camp

Medical Augmented Reality

International Lecture Series & Summer School
Computer Aided Medical Procedures

Motivation

Augmented Reality (AR) is a constantly growing field in computer science. Research efforts have been continually intensified and solutions have been developed for various domains such as entertainment, industry, art, communication, education, navigation, architecture and medicine. By extending the real world with virtual, computer generated information, the perception of natural environments can be enriched, and the surrounding world can be interactively manipulated. Especially in the medical field, advanced imaging technologies transformed the surgical practice in the last few decades which offers a whole new world of capabilities for the application of AR systems.

An intra-operative AR system concept. Illustration by Marc Lazarovici and Alexander Winkler

AR has the potential to revolutionize medicine. During surgery, AR systems provide medical imaging data and other patient information superimposed on the operation area in the most intuitive way. Furthermore, AR aided navigation systems can reduce the risk of complications and improve the safety and quality of surgeries, AR education systems train the surgeons of tomorrow to acquire the critical skills and AR rehabilitation concepts help patients to recover faster after interventions. However, while research is rapidly evolving in the field of Medical Augmented Reality, strong relationships between doctors, engineers and industry are the key for the development and implementation of new AR systems in medicine.

Our Chair for Computer Aided Medical Procedures (CAMP) at TU Munich and JHU Baltimore is one of the strongest and leading research centers for medical AR world-wide. For the last two decades, various AR systems have been developed and evaluated for a wide range of medical applications, including the world’s first AR-enabled C-arm. The CAMP chair possesses a comprehensive portfolio of AR related research projects, publications and live demonstrations at several high impact journals and international conferences. In cooperation with the HMZ Flagship Zurich we are bringing together surgery, imaging, computer science and engineering to develop, integrate, optimize and clinically validate state-of-the-art AR technologies to improve surgical capabilities and embed them in efficient and cost-effective clinical workflows for the benefit of the patient.

News

Camera Augmented Mobile C-arm (CAMC) Project Page

More Info

Summer School 2019

The focus of the Medical Augmented Reality Summer School Zurich is to teach the new generation of scientists the basics, challenges and recent advantages of Augmented Reality as well as to strengthen the connection between medicine, science and industry. In the first week, leading scientists of the field will present keynotes and insights from a medical and technical point of view. A condensed version of the TU Munich and JHU Baltimore lecture “Medical Augmented Reality” will provide profound theoretical knowledge of the topic. In the second week, the participants will develop their own Medical AR solutions using cutting-edge technologies in interdisciplinary teams. The best project will be awarded on the last day of the summer school.

The Balgrist Campus, Zurich

The Medical AR Summer School 2019 will be hosted from Aug 5th to Aug 16th at Balgrist hospital Campus, Zurich, and will consist of 45 attendants. The interdisciplinary teams will each be composed of 3 participants. One engineering student, one medical student and one industry person will work together on an individual project. The application is open to MSc and PhD students with background in engineering, life sciences, computer science, mathematics and physics, for medical students as well as for industry partners.

This event is endorsed by the MICCAI society and covered by the MICCAI Code of Conduct.

More Information:

Agenda

Day 1:

Welcome Ceremony

Technical keynote: Prof. Dr. Nassir Navab

Topic: Computer Assisted Medical Procedures and Augmented Reality

Medical keynote: Prof. Dr. med. Mazda Farshad

Topic: Augmented Reality in Specialized Spine Surgery

Medical AR Lectures & Exercises (based on TUM & JHU course)

Day 2:

Technical keynote: Dr. Till Bay

Topic: Building apps for the OR: live coding, patterns and tools

Medical keynote: Dr.med. Sandro-Michael Heining

Topic: Importance of Depth Perception and Workflow Integration in Medical AR: A Surgeon Experience at the NARVIS Research Laboratory

Medical AR Lectures & Exercises (based on TUM & JHU course)

Day 3:

Technical keynote: Prof. Dr. Marc Pollefeys

Topic: Computer Vision on HoloLens

Medical keynote: Prof. Dr. Greg Osgood

Topic: Augmented Reality in Orthopaedic Trauma Surgery

Medical AR Lectures & Exercises (based on TUM & JHU course)

Surgery Visit at Balgrist hospital

Day 4:

Technical keynote: Dr. Wolfgang Wein

Topic: Visual Computing for Advanced Image-Guided Interventions and Image Reconstruction

Technical keynote: Dr. Herbert Bay

Topic: TBA

Technical keynote: Dr. José-Luis Moctezuma de la Barrera

Topic: TBA

Medical AR Lectures & Exercises (based on TUM & JHU course)

Day 5:

Technical keynote: Navid Navab

Topic: Sonic Interaction Design: From Auditory Displays towards Behavioral Resonance

Technical keynote: Dr. med. Simon Weidert

Topic: Personal Opinion on Medical AR Hardware and Software Requirements in Orthopaedic Surgery

Medical AR Lectures & Exercises (based on TUM & JHU course)

Project Presentations

Interdisciplinary Teams and Project Selection

Days 6-9:

Practical Application of the Acquired Skills in Individual Projects

Progress Reports and Mentoring by Experts

Day 10:

Final Project Presentations

Presentation of the Award Winner

Closing Ceremony


Confirmed Speakers

Prof. Dr. Nassir Navab

Head of the Chair for Computer Aided Medical Procedures & Augmented Reality, Department of Computer Science, TU Munich

Prof. Dr. med. Mazda Farshad, MPH

Medical Director at Balgrist Hospital
Professor for Orthopedics at Universität Zürich

Prof. Dr. Greg Osgood, M.D.

Chief, Orthopaedic Trauma, Department of Orthopaedic Surgery, Johns Hopkins Hospital, Assistant Professor of Orthopaedic Surgery, JHU Baltimore

Prof. Dr. Marc Pollefeys

Director of Science at Microsoft HoloLens and Full Professor in the Institute for Visual Computing of the Dept. of Computer Science, ETH Zürich

Dr. José-Luis Moctezuma de la Barrera

Vice President Advanced Technology and UX at Stryker, Freiburg im Breisgau, Germany

Dr. Herbert Bay

Principal Software Engineer, Digital Health & User Perception at Magic Leap, Zürich

Dr. med. Sandro-Michael Heining

Former member of NARVIS Research Lab, TUM/LMU, Munich,
Senior Physician, Traumatology Department, UniversitätsSpital, Zurich

Dr. Till Bay

CEO, Co-Founder and Lead Engineer MR and Medical at Incremed, Zurich
CEO and Co-Founder Comerge AG, Zurich

Dr. med. Simon Weidert

Member of NARVIS Research Lab, TUM/LMU, Munich,
Physician, Traumatology and Orthopedic Surgery, LMU, Munich

Dr. Wolfgang Wein

CEO, ImFusion GmbH, Munich

Dr. Ulrich Eck

Senior Research Scientist, General Chair ISMAR 2018, TU Munich

Navid Navab

Associate Director in Responsive Media, Topological Media Lab, Concordia University, Montréal, Canada

Application Form

The expected cost of the summer school will be 600 CHF for Master, PhD and medical students. Selected students will receive an award covering full or part of the school fee. The details for this award will be announced in June. The fee for industry will be 3000 CHF per person for the two-week program. Applications can be submitted using the form below.

The deadline for the application is May 25th 2019.

Videos

People

Prof. Dr. Nassir Navab

Prof. Dr. med. Mazda Farshad

Prof. Dr. Greg Osgood, M.D.

Prof. Dr. med. Ekkehard Euler

A.R. Prof. Dr. Mathias Unberath

Dr. Ulrich Eck

Dr. Philipp Fürnstahl

Alex Johnson, M.D.

Dr. med. Simon Weidert

Dr. med. Sandro-Michael Heining, Oberarzt

Felix Bork

Alexander Winkler

Jakob Weiss

Alejandro Martín

Kevin Yu

Matthias Grimm

Matthias Seibold

Tobias Czempiel

Sasan Matinfar

Philipp Stefan

Javad Fotouhi

Ehsan Azimi

Long Qian

Sing Chun Lee

Marco von Atzigen

Florentin Liebmann

Partners

Related Publications

You can find all research related to Camera Augmented X-Ray Imaging on the CAMC Project Page. The following list contains recent CAMP publications on Medical Augmented Reality.

Contact