camp

Medical Augmented Reality

International Lecture Series & Summer School
Computer Aided Medical Procedures

Motivation

Augmented Reality (AR) is a constantly growing field in computer science. Research efforts have been continually intensified and solutions have been developed for various domains such as entertainment, industry, art, communication, education, navigation, architecture and medicine. By extending the real world with virtual, computer generated information, the perception of natural environments can be enriched, and the surrounding world can be interactively manipulated. Especially in the medical field, advanced imaging technologies transformed the surgical practice in the last few decades which offers a whole new world of capabilities for the application of AR systems.

An intra-operative AR system concept. Illustration by Marc Lazarovici and Alexander Winkler

AR has the potential to revolutionize medicine. During surgery, AR systems provide medical imaging data and other patient information superimposed on the operation area in the most intuitive way. Furthermore, AR aided navigation systems can reduce the risk of complications and improve the safety and quality of surgeries, AR education systems train the surgeons of tomorrow to acquire the critical skills and AR rehabilitation concepts help patients to recover faster after interventions. However, while research is rapidly evolving in the field of Medical Augmented Reality, strong relationships between doctors, engineers and industry are the key for the development and implementation of new AR systems in medicine.

Our Chair for Computer Aided Medical Procedures (CAMP) at TU Munich and JHU Baltimore is one of the strongest and leading research centers for medical AR world-wide. For the last two decades, various AR systems have been developed and evaluated for a wide range of medical applications, including the world’s first AR-enabled C-arm. The CAMP chair possesses a comprehensive portfolio of AR related research projects, publications and live demonstrations at several high impact journals and international conferences. In cooperation with the HMZ Flagship Zurich we are bringing together surgery, imaging, computer science and engineering to develop, integrate, optimize and clinically validate state-of-the-art AR technologies to improve surgical capabilities and embed them in efficient and cost-effective clinical workflows for the benefit of the patient.

News

NARVIS featured in ARD Documentary

More Info

NARVIS Magic Mirror in BBC Arabia Documentary

More Info

Camera Augmented Mobile C-arm (CAMC) Project Page

More Info

Student projects Medical AR Lecture @TUM slideshow

More Info

Medical Augmented Reality Summer School 2019

The focus of the Medical Augmented Reality Summer School Zurich is to teach the new generation of scientists the basics, challenges and recent advantages of Augmented Reality as well as to strengthen the connection between medicine, science and industry. In the first week, leading scientists of the field present keynotes and insights from a medical and technical point of view. A condensed version of the TU Munich and JHU Baltimore lecture “Medical Augmented Reality” provides profound theoretical knowledge of the topic. In the second week, the participants realize their own Medical AR solutions using cutting-edge technologies in interdisciplinary teams. During this year's event, 20 individual Medical AR solutions have been developed during the hackathon by a total number of 66 participants from all over the world. We would like to thank all participants and speakers, as well as all the people who made this event so exceptional. Furthermore, we would like to thank Balgrist university hospital to provide the platform and environment for the MARSS '19.

Our events are endorsed by the MICCAI society and covered by the MICCAI Code of Conduct.

MARSS '19 Participants

MARSS19 Participants from Country

Participant Feedback

Really great material coverage
Broad range of topics, great speakers!
Excited and active audience and interaction with speakers
Good integration between technical, industrial and medical perspectives
Detailed and relevant to the field. Speakers were all incredible knowledgeable as well
It was great to work in a team and come up with something in a short amount of time!

Agenda MARSS '19

A downloadable version of the MARSS '19 Program can be found here.

First week

Time Monday 5th Tuesday 6th Wednesday 7th Thursday 8th Friday 9th Saturday 10th
08:30 - 09:30 Keynote
Prof. Dr. med.
Farshad
Keynote
Prof. Dr. Osgood
Keynote
Dr. med. Heining
Keynote
Dr. Moctezuma
Lecture
CAMC
Keynote
Dr. med. Weidert
09:30 - 10:30 Keynote
Prof. Dr. Navab
Keynote
PD Dr. Fürnstahl
Keynote
Dr. Alex Ilic
Keynote
Dr. Wolfgang Wein
Keynote
Dr. Till Bay
Keynote
Prof. Dr. Pollefeys
10:30 - 11:00 Coffee Break
11:00 - 12:30 Lecture
Transformations,
Camera Models
Keynote
PD Dr. Tombari
Lecture
Visual System, Perception
Lecture
Rendering
Lecture
Surgical Sonification
Hackathon
Project Preparation
12:30 - 13:30 Lunch Break
13:30 - 14:30 Keynote
Dr. Ulrich Eck
Keynote
Prof. Dr. Meboldt
Keynote
Prof. Dr. Unberath
Workshop
ImFusion Suite
Workshop
3D Modelling
Hackathon
Kickoff Preparation
14:30 - 15:00 Coffee Break
15:00 - 16:30 Lecture
State of the Art in Medical AR
Lecture
AR/VR HMDs,
Synchronization
Lecture
User Interaction
Keynote
Navid Navab
Hackathon
Team Administration
Hackathon
Kickoff Presentation
16:40 - 18:00 Exercise
Unity 101
Exercise
Introduction to HoloLens
Exercise
Introduction to
Magic Leap
(Joshua Naylor)
Exercise
Rendering
OR Visit --
Evening Program -- -- -- Dinner -- Street Parade Zurich


Second week

Time Monday 12th Tuesday 13th Wednesday 14th Thursday 15th Friday 16th
8:30 - 12:30 Hackathon Hackathon Hackathon Hackathon Demo Day Session 1&2
12:30 - 13:30 Lunch Break

13:30 - 18:00

Hackathon

Hackathon
Hackathon
Keynote
Prof. Dr. Eagleson

Hackathon
Demo Day Session 3&4
Audience Award
Closing Ceremony



Keynote Speakers of MARSS '19

Prof. Dr. Nassir Navab

Head of the Chair for Computer Aided Medical Procedures & Augmented Reality, Department of Computer Science, TU Munich

Prof. Dr. med. Mazda Farshad, MPH

Medical Director at Balgrist Hospital
Professor for Orthopedics at Universität Zürich

Prof. Dr. Greg Osgood, M.D.

Chief, Orthopaedic Trauma, Department of Orthopaedic Surgery, Johns Hopkins Hospital, Assistant Professor of Orthopaedic Surgery, JHU Baltimore

Prof. Dr. Marc Pollefeys

Director of Science at Microsoft HoloLens and Full Professor in the Institute for Visual Computing of the Dept. of Computer Science, ETH Zürich

Prof. Dr. Mirko Meboldt

Chair of Product Dev.& Eng. Design, ETH Zürich

Prof. Dr. Roy Eagleson

Professor in the Faculty of Engineering at the University of Western Ontario, Associate Scientist at the Robarts Research Institute, Scientist and Principal Investigator at CSTAR, Canada

PD Dr. Philipp Fürnstahl

Head of CARD Research Laboratory, Balgrist Hospital, Zurich

PD Dr. Federico Tombari

Research Scientist and Manager at Google, Zurich,
Adjunct Lecturer (PrivatDozent) at the Technical University of Munich (TUM)

A.R. Prof. Dr. Mathias Unberath

Assistant Research Professor, Laboratory for Computational Sensing and Robotics, Department of Computer Science at Johns Hopkins University, Baltimore

Dr. José-Luis Moctezuma de la Barrera

Vice President Advanced Technology and UX at Stryker, Freiburg im Breisgau, Germany

Dr. Alex Ilic

Head of Magic Leap Switzerland, Zürich

Dr. med. Sandro-Michael Heining

Former member of NARVIS Research Lab, TUM/LMU, Munich,
Senior Physician, Traumatology Department, UniversitätsSpital, Zurich

Dr. Till Bay

CEO, Co-Founder and Lead Engineer MR and Medical at Incremed, Zurich
CEO and Co-Founder Comerge AG, Zurich

Dr. med. Simon Weidert

Member of NARVIS Research Lab, TUM/LMU, Munich,
Physician, Traumatology and Orthopedic Surgery, LMU, Munich

Dr. Wolfgang Wein

CEO, ImFusion GmbH, Munich

Dr. Ulrich Eck

Senior Research Scientist, General Chair ISMAR 2018, TU Munich

Navid Navab

Associate Director in Responsive Media, Topological Media Lab, Concordia University, Montréal, Canada

Videos

People

Prof. Dr. Nassir Navab

Prof. Dr. med. Mazda Farshad

Prof. Dr. Greg Osgood, M.D.

Prof. Dr. med. Ekkehard Euler

PD Dr. Philipp Fürnstahl

A.R. Prof. Dr. Mathias Unberath

Dr. Ulrich Eck

Alex Johnson, M.D.

Dr. med. Simon Weidert

Dr. med. Sandro-Michael Heining, Oberarzt

Felix Bork

Alexander Winkler

Jakob Weiss

Alejandro Martín

Kevin Yu

Matthias Grimm

Matthias Seibold

Tobias Czempiel

Sasan Matinfar

Philipp Stefan

Javad Fotouhi

Ehsan Azimi

Long Qian

Sing Chun Lee

Marco von Atzigen

Florentin Liebmann

Partners

Related Publications

You can find all research related to Camera Augmented X-Ray Imaging on the CAMC Project Page. The following list contains recent CAMP publications on Medical Augmented Reality.

Contact