Medical Augmented Reality Summer School 2023

The 3rd edition of the Medical Augmented Reality Summer School took place from September 4–15, 2023 at Balgrist University Hospital in Zurich, Switzerland. The event brought together the world’s experts in Medical AR, clinicians, companies and talented academic researchers from all around the world.

Location: Balgrist University Hospital, Zurich, Switzerland Dates: September 4–15, 2023 Organizers: Balgrist University Hospital (Zurich, Switzerland) and Technical University Munich (Germany)

MARSS23 provided access to the brand-new translational center for surgery, the OR-X, a highly technological equipped research and training infrastructure where surgical innovation and education can happen without patient burden.

This event was endorsed by the MICCAI society and covered by the MICCAI Code of Conduct.

Video

Hackathon Results

Interdisciplinary teams consisting of participants from research, industry, and clinic developed novel Medical Augmented Reality systems, supported by experienced surgeons and AR experts.

MARSS Audience Award Winners:

First Place (Gold): Josep Ferrer Rivero, Hamza Mekhzoum – Cam resection based on augmented arthroscopy
Second Place (Silver): Iwein Bau, Sebastian Andres, Gijs Luijten – LLM-based AR home assistant for dementia patients
Third Place (Bronze): Andreas Keller, John Ricklin, Leandro Paganotti – Magic Leap remote rendering for visualization in Anatomy teaching

Agenda MARSS23

First Week (September 4–8)

Time	Monday	Tuesday	Wednesday	Thursday	Friday
09:00–10:00	Welcome & Instructions	Keynote: Prof. Siyu Tang ETH Zurich, Computer Vision and Learning Group	Keynote: Prof. Marc Pollefeys Microsoft Mixed Reality & AI Lab / ETH Zürich	Keynote: Prof. Effy Vayena Professor of Bioethics, ETH Zurich	OR-X Live Surgery: Dr. Christoph Laux
10:00–11:00	Keynote: Prof. Henry Fuchs University of North Carolina, Chapel Hill, USA	Lecture: Visual System & Perception (Prof. Alejandro Martin-Gomez)	Lecture: AR Devices	Keynote: Navid Navab Topological Media Lab, Concordia University
11:30–12:30	Keynote: Prof. Alex Johnson, MD Johns Hopkins Department of Orthopaedic Surgery	Keynote: Prof. Philipp Fürnstahl ROCS, Balgrist University Hospital	Keynote: Prof. Terry Peters Robarts Research Institute, Western University, Canada	Lecture: Acoustic Sensing & Sonification	Keynote: Prof. Roy Eagleson University of Western Ontario
13:30–14:30	Keynote: Prof. Nassir Navab TU Munich	Hackathon: Project Brainstorming	Lecture: Rendering & Visualization	Keynote: Prof. Greg Osgood, MD Johns Hopkins Hospital	Lecture: User Interaction
15:00–16:00	OR-X Introduction	Workshop: AR in Robotics (KU Leuven)	OR-X Industry Demos	Workshop: ImFusion (Auditorium) / Materialise (OK B61)	Hackathon: Kickoff Preparation
16:00–18:00	OR-X Live Surgery: Prof. Mazda Farshad	Workshop: NVIDIA Clara Holoscan		Keynote: Prof. Sandrine De Ribaupierre, MD Western University, London, Ontario, Canada	Hackathon: Kickoff Presentations
17:00–18:00		Workshop: Neural Radiance Fields (Sergey Prokudin, ETHZ)	Panel Discussion	Workshop: Blender Tutorial / Unity 101 AR Dev for Medical
19:00–22:00		Pizza Night		Conference Dinner

Second Week (September 11–15)

Time	Monday	Tuesday	Wednesday	Thursday	Friday
08:30–12:30	Hackathon	Hackathon	Hackathon	Hackathon	Demo Day Sessions 1 & 2
13:30–18:00	Hackathon	Hackathon	Hackathon	Hackathon	Demo Day Sessions 3 & 4
16:30–17:00					Audience Award 1st: Josep Ferrer Rivero, Hamza Mekhzoum – Cam resection based on augmented arthroscopy 2nd: Iwein Bau, Sebastian Andres, Gijs Luijten – LLM-based AR home assistant for dementia patients 3rd: Andreas Keller, John Ricklin, Leandro Paganotti – Magic Leap remote rendering for anatomy teaching
17:00–18:00					Closing Ceremony

Keynote Speakers

Prof. Dr. Henry Fuchs

Professor of Computer Science and Adjunct Professor of Biomedical Engineering, University of North Carolina, Chapel Hill, USA

Prof. Dr. Terry Peters

Professor Medical Imaging, Medical Biophysics, and Biomedical Engineering, Robarts Research Institute, Western University, London, Ontario, Canada. Head of the VASST Lab

Prof. Dr. Nassir Navab

Head of the Chair for Computer Aided Medical Procedures & Augmented Reality, Department of Computer Science, TU Munich

Prof. Dr. Philipp Fürnstahl

Professor in Orthopedic Computer Science, Head of ROCS (Research in Orthopedic Computer Science), Balgrist University Hospital, University of Zurich

Prof. Mazda Farshad, MD, MPH

Medical Director at Balgrist Hospital, Professor for Orthopedics at Universität Zürich

Prof. Dr. Effy Vayena

Professor of Bioethics at the Swiss Institute of Technology (ETH) Zurich, Switzerland

Prof. Dr. Marc Pollefeys

Director Mixed Reality and AI Lab at Microsoft and Full Professor in the Institute for Visual Computing, ETH Zürich

Prof. Dr. Siyu Tang

Assistant Professor of Computer Science, Group Lead Computer Vision and Learning Group (VLG), ETH Zurich

Prof. Sandrine De Ribaupierre, MD

Associate Professor of Neurosurgery, Western University, London, Ontario, Canada

Prof. Dr. Roy Eagleson

Professor in the Faculty of Engineering at the University of Western Ontario, Associate Scientist at the Robarts Research Institute

Prof. Dr. med. Alex Johnson

Director of Hip Preservation, Johns Hopkins Department of Orthopaedic Surgery, Assistant Professor of Orthopaedic Surgery, Baltimore, USA

Prof. Greg Osgood, MD

Chief, Orthopaedic Trauma, Department of Orthopaedic Surgery, Johns Hopkins Hospital, Assistant Professor of Orthopaedic Surgery, JHU Baltimore

Christoph Laux, MD

Senior Surgeon Spine Surgery, Balgrist University Hospital, Zurich, Switzerland

Navid Navab

Associate Director in Responsive Media, Topological Media Lab, Concordia University, Montréal, Canada

Prof. Dr. Alejandro Martin-Gomez

Assistant research professor in the Department of Computer Science, Laboratory for Computational Sensing and Robotics (LCSR), JHU Baltimore, USA

Industry Partners

Hardware Sponsors

Software Sponsors