AI-Assisted Surgical Guidance
Investigating how computational analysis, tracking, and anatomical awareness can support surgical guidance while respecting clinicians’ limited visual attention.
WP1WP6
Research
Integrated research on multisensory perception, surgical sonification, spatial interaction, artificial intelligence, and clinical translation.
The research programme investigates how advanced computational systems communicate with clinicians through perceptually meaningful visual and auditory information. Its scientific themes address human perception, performance, and translation, supported by a connected set of enabling technologies.
Scientific Research Themes
These visitor-oriented themes describe the scientific questions investigated across the project and identify the contributing work packages.
Computational Sonification
Studying how surgical and model-derived information can be translated into structured auditory signals that complement conventional visual displays.
WP2WP3
Operating Room Soundscapes
Modeling realistic spatial operating-room sound environments to examine auditory scenes, information demands, and interference under ecologically meaningful conditions.
WP2
Human Multisensory Perception
Examining how visual and auditory information influence detection, discrimination, navigation, cognitive load, and fatigue in controlled and active tasks.
WP4WP5
Expertise and Training
Investigating how experience, learning, and training shape the use of multisensory guidance and performance in demanding surgical tasks.
WP5
Clinical Translation
Evaluating optimized multisensory guidance in realistic ophthalmic experiments, with attention to clinical usability, performance, and translational potential.
WP6
Enabling Technologies
These capabilities support research across multiple themes rather than representing work packages themselves.
Vibroacoustic Interaction & Sensing
Capturing and interpreting vibroacoustic signals generated during surgical interaction as a basis for experimental sensing and feedback methods.
Medical XR
Creating controlled immersive environments for surgical simulation, interaction studies, and repeatable experimental evaluation.
Artificial Intelligence
Supporting analysis and context-aware guidance within experimental computer-assisted surgical workflows.
Spatial Audio
Reproducing and designing spatially structured sound for operating-room simulation and perceptual experiments.
Physics-based Modeling
Connecting computational models of surgical interaction with interpretable auditory representations and experimental simulations.
Publications
Preprint2026SonificationHuman–Computer InteractionImage and Video Processing
Physics-Based iOCT Sonification for Real-time Interaction Awareness in Subretinal Injection
Luis D. Reyes Vargas, Veronica Ruozzi, Andrea K. M. Ross, Shervin Dehghani, Michael Sommersperger, Koorosh Faridpooya, Mohammad Ali Nasseri, Merle Fairhurst, Nassir Navab, Sasan Matinfar
arXiv preprint arXiv:2605.14500
This preprint presents a real-time, physics-inspired sonification framework that maps segmented intraoperative OCT anatomy, needle motion, and retinal deformation to auditory feedback for subretinal injection guidance. A controlled study with 34 participants and an evaluation by four experts examined event identification and clinical relevance.
Software, Datasets, and Research Outputs
Software repositoryComing soon
iOCT Sonification for Subretinal Injection
Official repository for code and samples associated with the project’s physics-based iOCT sonification research. The repository is public, with its resources currently marked as coming soon.
View repository on GitHub →