OBELISK: Optical Biopsy using Endomicroscopy for Sinunasal Carcinoma and Deep Learning-based Assessment and Visualization

The overall objective of this research proposal is to develop and evaluate novel methods for the diagnosis and treatment of sinonasal tract tumors using CLE, with a focus on improving patient outcomes through enhanced visualization and decision support.

The diagnosis and treatment of sinonasal tract tumors pose significant challenges due to their rarity, complex anatomy, and limited visibility during surgical procedures. Traditional imaging techniques, such as computed tomography (CT) scans and magnetic resonance imaging (MRI), have limitations in providing detailed information about the tumor’s size, shape, location, and relationship with surrounding structures.

To address these challenges, researchers have been exploring the use of Confocal Laser Endoscopy (CLE) as a novel diagnostic tool. CLE involves using endoscopic instruments to visualize the inside of the nasal cavity and sinuses, allowing for more precise and minimally invasive diagnosis and treatment of tumors. However, the development of effective CLE systems requires significant advances in image processing, machine learning, and user interface design.

Our project, which is funded by the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG) and conducted together with the ENT clinic of the university hospital of the University of Würzburg (Principal Investigator: PD Dr. Miguel Gonçalves) aims to address these challenges by developing a novel CLE system that integrates advanced image processing techniques, robust machine learning algorithms, and intuitive user interfaces. The proposed system will be evaluated for its performance in diagnosing and treating sinonasal tract tumors, with a focus on improving patient outcomes through enhanced visualization and decision support.

In particular, we aim to co-register CLE information with the patient’s anatomy. For this, we use an off-the-shelve navigation device, and bundle it with the fine fibre bundle of the CLE device. This, together with a prior registration on the patient’s landmarks, allows to do a post-hoc analysis of tissue organization within the patient’s anatomy.

The complex patterns acquired from the CLE device, however, are challenging to interpret, and the projection onto the anatomical situation in 3D is a challenge for the experts. This is why we use machine learning models to evaluate the malignancy of the CLE frames, condensing the information significantly, and allowing for a visualization in the next step.

Ultimately, we want to provide a virtual endomicroscopy using 3D visualization techniques, where tumorous areas are visualized. We aim to investigate the potential of pre-surgical or post-surgical analysis for improving patient outcome using these techniques.

The proposed research has the potential to revolutionize the diagnosis and treatment of sinonasal tract tumors, enabling clinicians to provide more accurate diagnoses, effective treatments, and improved patient outcomes. 

Publications

Journal Papers

• Flurin Müller-Diesing, Matti Sievert, Bharat Akhanda Panuganti, Marc Aubreville, Nils Porsche, Stephan Hackenberg, Manuel Stöth, Agmal Scherzad, Markus Wirth, Philipp Winnand, Miguel Goncalves: Optical biopsy of nasal cavity cancer with confocal laser endomicroscopy – a pilot study. In: European Archives of Oto-Rhino-Laryngology, vol. 283, no. 3, pp. 1763–1770, 2026, ISSN: 0937-4477, 1434-4726.
• Flurin Müller-Diesing, Matti Sievert, Bharat Akhanda Panuganti, Marc Aubreville, Nils Porsche, Stephan Hackenberg, Manuel Stöth, Agmal Scherzad, Jasper Meyer, Markus Wirth, Miguel Goncalves: Feasibility of confocal laser endomicroscopy as an optical biopsy method for SCC on the auricle : an exploratory study. In: Oral and Maxillofacial Surgery, vol. 30, no. 1, pp. 21, 2026, ISSN: 1865-1569.
• Lisa Thesing, Matti Sievert, Bharat Akhanda Panuganti, Marc Aubreville, Till Meyer, Flurin Müller-Diesing, Agmal Scherzad, Stephan Hackenberg, Miguel Goncalves: Characterization of irradiated mucosa using confocal laser endomicroscopy in the upper aerodigestive tract. In: European Archives of Oto-Rhino-Laryngology, vol. 282, no. 5, pp. 2507–2514, 2025, ISSN: 0937-4477, 1434-4726.
• Marc Aubreville, Jonathan Ganz, Jonas Ammeling, Emely Rosbach, Thomas Gehrke, Agmal Scherzad, Stephan Hackenberg, Miguel Goncalves: Prediction of tumor board procedural recommendations using large language models. In: European Archives of Oto-Rhino-Laryngology, 2024, ISSN: 1434-4726.

Conference Papers

• Nils Porsche, Flurin Müller-Diesing, Sweta Banerjee, Miguel Goncalves, Marc Aubreville: Filtering Scheme for Confocal Laser Endomicroscopy (CLE)-video Sequences for Self-supervised Learning. In: Handels, Heinz; Breininger, Katharina; Deserno, Thomas; Maier, Andreas; Maier-Hein, Klaus; Palm, Christoph; Tolxdorff, Thomas (Ed.): Bildverarbeitung für die Medizin 2026, pp. 375–380, Springer Fachmedien Wiesbaden, Wiesbaden, 2026, ISBN: 978-3-658-51099-2 978-3-658-51100-5, (Series Title: Informatik aktuell).