Journal Papers

Lucia Vadicamo, Rahel Arnold, Werner Bailer, Fabio Carrara, Cathal Gurrin, Nico Hezel, Xinghan Li, Jakub Lokoc, Sebastian Lubos, Zhixin Ma, Nicola Messina, Thao-Nhu Nguyen, Ladislav Peska, Luca Rossetto, Loris Sauter, Klaus Schöffmann, Florian Spiess, Minh-Triet Tran, and Stefanos Vrochidis. 2024. Evaluating Performance and Trends in Interactive Video Retrieval: Insights from the 12th VBS Competition. IEEE Access, DOI:

Negin Ghamsarian, Yosuf El-Shabrawi, Sahar Nasirihaghighi, Doris Putzgruber-Adamitsch, Martin Zinkernagel, Sebastian Wolf, Klaus Schoeffmann, Raphael Sznitman. 2024. Cataract-1K Dataset for Deep-Learning-Assisted Analysis of Cataract Surgery Videos. Nature Scientific Data, Springer, Vol 3193. DOI:

Konstantin Schall, Werner Bailer, Kai-Uwe Barthel, Fabio Carrara, Jakub Lokoč, Ladislav Peška, Klaus Schoeffmann, Lucia Vadicamo, Claudio Vairo. 2024. Interactive multimodal video search: an extended post-evaluation for the VBS 2022 competition. International Journal of Multimedia Information Retrieval, Springer, Vol. 13, No. 2, 1-13, DOI:

Hadi Amirpour, Klaus Schoeffmann, Mohammad Ghanbari, Christian Timmerer. 2024. DeepVCA: Deep Video Complexity Analyzer. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT). To appear. Online first: DOI:

Negin Ghamsarian, Doris Putzgruber-Adamitsch, Stephanie Sarny, Raphael Sznitman, Klaus Schoeffmann, and Yosuf El-Sabrawi. 2024. Predicting Postoperative Intraocular Lens Dislocation in Cataract Surgery via Deep Learning. IEEE Access, DOI: 10.1109/ACCESS.2024.3361042, to appear

Negin Ghamsarian, Sebastian Wolf, Martin Zinkernagel, Klaus Schoeffmann, and Raphael Sznitman. 2024.
DeepPyramid+: Medical Image Segmentation using Pyramid View Fusion and Deformable Pyramid Reception.
International Journal of Computer Assisted Radiology and Surgery (IJCARS), Springer International Publishing, 9 pages, doi: 10.1007/s11548-023-03046-2

Jakub Lokoc, Stelios Andreadis, Werner Bailer, Aaron Duane, Cathal Gurrin, Zhixin Ma, Nicola Messina, Thao-Nhu Nguyen, Ladislav Peska, Luca Rossetto, Loris Sauter, Konstantin Schall, Klaus Schoeffmann, Omar Shahbaz Khan, Florian Spiess, Lucia Vadicamo, Stefanos Vrochidis. 2023. Interactive Video Retrieval in the Age of Effective Joint Embedding Deep Models: Lessons from the 11th VBS. Multimedia Systems, Springer, Vol. 29, 3481-3504. doi: 10.1007/s00530-023-01143-5

Vignesh V Menon, Prajit T Rajendran, Christian Feldmann, Klaus Schoeffmann, Mohammad Ghanbari, and Christian Timmerer. 2023. JND-aware Two-pass Per-title Encoding Scheme for Adaptive Live Streaming. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT). Vol. 34, No. 2, 1281-1294, DOI:

Ly-Duyen Tran, Manh-Duy Nguyen, Duc-Tien Dang-Nguyen, Silvan Heller, Florian Spiess, Jakub Lokoc, Ladislav Peska, Thao-Nhu Nguyen, Omar Shahbaz Khan, Aaron Duane, Björn Þór Jónsson, Luca Rossetto, An-Zi Yen, Ahmed Alateeq, Naushad Alam, Minh-Triet Tran, Graham Healy, Klaus Schoeffmann, Cathal Gurrin. 2023. Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021. IEEE Access. DOI:

Silvan Heller, Viktor Gsteiger, Werner Bailer, Cathal Gurrin, Björn Thor Jonsson, Jakub Lokoc, Andreas Leibetseder, Frantisek Mejzlik, Ladislav Peska, Luca Rossetto, Konstantin Schall, Klaus Schoeffmann, Heiko Schuldt, Florian Spiess, Ly-Duyen Tran, Lucia Vadicamo, Patrik Vesely, Stefanos Vrochidis, and Jiaxin Wu. 2022. Interactive Video Retrieval Evaluation at a Distance: Comparing Sixteen Interactive Video Search Systems in a Remote Setting at the 10th Video Browser Showdown. International Journal of Multimedia Information Retrieval (IJMR) 11, Springer, USA, 1-18, doi: 10.1007/s13735-021-00225-2.

Andreas Leibetseder, Klaus Schoeffmann, Jörg Keckstein, Simon Keckstein. 2022. Endometriosis Detection and Localization in Laparoscopic Gynecology. Multimedia Tools and Applications (MTAP) 81, Springer, USA, 6191-6215. doi:

Natalia Sokolova, Klaus Schoeffmann, Mario Taschwer, Stephanie Sarny, Doris Putzgruber-Adamitsch, and Yosuf El-Shabrawi. 2021. Automatic detection of pupil reactions in cataract surgery videos. PLOS ONE. 14 pages. DOI:

Jakub Lokoč, Patrik Veselý, František Mejzlík, Gregor Kovalčík, Tomáš Souček, Luca Rossetto, Klaus Schoeffmann, Werner Bailer, Cathal Gurrin, Loris Sauter, Jaeyub Song, Stefanos Vrochidis, Jiaxin Wu, and Björn þóR Jónsson. 2021. Is the Reign of Interactive Search Eternal? Findings from the Video Browser Showdown 2020. ACM Trans. Multimedia Comput. Commun. Appl. 17, 3, Article 91 (August 2021), 26 pages. DOI:

Negin Ghamsarian, Klaus Schoeffmann, and Morteza Khademi. 2021. Blind MV-based Video Steganalysis Based on Joint Inter-Frame and Intra-frame Statistics. Multimedia Tools and Applications (MTAP) 80, Springer, USA, 9137-9159,

Tobias Roß, Annika Reinke, Peter M. Full, Martin Wagner, Hannes Kenngott, Martin Apitz, Hellena Hempe, Diana Mindroc-Filimon, Patrick Scholz, Thuy Nuong Tran, Pierangela Bruno, Pablo Arbeláez, Gui-Bin Bian, Sebastian Bodenstedt, Jon Lindström Bolmgren, Laura Bravo-Sánchez, Hua-Bin Chen, Cristina González, Dong Guo, Pål Halvorsen, Pheng-Ann Heng, Enes Hosgor, Zeng-Guang Hou, Fabian Isensee, Debesh Jha, Tingting Jiang, Yueming Jin, Kadir Kirtac, Sabrina Kletz, Stefan Leger, Zhixuan Li, Klaus H. Maier-Hein, Zhen-Liang Ni, Michael A. Riegler, Klaus Schoeffmann, Ruohua Shi, Stefanie Speidel, Michael Stenzel, Isabell Twick, Gutai Wang, Jiacheng Wang, Liansheng Wang, Lu Wang, Yujie Zhang, Yan-Jie Zhou, Lei Zhu, Manuel Wiesenfarth, Annette Kopp-Schneider, Beat P. Müller-Stich, and Lena Maier-Hein. 2021. Comparative validation of multi-instance instrument segmentation in endoscopy: Results of the ROBUST-MIS 2019 challenge. Medical Image Analysis, Elsevier, Volume 70, No. 101920, doi:

Luca Rossetto, Ralph Gasser, Jakub Lokoc, Werner Bailer, Klaus Schoeffmann, Bernd Münzer, Tomas Soucek, Phuong Anh Nguyen, Paolo Bolettieri, Andreas Leibetseder, Stefanos Vrochidis. 2021. Interactive Video Retrieval in the Age of Deep Learning – Detailed Evaluation of VBS 2019. IEEE Transactions on Multimedia (TMM), Volume 23, 243-256.

Sabrina Kletz, Klaus Schoeffmann, and Heinrich Husslein. 2019. Learning the Representation of Instrument Images in Laparoscopy Videos. Special Issue of the IET’s HealthCare Technology Letters Journal (IET HTL). Institution of Engineering and Technology (IET). 6 pages

Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Andreas Leibetseder, Liting Zhou, Aaron Duane, Duc-Tien Dang-Nguyen, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Lokoč, and Wolfgang Hürst. 2019. Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018). ITE Transactions on Media Technology and Applications7(2), 46-59.

Jakub Lokoc, Gregor Kovalcik, Bernd Münzer, Klaus Schöffmann, Werner Bailer, Ralph Gasser, Stefanos Vrochidis, Phuong Anh Nguyen, Sitapa Rujikietgumjorn, and Kai Uwe Barthel. 2019. Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018. Transactions on Multimedia Computing Communications and Applications (TOMM), 15, 1, ACM, 24 pages, Article No. 29.

Stefan Petscharnig and Klaus Schoeffmann. 2018. Binary Convolutional Neural Network Features Off-the-Shelf for Image to Video Linking in Endoscopic Multimedia Databases. Multimedia Tools and Applications (MTAP), 77, 21, Springer, USA, 28817-28842.

Jakub Lokoc, Werner Bailer, Klaus Schoeffmann, Bernd Münzer, George Awad. 2018. On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015-2017. IEEE Transactions on Multimedia (TMM), 20, 12, IEEE, New York, NY, 3361-3376.

Stefan Petscharnig and Klaus Schoeffmann. 2018. Learning Laparoscopic Video Shot Classification for Gynecological Surgery. Multimedia Tools and Applications (MTAP), 77, 7, Springer US, 8061-8079.
Link (Open Access).

Bernd Münzer, Klaus Schoeffmann, and Laszlo Böszömenyi. 2018. Content-based Processing and Analysis of Endoscopic Images and Videos: A Survey. Multimedia Tools and Applications (MTAP), 77, 1, Springer US, 1323-1362.
Link (Open Access).

Klaus Schoeffmann, Heinrich Husslein, Sabrina Kletz, Stefan Petscharnig, Bernd Münzer, and Christian Beecks. 2018. Video Retrieval in Laparoscopic Video Recordings with Dynamic Content Descriptors. Multimedia Tools and Applications (MTAP), 77, 13, Springer, USA, 16813-16832.
Link (Open Access). Dataset.

Claudiu Cobarzan, Klaus Schoeffmann, Werner Bailer, Wolfgang Hürst, Adam Blazek, Jakub Lokoc, Stefanos Vrochidis, Kai U. Barthel, and Luca Rossetto. 2017. Interactive Video Search Tools: A Detailed Analysis of the Video Browser Showdown 2015. Multimedia Tools and Applications (MTAP), 76, 4, Springer, USA, 5539-5571.

Klaus Schoeffmann and Lukas Burgstaller. 2016. A Convenient Interface for Video Navigation on Smartphones. International Journal of Multimedia Data Engineering and Management (IJMDEM), 7, 3, IGI Publishing, Hershey, PA, USA, 16 pages.

Klaus Schoeffmann, Marco A. Hudelist, and Jochen Huber. 2015. Video Interaction Tools: A Survey of Recent Work. ACM Computing Surveys 48, 1, Article 14 (September 2015), 34 pages. DOI:

Klaus Schoeffmann, Manfred Del Fabro, Tibor Szkaliczki, Laszlo Böszörmenyi, and Jörg Keckstein. 2015. Keyframe Extraction in Endoscopic Video. Multimedia Tools and Applications, 74, 24, Springer, USA, 11187–11206.

Klaus Schoeffmann. 2014. A User-Centric Media Retrieval Competition: The Video Browser Showdown 2012-2014. IEEE Multimedia, 21, 4, IEEE, New York, NY, USA, 8-13.

Klaus Schoeffmann, David Ahlström, and Marco Andrea Hudelist. 2014. 3-D Interfaces to Improve the Performance of Visual Known-Item Search. IEEE Transactions on Multimedia, 16, 7, IEEE, New York, NY, USA, 1942-1951.

Marco A. Hudelist, Klaus Schoeffmann, and David Ahlström. 2014. Evaluating Alternatives to the 2D Grid Interface for Mobile Image Browsing. International Journal of Semantic Computing, 8, 2, World Scientific, 25 pages.

Klaus Schoeffmann, David Ahlström, Werner Bailer, Claudiu Cobarzan, Frank Hopfgartner, Kevin McGuinness, Cathal Gurrin, Christian Frisson, Duy-Dinh Le, Manfred del Fabro, Hongliang Bai, and Wolfgang Weiss. 2014. The Video Browser Showdown: A Live Evaluation of Interactive Video Search Tools, International Journal of Multimedia Information Retrieval (MMIR), 3, 2, Springer, London, 113-127.

Klaus Schoeffmann and David Ahlström. 2012. An Evaluation of Color Sorting for Image Browsing. International Journal of Multimedia Data Engineering and Management, 3, 1, IGI Publishing, Hershey, PA, USA, 14 pages.

Klaus Schoeffmann, Frank Hopfgartner, Oge Marques, Laszlo Boeszoermenyi, and Joemon M. Jose. 2010. Video browsing interfaces and applications: a review, SPIE Reviews, 1, 1, SPIE,USA, 1-35 (018004).

Mathias Lux, Oge Marques, Klaus Schoeffmann, Laszlo Boeszoermenyi, and Georg Lajtai. 2009. A Novel Tool for Summarization of Arthroscopic Videos, Multimedia Tools and Applications, 46, 2-3. Springer, USA, 521-544.