Towards Explainable Interactive Multi-Modal Video Retrieval with vitrivr

Authors
Silvan Heller, Ralph Gasser, Cristina Illi, Maurizio Pasquinelli, Loris Sauter, Florian Spiess, Heiko Schuldt
Type
In Proceedings
Date
2021/6
Appears in
Proceedings of the 27th International Conference on Multimedia Modeling (MMM 2021)
Location
Prague, Czech Republic (held virtually)
Abstract

This paper presents the most recent iteration of the vitrivr multimedia retrieval system for its participation in the Video Browser Showdown (VBS) 2021. Building on existing functionality for interactive multi-modal retrieval, we overhaul query formulation and results presentation for queries which specify temporal context, extend our database with index structures for similarity search and present experimental functionality aimed at improving the explainability of results with the objective of better supporting users in the selection of results and the provision of relevance feedback.

Research Projects