Towards Explainable Interactive Multi-Modal Video Retrieval with vitrivr

Silvan Heller, Ralph Gasser, Cristina Illi, Maurizio Pasquinelli, Loris Sauter, Florian Spiess, Heiko Schuldt
In Proceedings
Appears in
Proceedings of the 27th International Conference on Multimedia Modeling (MMM 2021)
Prague, Czech Republic (held virtually)

This paper presents the most recent iteration of the vitrivr multimedia retrieval system for its participation in the Video Browser Showdown (VBS) 2021. Building on existing functionality for interactive multi-modal retrieval, we overhaul query formulation and results presentation for queries which specify temporal context, extend our database with index structures for similarity search and present experimental functionality aimed at improving the explainability of results with the objective of better supporting users in the selection of results and the provision of relevance feedback.

Research Projects