Multi-Modal Video Retrieval in Virtual Reality with vitrivr-VR

In multimedia search, appropriate user interfaces (UIs) are essential to enable effective specification of the user’s information needs and the user-friendly presentation of search results. vitrivr-VR addresses these challenges and provides a novel Virtual Reality-based UI on top of the multimedia retrieval system vitrivr. In this paper we present the version of vitrivr-VR participating in the Video Browser Showdown (VBS) 2022. We describe our visual-text co-embedding feature and new query interfaces, namely text entry, pose queries and temporal queries.

• Heiko Schuldt
• Ralph Gasser
• Loris Sauter
• Florian Spiess
• Luca Rossetto
• Silvan Heller
• Mahnaz Parian-Scherb

• vitrivr
• vitrivr-VR