Multi-Modal Interactive Video Retrieval with Temporal Queries

Authors
Silvan Heller, Rahel Arnold, Ralph Gasser, Viktor Gsteiger, Mahnaz Parian-Scherb, Luca Rossetto, Loris Sauter, Florian Spiess, Heiko Schuldt
Type
In Proceedings
Date
2022/4
Appears in
Proceedings of the 28th International Conference on Multimedia Modeling
Location
Qui Nhon, Vietnam
Abstract

This paper presents the version of vitrivr participating at the Video Browser Showdown (VBS) 2022. vitrivr already supports a wide range of query modalities, such as color and semantic sketches, OCR, ASR and text embedding. In this paper, we briefly introduce the system, then describe our new approach to queries specifying temporal context, ideas for color-based sketches in a competitive retrieval setting and a novel approach to pose-based queries.

Research Projects