Combining Boolean and Multimedia Retrieval in vitrivr for large-scale Video Search

Authors
Loris Sauter, Mahnaz Amiri Parian, Ralph Gasser, Silvan Heller, Luca Rossetto, Heiko Schuldt
Type
In Proceedings
Date
2020/1
Appears in
Proceedings of the 26th International Conference on MultiMedia Modeling
Location
Daejeon, Korea
Publisher
Springer
Abstract

This paper presents the most recent additions to the vitrivr multimedia retrieval stack made in preparation for the participation to the 9th Video Browser Showdown (VBS) in 2020. In addition to refi ning existing functionality and adding support for classical Boolean queries and metadata fi lters, we also completely replaced our storage engine ADAMpro by a new database called Cottontail DB. Furthermore, we have added support for scoring based on the temporal ordering of multiple video segments with respect to a query formulated by the user. Finally, we have also added a new object detection module based on Faster-RCNN and use the generated features for object instance search.

Research Projects