Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021
Authors
Silvan Heller, Ralph Gasser, Mahnaz Parian-Scherb, Sanja Popovic, Luca Rossetto, Loris Sauter, Florian Spiess, Heiko Schuldt
Type
In Proceedings
Date
2021/8
Appears in
Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR'21)
Location
Taipei, Taiwan (held virtually)
Publisher
ACM
Abstract
The Lifelog Search Challenge (LSC) is an annual benchmarking competition for interactive multimedia retrieval systems, where participating systems compete in finding events based on textual descriptions containing hints about structured, semi-tructured, and/or unstructured data. In this paper, we present the multimedia retrieval system vitrivr, a long-time participant to LSC, with a focus on new functionality. Specifically, we introduce the image stabilisation module which is added prior to the feature extraction to reduce the image degradation caused by lifelogger movements, and discuss how geodata is used during query formulation, query execution, and result presentation.
Staff members
Research Projects