Multimodal Interactive Lifelog Retrieval with vitrivr-VR

Authors
Florian Spiess, Heiko Schuldt
Type
In Proceedings
Date
2022/6
Appears in
Proceedings of the fifth Lifelog Search Challenge (LSC)
Location
Newark, NJ, USA
Abstract

The multimodal nature of lifelog data poses unique challenges for analysis, indexing and interactive retrieval. To address these challenges, the Lifelog Search Challenge (LSC) is an annual evaluation campaign allowing interactive retrieval systems to explore new ideas and measure their performance against each other. This paper describes the virtual reality (VR) multimedia retrieval system vitrivr-VR, with a focus on aspects relevant to the LSC’22, especially the user interaction in VR, the formulation of typical LSC queries, and different options to explore the retrieval results in VR.

Research Projects