MediaMix: Multimedia Retrieval with Dual Backend Support and Result Exploration in MR

Authors
Rahel Arnold, Anna Pietzak, Heiko Schuldt
Type
In Proceedings
Date
2026/1
Appears in
MultiMedia Modeling: 32nd International Conference on Multimedia Modeling, MMM 2026, Prague, Czech Republic, January 29–31, 2026, Proceedings, Part IV
Location
Prague, Czech Republic
Abstract

Extended Reality (XR), particularly Mixed Reality (MR), offers exciting opportunities for immersive user interactions that exceed the limitations of traditional two-dimensional interfaces. Following our first participation in the Video Browser Showdown (VBS) 2025, we present an extended and improved version of MediaMix, our mixed reality multimedia retrieval system running on the Apple Vision Pro. This new iteration introduces substantial enhancements to both the backend and the frontend. On the backend, MediaMix now seamlessly integrates with FERElight and the vitrivr-engine, thereby extending its flexibility in retrieval workflows and ensuring compatibility with established infrastructures within the vitrivr stack. On the frontend, we expanded the presentation of results to enhance the browsing experience. Beyond the existing spherical visualization, results can now be displayed in floating windows or in wall-mounted views, giving users greater control over their workspace arrangement. Furthermore, we extended the sphere-based representation, allowing users to freely configure the number of displayed results. Moreover, multiple spheres can be merged into combined result sets, enabling a more comprehensive and comparative exploration of search outcomes. With these enhancements, we aim to increase usability, adaptability, and efficiency of MediaMix in interactive video retrieval tasks.

Research Projects