Enhanced Object Detection with Multimedia Retrieval in Mixed Reality (Bachelor Thesis, Ongoing)
Author
Description
The rapid adoption of mixed reality (MR) technologies has transformed how users interact with their environment by blending the physical and digital worlds. Current object detection systems primarily identify objects and provide visually similar results. While useful, these systems often fail to deliver detailed contextual information about the detected objects. This thesis seeks to bridge this gap by integrating information retrieval into an MR application. By leveraging object detection, instance segmentation and data retrieval capabilities, the system will allow users to interact with physical objects and gain deeper insights on a detailed level. For example, further event details from a poster or product specifications of a physical item are shown. As a predefined database might limit the application, a connection to the internet is necessary to browse up-to-date information. The goal is to create an intuitive and context-sensitive MR application that enriches the user experience with relevant and actionable information on a component layer.
Start / End Dates
2025/03/17 - 2025/07/16