DRES: Distributed Retrieval Evaluation Server (Finished)
The DRES project deals with the question, how interactive multimedia retrieval systems can be benchmarked and tested in a distributed and (potentially) asynchronous fashion. The resulting DRES server is a piece of infrastructure built for and used at various multimedia retrieval evaluation campaigns, such as the Video Browser Showdown (VBS), the Lifelog Search Challenge (LSC) and others.
Website
https://github.com/dres-dev/DRES
Start / End Dates
31.03.2020 - 01.01.1970
Staff
Research Topics
Publications
2024
- Loris Sauter, Ralph Gasser, Heiko Schuldt, Abraham Bernstein, Luca Rossetto
Performance Evaluation in Multimedia Retrieval
ACM Transactions on Multimedia Computing, Communications and Applications, 2024/10 - Loris Sauter
Flexible Information Retrieval Evaluation
PhD Thesis, Department of Mathematics and Computer Science, University of Basel, Switzerland 2024/2
2022
- Loris Sauter, Ralph Gasser, Abraham Bernstein, Heiko Schuldt, Luca Rossetto
An Asynchronous Scheme for the Distributed Evaluation of Interactive Multimedia Retrieval
Proceedings of the 2nd International Workshop on Interactive Multimedia Retrieval (IMuR’22), Lisbon, Portugal 2022/10
2021
- Luca Rossetto, Ralph Gasser, Silvan Heller, Mahnaz Parian-Scherb, Loris Sauter, Florian Spiess, Heiko Schuldt, Ladislav Peška, Tomáš Souček, Miroslav Kratochvíl, František Mejzlík, Patrik Veselý, Jakub Lokoč
On the User-centric Comparative Remote Evaluation of Interactive Video Search Systems
IEEE Multimedia, 2021/10