Systems evaluations are an important part of empirical research in computer science. Such evaluations encompass the systematic assessment of the run-time characteristics of systems based on one or several parameters. Chronos is an open source system for the automation of the entire (database) systems evaluation workflow including the set-up of the evaluation, its execution, and the subsequent analysis of the results. It allows to evaluate a wide range of applications from simple databases to complex polystores or from plain text retrieval to complex multimedia search engines and thus fosters the reproducibility of evaluations.
- Marco Vogt, Alexander Stiemer, Sein Coray, Heiko Schuldt
Chronos: The Swiss Army Knife for Database Evaluations
Proceedings of the 23rd International Conference on Extending Database Technology (EDBT 2020), Copenhagen, Denmark (held virtually) 2020/4