Using Hand Gestures for Specifying Motion Path Queries in Sketch-based Video Retrieval

Ihab Al Kabary and Heiko Schuldt
In Proceedings
Appears in
Proceedings of the 36th European Conference on Information Retrieval (ECIR)
Amsterdam, Netherlands
In team sports, the analysis of a teams tactical behavior is becoming increasingly important. While this is still mostly based on the manual selection of video sequences from games, coaches and analysts increasingly demand more automated solutions to search for relevant sequences of videos, and to support this search by means of easy-to-use interfaces. In this demo, we present a novel intuitive interface for specifying sketched-based motion queries in sport videos using hand gestures. We have built the interface on top of SportSense, a system for interactive sports video retrieval. SportSense exploits spatiotemporal information incorporating various events within sport games, which is used as metadata to the actual sports videos. The interface has been designed to enable users to fully control the system and facilitate acquiring of the query object needed to perform both spatial and spatiotemporal motion queries using intuitive hand gestures.