Sketch-based Image Similarity Search with a Pen and Paper Interface

Ihab Al Kabary, Heiko Schuldt

In Proceedings

2012/8

Proceedings of the 2012 International Conference on Research and Development in Information Retrieva

Portland, OR, USA

We present a novel and innovative user interface for query-by-sketching based image retrieval that exploits emergent interactive paper and digital pen technology. Users can draw sketches with a digital pen on interactive paper in a user-friendly way. The pen is able to capture the stroke vectors and to interactively stream them to the underlying content-based image retrieval (CBIR) system via the pen's Bluetooth interface. We present the integration of interactive paper/digital pen technology with QbS, our CBIR system tailored to Query-by-Sketching, and we demonstrate the use of the paper and pen interface together with QbS for three different collections:MIRFLICKR-25K, a cartoon collection, and a collection of medieval paper watermarks.