Sketch-based Image Similarity Search with a Pen and Paper Interface

Ihab Al Kabary and Heiko Schuldt
In Proceedings
Appears in
Proceedings of the 2012 International Conference on Research and Development in Information Retrieva
Portland, OR, USA
We present a novel and innovative user interface for query-by-sketching based image retrieval that exploits emergent interactive paper and digital pen technology. Users can draw sketches with a digital pen on interactive paper in a user-friendly way. The pen is able to capture the stroke vectors and to interactively stream them to the underlying content-based image retrieval (CBIR) system via the pen's Bluetooth interface. We present the integration of interactive paper/digital pen technology with QbS, our CBIR system tailored to Query-by-Sketching, and we demonstrate the use of the paper and pen interface together with QbS for three different collections:MIRFLICKR-25K, a cartoon collection, and a collection of medieval paper watermarks.