Efficient segmentation-free keyword spotting in historical document collections

• We present a query-by-example keyword spotting method for historical collections.
• The method is segmentation-free and avoids any pre-processing step.
• We use a compact and efficient vectorial representation to index large collections.
• We outperform the recent state-of-the-art keyword spotting approaches.

In this paper we present an efficient segmentation-free word spotting method, applied in the context of historical document collections, that follows the query-by-example paradigm. We use a patch-based framework where local patches are described by a bag-of-visual-words model powered by SIFT descriptors. By projecting the patch descriptors to a topic space with the latent semantic analysis technique and compressing the descriptors with the product quantization method, we are able to efficiently index the document information both in terms of memory and time. The proposed method is evaluated using four different collections of historical documents achieving good performances on both handwritten and typewritten scenarios. The yielded performances outperform the recent state-of-the-art keyword spotting approaches.