Improving statistical keyword detection in short texts: Entropic and clustering approaches

Word-clustering and entropic keyword detectors are compared in long and short texts. ► We propose two suitable metrics to evaluate the performance of keyword detectors. ► The word-clustering detector is improved to find relevant low-frequency words. ► The entropic detector gives reliable results only for suitable text partitions. ► The word clustering detector is successful both in long and short texts.