Newspaper article reconstruction using ant colony optimization and bipartite graph

The primary information units in a newspaper are the articles. How to segment a newspaper page into individual articles and to recover the reading order of each article, namely newspaper article reconstruction, is known to be challenging due to the complexity of the multi-article page layout. In this paper, we propose a novel article reconstruction approach by solving a series of subtasks: grouping the article bodies, detecting the reading order, associating the title-body pairs and linking article parts scattered in multiple pages. We formulate reading order detection as a traveling salesman problem (TSP), and employ the Max-Min Ant System (MMAS) to solve it. Furthermore, a level-based pheromone mechanism is introduced to improve the efficiency of standard MMAS. Moreover, in sharp contrast to the existing methods, we perform the first two subtasks of article reconstruction in reverse order, that is, we detect the reading order of the text blocks first and then use the content continuity implicitly specified in the reading order to aggregate text blocks of the same article. In this way, we can effectively overcome the limitation of content similarity on article body aggregation. The other two subtasks (associating the title-body pairs, linking article parts scattered in multiple pages), are solved under a unified bipartite graph framework, which models the complex relationships between page objects as one-to-one correspondences, and accomplishes the two subtasks by finding the optimal matching on this graph. During the optimization process, various information sources, including geometric layout, linguistic and semantic content, are deeply mined in MMAS and bipartite graph model to deal with the wide range of complex newspaper layouts. Experimental results on real-world data have demonstrated the effectiveness of our proposed method. It has also been adopted in several large-scale newspaper digitalization projects.

Graphical abstractThis paper propose a complete solution to address a series of sub-tasks of article extraction from newspaper pages: detecting the reading order, aggregating the article bodies, associating the title-body pairs, and linking article parts on different pages, using Ant Colony Optimization (ACO) and bipartite graph model.Figure optionsDownload full-size imageDownload as PowerPoint slideHighlights► We formulate article reconstruction tasks using an Ant Colony Optimization model. ► Layout information and content information are combined to improve the reliability. ► Selecting the reading order of article blocks as a basic clue of grouping them. ► Titles are recognized through content correlation between titles and bodies.