Article ID Journal Published Year Pages File Type
461550 Journal of Systems and Software 2016 14 Pages PDF
Abstract

•CALA is a tool to automatically classify web pages based exclusively on their URL.•CALA is unsupervised and based on a lightweight crawling to gather a training set.•CALA provides a GUI that helps the user perform the web page classification.•Experiments show that CALA is effective, efficient, and generally applicable.•CALA is suitable for solving real-world web page classification problems.

Web page classification refers to the problem of automatically assigning a web page to one or more classes after analysing its features. Automated web page classifiers have many applications, and many researchers have proposed techniques and tools to perform web page classification. Unfortunately, the existing tools have a number of drawbacks that makes them unappealing for real-world scenarios, namely: they require a previous extensive crawling, they are supervised, they need to download a page before classifying it, or they are site-, language-, or domain-dependent. In this article, we propose CALA, a tool for URL-based web page classification. The strongest features of our tool are that it does not require a previous extensive crawling to achieve good classification results, it is unsupervised, it is based exclusively on URL features, which means that pages can be classified without downloading them, and it is site-, language-, and domain-independent, which makes it generally applicable. We have validated our tool with 22 real-world web sites from multiple domains and languages, and our conclusion is that CALA is very effective and efficient in practice.

Related Topics
Physical Sciences and Engineering Computer Science Computer Networks and Communications
Authors
, , , ,