OntoCrawler: A focused crawler with ontology-supported website models for information agents

This paper proposed the use of ontology-supported website models to provide a semantic level solution for an information agent so that it can provide fast, precise, and stable query results. We have based on the technique to develop a focused crawler, namely, OntoCrawler which can benefit both user requests and domain semantics. The technique in this research has practically applied on Google and Yahoo searching engines to actively search for webpages of related information, and the experiment outcomes indicated that this technique could definitely up-rise precision rate and recall rate of webpage query. Equipped with this technique, we have developed an ontology-supported information agent shell in Scholar domain which manifests the following interesting features: ontology-supported construction of website models, website models-supported website model expansion, website models-supported webpage retrieval, high-level outcomes of information recommendation, and accordingly proved the feasibility of the related techniques proposed in this paper.