Inferring user knowledge level from eye movement patterns

The acquisition of information and the search interaction process is influenced strongly by a person’s use of their knowledge of the domain and the task. In this paper we show that a user’s level of domain knowledge can be inferred from their interactive search behaviors without considering the content of queries or documents. A technique is presented to model a user’s information acquisition process during search using only measurements of eye movement patterns. In a user study (n = 40) of search in the domain of genomics, a representation of the participant’s domain knowledge was constructed using self-ratings of knowledge of genomics-related terms (n = 409). Cognitive effort features associated with reading eye movement patterns were calculated for each reading instance during the search tasks. The results show correlations between the cognitive effort due to reading and an individual’s level of domain knowledge. We construct exploratory regression models that suggest it is possible to build models that can make predictions of the user’s level of knowledge based on real-time measurements of eye movement patterns during a task session.

► We model the search information acquisition process with eye movement patterns.
► The genomics domain knowledge of users (n = 40) is represented using MeSH terms.
► Cognitive effort measurements of user reading eye movement patterns are constructed.
► We show correlations between the cognitive effort measures and domain knowledge.
► Regression models suggest real time implicit detection of user knowledge is possible.