A qualitative evaluation of evolution of a learning analytics tool

LOCO-Analyst is a learning analytics tool we developed to provide educators with feedback on students learning activities and performance. Evaluation of the first version of the tool led to the enhancement of the tool’s data visualization, user interface, and supported feedback types. The second evaluation of the improved tool allowed us to see how the improvements affected the users’ perceived value of the tool. Here, we present the qualitative results of our two evaluations and discuss important lessons learned stemming from the comparison of the two studies. The results show that educators find the kinds of feedback implemented in the tool informative and they value the mix of textual and graphical representations of different kinds of feedback provided by the tool.

► a learning analytics tool for educators-directed feedback is presented.
► results of two qualitative evaluation studies of the tool are presented.
► educators found the feedback implemented in the tool informative.
► educators valued the mix of textual and graphical representations of the feedback.
► important lessons learned from the comparison of the two studies are discussed.