Tool-use in a blended undergraduate course: In Search of user profiles

The popularity of today’s blended courses in higher education is driven by the assumption that students are provided with a rich toolset that supports them in their learning process. However, little is known on how students actually use these tools and how this affects their performance for the course. The current study investigates how students use the entire toolset at their disposal, whether tool-use patterns can be found and if these patterns affect performance for the course. Logging students (n = 156) actions throughout the content management system and registering students’ use of the face-to-face support in an undergraduate course, the study reveals large student differences and an underuse for some tool-types. Further to this, K-means cluster analysis reveals three distinct tool-use patterns or user profiles: the no-users, the intensive users and the incoherent users. These patterns are characterized by different tool-choices and even different use intensity among students. Evidence is retrieved that these tool-use differences are problematic since multivariate analysis of variance reveals significant performance effects. Hence, these results imply that not all students seem to profit from the learning affordances that are provided. Similar as evidence in controlled settings, the results suggest that learner control in using tools cannot be taken for granted. Consequently, this study legitimates more research into the influencing (student and context) variables that can explain these differences.

► Focus on tool-use patterns and performance effects.
► Three tool-use patterns: no, incoherent and intensive users.
► Significant performance effects; no-users performed worse.
► Conclusion: not every student profits from the learning environment affordances.
► Relevance for instructional design: how many student control and for who?