Measuring critical components of digital literacy and their relationships with learning

The growing prominence of the Internet, and other digital environments, as educational tools requires research regarding learners' digital literacy. We argue that two critical aspects of digital literacy are the ability to effectively plan and monitor the efficacy of strategies used to search and manage the wealth of information available online, and the knowledge to appropriately vet and integrate those information sources. Therefore, digital literacy requires effective self-regulated learning (SRL) skills, and availing epistemic cognition (EC). Although numerous researchers and scholars have examined the role of SRL in online learning (e.g., Efklides, 2011; Lee and Tsai, 2010, Williams and Hellman, 2004, Winters et al., 2008), there is a need for additional empirical research on how SRL and EC interact, and relate to learning in digital environments. In this study, we used a powerful, but little-used data collection methodology, think-aloud protocol (TAP) analysis, to investigate the relations among SRL, EC, and learning gains with 20 college students who studied vitamins on the Internet. We also contributed to the literature by exploring alternative techniques for preparing, analyzing, and representing these data, accounting for the strengths and challenges of TAPs. We found that, on average, participants did increase their understanding as a result of learning with the Internet, and that a data-driven approach to understanding relations among SRL, EC, and learning yielded the most powerful representation of these phenomena. Our study has implications for future research on digital literacy using TAPs, as well as the relative contribution of SRL and EC, as aspects of digital literacy, to online learning.