Developing multi-dimensional evaluation criteria for English learning websites with university students and professors

Many English learning websites have been developed worldwide, but little research has been conducted concerning the development of comprehensive evaluation criteria. The main purpose of this study is thus to construct a multi-dimensional set of criteria to help learners and teachers evaluate the quality of English learning websites. These evaluation guidelines are based on web usability, learning materials, functionality of assisting language learning, technology integration, and learner preferences. In order to achieve this goal, the researchers used a rigorous four-phase procedure and utilized both qualitative and quantitative research methods with university students and professors in Design-based Research to construct and refine the evaluation criteria in 2008–2009. Fifty-eight evaluation criteria were refined and finalized. In addition, to cope with the difficulties in applying the derived criteria and explaining what the results indicate, this study presents a practical application by evaluating an English learning website.

Research highlights
► 160 university students and 7 professors participated in the study.
► Both qualitative and quantitative methods were used in this Design-based Research.
► 58 evaluation criteria were finalized in the four-phase research procedure.
► BBC learning English website was evaluated by using the 17 web usability criteria.
► The evaluation criteria in four dimensions were provided in Table 3 and Appendix B.