Further considerations of evaluation competencies in Taiwan

•A framework of evaluator competencies adapted for the Taiwanese context generalized to some degree to a large sample across the country.•Respondents gave high ratings to many items in a needs format, discrepancies were not great, and accordingly it was not possible to make recommendations for evaluator training.•Those labeled as evaluators in Taiwan differ from their counterparts in the west, affecting the validity of the study.•The Likert scale worked slightly better than the Fuzzy one but additional research is warranted.

A list of evaluator competencies (Stevahn, King, Ghere, & Minnema, 2005) was adapted to fit the Taiwanese context by Lee, Altschuld, & Lee (2012). It was studied as to how it generalized to a large sample in Taiwan. Likert and Fuzzy surveys with needs assessment formats (importance and competence) were mailed via random assignment to two groups of participants. The questions for the study were: do the modified competencies relate country-wide to Taiwan, did the investigation uncover training needs for evaluators, and were there convergent rating patterns across the two forms of the instrument? The results supported a fit of the modified competencies to the context and convergent validity was observed but strong competency needs were not apparent. Reasons for the findings and implications for future research are discussed.