How to improve a technology evaluation model: A data-driven approach

Academic research suggests a number of technology evaluation models. To ensure effective use, models need to be improved in accordance with changing internal and external environments. However, a majority of previous studies focus on model development, while a few emphasize their implementation or improvement. To fill this research gap, this study suggests a systematic approach to examining the validity of technology evaluation models and improving them. We consider three propositions as criteria for improvement: 1) the coherence of the evaluation results with the evaluation purpose, 2) the appropriateness of the evaluation methods, and 3) the concreteness of the evaluation model. Rather than using expert opinions, this study takes a data-driven approach, wherein we analyze actual evaluation results and determine whether the model produces the intended results. A case study of 291 technology evaluation results, all made by the South Korean government in support of technology-based small and medium-sized enterprises, is conducted to verify the suggested approach's applicability. This is one of the few studies to address issues regarding improvements to a technology evaluation model. Its approach can help to develop and continuously improve a valid technology evaluation model, thus leading to more effective practice.