Evaluation methods used on health information systems (HISs) in Iran and the effects of HISs on Iranian healthcare: A systematic review

• A limited number of available methods were used to evaluate HISs.
• The studies mainly discussed the positive effects of HIS on health care services.
• Published evaluation studies were mostly summative.
• Studies evaluating real behavior of users when interacting with HISs are lacking.
• Current HISs improved users’ satisfaction, efficiency and the quality of care.

ObjectivesThe most important goal of a health information system (HIS) is improvement of quality, effectiveness and efficiency of health services. To achieve this goal, health care systems should be evaluated continuously. The aim of this paper was to study the impacts of HISs in Iran and the methods used for their evaluation.MethodsWe systematically searched all English and Persian papers evaluating health information systems in Iran that were indexed in SID, Magiran, Iran medex, PubMed and Embase databases until June 2013. A data collection form was designed to extract required data such as types of systems evaluated, evaluation methods and tools.ResultsIn this study, 53 out of 1103 retrieved articles were selected as relevant and reviewed by the authors. This study indicated that 28 studies used questionnaires to evaluate the system and in 27 studies the study instruments were distributed within a research population. In 26 papers the researchers collected the information by means of interviews, observations, heuristic evaluation and the review of documents and records. The main effects of the evaluated systems in health care settings were improving quality of services, reducing time, increasing accessibility to information, reducing costs and decreasing medical errors.ConclusionEvaluation of health information systems is central to their development and enhancement, and to understanding their effect on health and health services. Despite numerous evaluation methods available, the reviewed studies used a limited number of methods to evaluate HIS. Additionally, the studies mainly discussed the positive effects of HIS on health care services.