A flexible multicriteria decision-making methodology to support the strategic management of Science, Technology and Innovation research funding programs

A pilot study, presented in the paper, involved a retrospective implementation of a peer review process in the context of a program launched by the Ministry for Science, Technology, Innovations and Communications and the National Council of Technological and Scientific Development, in Brazil. The methodology allowed a clear distinction of roles. The agency staff in the role of decision-makers was responsible for making value judgments on behalf of the agency. The experts, in the role of committee members and ad hoc reviewers, contributed with their expertise by providing objective assessments. Such assessments served as a basis for evaluating the applications, characterizing the possible portfolios, and can be considered as data in future program evaluation studies.