نوع مقاله : مقاله پژوهشی
نویسنده
استادیار سیاستگذاری علم و فناوری، مؤسسه تحقیقات سیاست علمی کشور، تهران، ایران
چکیده
کلیدواژهها
موضوعات
عنوان مقاله [English]
نویسنده [English]
This research was conducted to empirically validate the third-generation framework for monitoring and evaluating science, technology, and innovation (STI) by the Supreme Council of Science, Research, and Technology (SCSRT) in Iran. The framework is based on an integrated evaluation model (efficiency, effectiveness, and utility quadrant) and comprises 40 selected indicators. The primary objective was to assess the degree of Compliance, implementability, and added value of this framework before its formal deployment within Iran's science and technology governance system.
The study employed a mixed-methods approach (quantitative time-series trend analysis and qualitative expert-based analysis). Real-world data for 40 indicators were collected from national and international reports during the period of the Sixth Development Plan (2017-2022) and analyzed. The validity and reliability of the instruments were confirmed.
Key findings indicate that the average Compliance of the indicators with international standards is 85%. This alignment was 97% for the efficiency quadrant, 67% for effectiveness, and 92% for utility. In addition, the overall performance of the framework was rated as "weak," with a weighted average Compound Annual Growth Rate (CAGR) of 1.6%. The efficiency, effectiveness, and utility quadrants all performed at a "weak" level. Out of 34 indicators with available data, 21indicators were rated at "weak" or "very weak" levels. Furthermore, the most significant implementation challenges identified include weaknesses in "Data Accessibility, Analyzability, Being up-to-date" (DAB) (especially in the utility domain), fragmentation of information systems, and lack of integration in data collection processes. However, the added value of the third-generation evaluation framework compared to previous generations is evident in the integration of the value chain, reduction of indicators from 112 to 40, and the incorporation of "Beta Testing" for policy learning before full-scale implementation.
The overall conclusion suggests that the third-generation framework is structurally and theoretically ready for deployment, but requires modifications to impact indicators and a strengthening of data infrastructure. A pilot implementation of this framework, with continuous monitoring and benchmarking informed by successful national and international experiences, is recommended in the short term. This framework has the potential to serve as an effective model for a national intelligent STI monitoring system in Iran and other countries in the region.
کلیدواژهها [English]
)