The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
Research and Innovation in Science and Technology Project (P121842)
EAST ASIA AND PACIFIC | Indonesia | Education Global Practice |
IBRD/IDA | Investment Project Financing | FY 2013 | Seq No: 14 | ARCHIVED on 25-Jun-2020 | ISR42500 |
Implementing Agencies: Ministry of Finance, Ministry of Research Technology / BRIN
Key Dates
Key Project Dates
Bank Approval Date: 29-Mar-2013 Effectiveness Date: 12-Jun-2013
Planned Mid Term Review Date: 13-Jun-2016 Actual Mid-Term Review Date: 09-Feb-2016
Original Closing Date: 31-Dec-2020 Revised Closing Date: 31-Dec-2020
pdoTable
Project Development Objectives
Project Development Objective (from Project Appraisal Document)
To create an enabling policy environment for research and development in science and technology, to improve thepublicresearchanddevelopment
institutes’ performance, and to improve science, technology and innovation human resource capacity.
Has the Project Development Objective been changed since Board Approval of the Project Objective?
Yes
Board Approved Revised Project Development Objective (If project is formally restructured)
To support the government in: (1) improving STI human resource capacity; and (2) strengthening technology transfer, institutional functioning, and
data management of public research agencies (LPNKs).
Components Table
Name
Strengthening the Innovation System and Technology Transfer at Public Research Agencies:(Cost $2.50 M)
Strengthening Public Research Funding:(Cost $2.50 M)
Developing Science and Technology Human Resources Capacity:(Cost $68.00 M)
Project Management:(Cost $7.00 M)
Overall Ratings
Name Previous Rating Current Rating
Progress towards achievement of PDO Satisfactory Satisfactory
Overall Implementation Progress (IP) Satisfactory Satisfactory
Overall Risk Rating Substantial Moderate
Implementation Status and Key Decisions
The overall implementation progress of the RISET Project towards the achievement of the Project Development Objective PDO has witnessed
some progress during this reporting period and the results have positively impacted the achievement of the PDO.
6/25/2020 Page 1 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
Since the last implementation review mission in November 2019, the Component 1 team has achieved PDO indicator 1: Lembaga Pemerintah Non
Kementerian/ Public Research Institute (LPNK) research agency reforms are institutionalized’. In 2020, reforms of five Science and Technology
Parks (STPs) in three LPNKs has taken place by providing methods and processes of measuring STP maturity, as well as mapping and developing
innovation clusters to support STP excellence. The STP strengthening framework has been formalized through Ministry of Research Technology
and Higher Education (MoRTHE) Regulation No. 25/2019 on STP Governance and the methods of STP maturity measurement have been
institutionalized. TTOs reform has progressed with the formal stipulation of the STP maturity measurement have been institutionalized. TTOs reform
has progressed with the formal stipulation of the Technology Management Guideline, issuance of a technology valuation, incentive system
guideline, and standard operating procedure. The team also produced two academic papers discussing Innovation Costing based on a Venture
Model, LPNK-Kemristek/BRIN-Industry Collaboration, and Big Data Analytics Invention in preparing Registered Technology Transfer Professional
(RTTP) certification for TTO staff.
Progress has also been made in Component 2 in achieving PDO indicator 2: ‘Improved regulation on the output-based cost standard for the
Science Technology Innovation research funding system issued on an annual basis.’ The project team has contributed to the issuance of MoF
Regulation No. PER-7/PB/2019, which has resolved contradicting regulation statements arising from previous regulation No. PER-15/PB/2017 that
have hindered implementation. Advancement of Monevrisbang (Research and Development Monitoring and Evaluation system) development has
been achieved by integrating it with the systems at the Center of Data and Information (Pusdatin) of Kemristek/BRIN. The collaboration with LPDP
has harvested data on 450,000 research outputs and the system is being used by LPDP to support research proposal selection for their research
grant program. Bappenas has requested that the Monevrisbang database be further developed so that Monevrisbang data can be used as a
reference for R&D national planning.
Component 3 also continues to make progress in achieving PDO 3: ‘Increased percentage of Masters’ and Ph.D. degree holders in LPNKs and
MoRTHE supported by the RISET Project.’ Of the 457 scholars who are supported by the project, the number of graduates has increased from 222
(48.6 percent) by November 2019 to 307 (67 percent) to date. The Project Management Office needs to collect information on their study progress
to ensure timely completion of all scholars’ studies by the end of 2020.The remaining 29.5% (135 scholars) are still recorded as active and are
scheduled to complete their study by the end of 2020. On the Non-Degree program (NDP), the number of participants has increased from 1,921 at
the end of 2019 to 1,982 to date. Another 100 participants will enroll in the NDPs in 2020.
Progress has also made in Component 4, on Project Management. For this FY, due to the COVID-19 pandemic, many project activities requiring
face-to-face meetings and travel could not be implemented. Therefore, the project team is submitting a request for a one-year project extension
from December 2020 to December 2021.
Risks
Systematic Operations Risk-rating Tool
Risk Category Rating at Approval Previous Rating Current Rating
Political and Governance -- Substantial Moderate
Macroeconomic -- Moderate Low
Sector Strategies and Policies -- Moderate Moderate
Technical Design of Project or Program -- Substantial Low
Institutional Capacity for Implementation and
-- Moderate Moderate
Sustainability
Fiduciary -- Substantial Substantial
Environment and Social -- Low Low
Stakeholders -- Moderate Low
Other -- -- Moderate
Overall -- Substantial Moderate
6/25/2020 Page 2 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
Results
PDO Indicators by Objectives / Outcomes
To support the government in strengthening technology transfer
IN00863385
►1. LPNK research agency reforms are institutionalized (Text, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Reforms are
Value NA In progress In progress
institutionalized
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
Reforms in five STPs in three LPNKs have been institutionalized through the issuance of MoRTHE
Regulation No. 25/2019 on STP Governance. Through this new governance framework, the project has
contributed strongly to the methods and processes of measuring STP maturity. Continuing work from
2019, innovation clusters have also been mapped and developed to support STP excellence. Progress
Comments: with TTOs has been made with the formal stipulation of a TTO Management Guideline and issuance of a
technology valuation and incentive system guideline and standard operating procedure (SOP). The team
will next work on aligning these guidelines with the new Law No. 11/2019 on the National Science and
Technology System.
To support the government in strengthening institutional functioning and data management of LPNKs
IN00863461
►2. Improved regulation on the output-based cost standard for the STI research funding system issued on an annual basis (Text, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Refined regulation is
issued based on
Value NA In progress In progress
annual review covering
research priorities
Date 13-May-2011 11-Dec-2019 19-Jun-2020 31-Dec-2019
The team has contributed to the implementation of output-based cost standard regulations (i.e.: MoF
Regulation #106/2016 and its derivative Peraturan Dirjen Perbendaharaan No: Per.15/PB/2017 on SBK,
the result-based unit cost. While there are some contradictions of regulation statements that hinder
Comments: implementation, the project team has successfully contributed to the issuance of MoF Regulation No.
PER-7/PB/2019, which responds to implementation challenges arising from previous regulation No. PER-
15/PB/2017.
To support the government in improving STI human resources capacity
IN00863384
►3. Increased % of Master's and Ph.D. degree holders in LPNK and MoRTHE supported by the RISET Project (Percentage, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 48.00 67.01 100.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
6/25/2020 Page 3 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
The number of RISET scholarship graduates has increased from 222 in November 2019 to 307 to date.
This number is 67.1 percent of the total 457 scholars. Of these 307 graduates, 289 have returned to work
at their LPNKs while the remaining 18 are still in transition (still in their country of study, returning home,
Comments:
and yet to be officially active in their work). The graduates comprise 228 Master’s degree holders
(74.3 percent) and 79 Ph.D degree holders (25.7 percent).
IN00863462
►4. Master’s degree holders who participate in applied science research programs (Percentage, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 99.00 95.00 90.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
Of the 228 Master’s degree program graduates to date, 217 (95 percent) have returned to their LPNKs
and been assigned to work relevant to their study programs. Eight are continuing PhD programs in
Comments: another program outside RISET Project, while the other three are still in transition (returning home and yet
to be officially active in their work). This indicator is thus likely to be achieved.
IN00863463
►5. Ph.D. degree holders who manage or coordinate applied science research programs (Percentage, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 100.00 91.00 90.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
Of the total 79 Ph.D. degree holders, 72 (91 percent) have returned to work and are active as researchers
in their respective LPNKs. Although only 20 of these Ph.D. graduates (26 percent) are currently leading or
Comments: coordinating research teams at their institutions, all are playing a significant role in research teams and
activities at their LPNKs.
Overall Comments PDO
The work that is being implemented under the different components of the project are helping to achieve the PDO. To date, four of the five
PDO indicators and 9 out of the 10 Intermediate Result Indicators (IRIs) have been achieved. The PMO needs to now expedite implementation
to achieve PDO indicator 3 and IRI 5.
Intermediate Results Indicators by Components
Strengthening the Innovation System and Technology Transfer at Public Research Agencies
IN00863465
►1. National innovation strategy is developed (Component 1) (Text, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Strategy action plans
Strategy action plans
are submitted for
have been submitted in Strategy action plans
consideration to the
Value NA the form of a technocratic is included in the
new national research
paper for RPJMN 2020- RPJMN 2020-2024.
and innovation master
2024.
plan
6/25/2020 Page 4 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2019
IN00863469
►2. National Information System for STI is established and integrated into ministry’s database system (Component 1) (Text, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Data collection at
STPs to inform
Kemristek/BRIN
STI data is continuously database.
being collected, and the Monevrisbang tool is
database is being also being used to
STI data is collected
Value Not started expanded to include monitor research and
and reported
national, local development managed
government, and by the Kemristek/BRIN
university STI data. and LPNKs, as well as
by MoF for LPDP
research grant
proposal selection.
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
The Kemristek/BRIN uses the Monevrisbang tool to monitor implementation and the results of research
programs (the Insentif Riset program) funded by the Ministry, including those in LPNKs and universities.
The Ministry of Finance has used it to assist in the LPDP research grant proposal selection process. In the
near future, the data in Monevrisbang will also be used for planning and budgeting of research programs
Comments:
that support national priorities undertaken by LPNKs and Kemristek/BRIN. Bappenas has requested the
project to prepare Monevrisbang to be used for national planning on research and development.
Furthermore, the project is conducting data collection from STPs to enrich the Kemristek/BRIN database.
IN00863473
►3. Existing regulations in the STI legal framework are reviewed and modifications proposed (Component 1) (Text, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Reforms in five Science
and Technology Parks
(STPs) have been
Final modifications are
institutionalized. Four
proposed and
Technology Transfer TTO regulation is
Value NA submitted for
Office (TTOs) involved in being drafted
consideration to
the pilot are in the
relevant ministries.
process of endorsing
TTO management
guidelines.
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
Strengthening Public Research Funding
IN00863466
►1. Increased number of research programs in LPNKs and MoRTHE focused on higher ranks of the Technology Readiness Level (TRL)
(Component 2) (Text, Custom)
Baseline Actual (Previous) Actual (Current) End Target
It has been confirmed
that, for evaluation
Number of research Increased number of
purposes, the
Value NA programs of higher TRL research programs of
numerical indicator of
is increasing. higher TRL
TRL has to be
combined with the
6/25/2020 Page 5 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
other relevant
indicators. Further
desk-analysis is
required to contribute
to upcoming regulation
on TRL System as
mandated by Law
No:11/2019
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2019
IN00863470
►2. Strengthened R&D monitoring & evaluation capacity (Component 2) (Number, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 10.00 12.00 12.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
Twelve independent evaluations of multi-year research activities -- selected from the health, medicine,
food/Agriculture, energy, and advanced materials research fields -- were conducted and lessons were
Comments:
documented. The target has been completed.
Developing Science and Technology Human Resources Capacity
IN00863464
►1. Number of LPNK, MoRTHE, Research Agency staff who have studied overseas as supported by RISET-Project (Component 3)
(Number, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 457.00 457.00 422.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
IN00863468
►2. Number of participants in RISET-Project’s Non-Degree professional courses and training (Component 3) (Number, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 1,921.00 1,982.00 1,907.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2018
IN00863472
►Direct project beneficiaries (Number, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value 0.00 2,387.00 2,439.00 2,387.00
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2019
IN00863474
Female beneficiaries (Percentage, Custom Supplement)
Baseline Actual (Previous) Actual (Current) End Target
6/25/2020 Page 6 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
Value 0.00 33.00 33.00 28.00
Project Management
IN00863467
►1. Project implementation and monitoring reports (include financial reports) are completed (Component 4) (Yes/No, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value No Yes Yes Yes
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
While IFR 2019 has been submitted in a timely manner, the PMO still needs to submit the annual report
Comments:
IN00863471
►2. Computerized project monitoring database is established, updated, and key information is placed on MoRTHE project website
(Component 4) (Yes/No, Custom)
Baseline Actual (Previous) Actual (Current) End Target
Value No Yes Yes Yes
Date 30-Sep-2013 11-Dec-2019 19-Jun-2020 31-Dec-2020
The website link is: http://risetpro.ristekdikti.go.id. Improvements are needed to update information from
Component 1 to 4 activities:
Component 1: STP and TTO.
Component 2: IRFF, Monevrisbang (https://monevrisbang.ristekbrin.go.id/), Research Global
Comments: Linkage, etc.
Component 3: Profiles of degree scholars and NDP participants, excerpts and articles of
alumni’s research and products, etc.
Component 4: overall achievement (PDOs and IRIs), financial report, and other reports, etc.
Performance-Based Conditions
Data on Financial Performance
Disbursements (by loan)
Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed
P121842 IBRD-82450 Effective USD 95.00 80.00 15.00 66.45 13.55 83%
Key Dates (by loan)
Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date
P121842 IBRD-82450 Effective 29-Mar-2013 12-Apr-2013 12-Jun-2013 31-Dec-2020 31-Dec-2020
Cumulative Disbursements
6/25/2020 Page 7 of 8
The World Bank Implementation Status & Results Report
Research and Innovation in Science and Technology Project (P121842)
PBC Disbursement
Achievement Disbursed amount in Disbursement %
PBC ID PBC Type Description Coc PBC Amount
Status Coc for PBC
Restructuring History
Level 1 Approved on 30-Jan-2017
Related Project(s)
There are no related projects.
6/25/2020 Page 8 of 8