The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) Ukraine Improving Higher Education for Results Project (P171050) EUROPE AND CENTRAL ASIA | Ukraine | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2021 | Seq No: 6 | ARCHIVED on 28-May-2024 | ISR60492 | Implementing Agencies: Ministry of Education and Science of Ukraine, Ukraine Key Dates Key Project Dates Bank Approval Date: 05-May-2021 Effectiveness Date: 03-Dec-2021 Planned Mid Term Review Date: 21-Oct-2024 Actual Mid-Term Review Date: Original Closing Date: 31-Dec-2026 Revised Closing Date: 31-Dec-2026 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective is to improve the efficiency, conditions for quality, and transparency in Ukraine's higher education system. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Sector-Wide Improvements to Governance, Financing, Quality and Transparency:(Cost $54.00 M) Alliances and Partnerships for Improved Efficiency and Quality:(Cost $3.00 M) Capacity Building and Education Environment Enhancement:(Cost $39.00 M) Project Management, Monitoring & Evaluation:(Cost $4.00 M) Support to Academic and Social Scholarships for Higher Education Students:(Cost $100.00 M) Contingent Emergency Response Component Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions The Project is making progress across all project components. The MoES continues to make progress in areas related to digital transformation of the higher education sector, including through upgrading of the EDEBO information system and preparation for university admissions exams and qualifications exams, both of which contribute to the project development objectives on improving transparency and conditions for quality. The MoES also continues to strengthen its implementation and planning capacity. MoES has finalized eligibility and selection criteria for higher education institutions under Components 2 and 3, and eligible HEIs are preparing and submitting proposals for investment packages focusing on securing safe conditions, promoting digitalization of teaching and learning, and improving teaching and research laboratories. The MoES also is launching professional development support for academic managers. These activities will further contribute to the objectives of improving efficiency 5/28/2024 Page 1 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) and conditions for quality of teaching and research in higher education institutions. The MoES and Bank teams will continue to work closely together to ensure that planned project activities are fully aligned with changing needs in the sector. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Moderate Substantial Substantial Macroeconomic Substantial High High Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Moderate Moderate Institutional Capacity for Implementation and Substantial Substantial Substantial Sustainability Fiduciary Substantial Substantial Substantial Environment and Social Moderate Substantial Substantial Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Moderate Substantial Substantial Results PDO Indicators by Objectives / Outcomes Improve efficiency in higher education IN01419738 ►Performance-based funding formula is used to allocate public funding to HEIs during at least two consecutive fiscal years (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In progress. The PBF formula was used to allocate public funding in 2021. Following the Russian military invasion to Ukraine in February 2022, the PBF formula has been temporarily suspended for the duration of the martial law. However, it was reinstated in January 2024. This indicator measures implementation of the performance-based funding formula for the allocation of Comments: public funds to HEIs for at least two consecutive years during the project period. The indicator is met when performance metrics are used as part of the formula for allocating funds to HEIs, as envisioned in the higher education reform and legal/regulatory changes that are anticipated. 5/28/2024 Page 2 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) Improve conditions for quality in higher education IN01419739 ►Percentage of higher education institutions that have developed change management plans for improving university governance and teaching and learning (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 65.00 Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In progress. 28% of universities under MoES (36 HEIs) have been confirmed as eligible and are now in the process of submitting proposals. Procedures for emergency investment packages under Component 3 have also been defined with requirements for simplified change management plans describing how investments will improve teaching and learning conditions. Comments: This indicator measures progress towards improvements in university governance and teaching/learning environments in accordance with change management plans in HEIs. The indicator will be met when at least 65 percent of HEIs benefiting from Component 3 have developed change management plans with linkage to Project-financed investments. IN01419821 ►Share of students enrolled in full-time academic programs receiving academic scholarships during the 2021-2022 year, relative to the prior year (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 35.00 40.00 40.00 40.00 Date 13-Sep-2021 17-Feb-2023 17-Feb-2023 30-Dec-2022 Target achieved. MoES Financial Department has completed data collection and final review of the scholarships program which is now publicly available at the MoES website. Based on the information obtained, 40% of students enrolled in full-time academic programs have received academic scholarships during the 2021-2022 year. Relative to the 2020-2021 year, this value is 1.4 percentage points less but is Comments: fully in line with the projected 40% of scholarship holders for the 2021-2022 year. Improve transparency in higher education IN01419740 ►Number of institutions with active performance-based contracts in place (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 39.00 88.00 86.00 89.00 Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 On track. This indicator measures progress towards implementing performance-based contracts with rectors in higher education institutions. While PBC 4 measures initiation and signature of such contracts, Comments: this PDO indicator measures the maintenance of active performance-based contracts in at least 50 HEIs. Baseline as of May 2021 is 39 HEIs. Intermediate Results Indicators by Components 5/28/2024 Page 3 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) Sector-Wide Improvements to Governance, Financing, Quality and Transparency IN01419822 ►Performance-based funding formula for HEIs (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Resolution of the Resolution of the Resolution of the Cabinet No performance-based Cabinet of Ministers of Cabinet of Ministers of of Ministers of Ukraine on funding formula for Ukraine on a Ukraine on a Value a performance-based higher education is in performance-based performance-based funding formula has been place funding formula has funding formula has issued been issued been issued Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 Target achieved. This indicator measures formal adoption and introduction of a revised performance- Comments: based funding formula for HEIs. IN01419825 ►Amendments to package of laws to provide for HEIs' financial autonomy (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Package of laws HEIs do not have HEIs do not have HEIs do not have providing for financial Value financial or budget financial autonomy financial autonomy autonomy for HEIs has autonomy been enacted Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 Indicator to be dropped. Measures formal enactment of amendments to legislation to provide for HEIs' Comments: financial autonomy (linked to PBC 2). IN01419829 ►Amendments to bylaws on HEIs' financial autonomy (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target HEIs do not have HEIs do not have HEIs do not have Bylaws providing for Value financial or budget financial or budget financial or budget financial autonomy of autonomy autonomy autonomy HEIs have been issued Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 Indicator to be dropped. Measures formal adoption of legal changes on budget and financial autonomy for Comments: HEIs (linked to PBC 3). IN01419832 ►HEI performance-based contracts with KPIs (Number, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 88.00 86.00 50.00 Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 Target exceeded. This indicator measures progress towards establishing a system of performance- based contracts with rectors across the higher education system, thereby contributing to further Comments: transparency in the sector. IN01419835 5/28/2024 Page 4 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) ►Increase in students reporting satisfaction with the higher education system based on National Student Survey (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Increase in percent of Baseline to be NSS has not yet been NSS has not yet been students reporting Value determined after first implemented implemented satisfaction with higher round of NSS education system Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 TOR for development of NSS has been prepared but activity has not yet been launched. Citizen engagement corporate indicator: Measures percent increase in student satisfaction with higher education system, and progress towards greater collection and dissemination of beneficiary feedback as a result of Comments: developing and implementing a National Student Survey. Results of NSS will be published and publicly disseminated. IN01419837 ►State Electronic Database on Education (EDEBO) is upgraded for higher education management information system (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In progress, with technical upgrades for EDEBO ongoing currently. Measures development of the existing State Electronic Database on Education (EDEBO) and modernization into a fully operational higher Comments: education management information system IN01419839 ►Unified information system on competitive research funding of HEIs is established and operational (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In progress - activity has been launched. This indicator measures development and completion of unified Comments: information system on competitive research funding of HEIs. IN01419840 ►National Student Survey includes module on gender awareness and inclusion in higher education (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target National Student Survey includes module on gender National Student Survey NSS not yet designed or NSS not yet designed awareness and Value has not been established implemented or implemented inclusion in higher or implemented education and NSS results have been publicly disseminated Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 TOR for development of NSS is prepared, but activity not launched yet. Measures the establishment of a focused module on gender inclusion and awareness as part of the National Student Survey to be Comments: developed and implemented with Project support. 5/28/2024 Page 5 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) Alliances and Partnerships for Improved Efficiency and Quality IN01419828 ►Development of guidelines for pursuing HEI alliances, partnerships and mergers (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 13-Sep-2021 17-Oct-2023 08-May-2024 29-Dec-2023 Indicator to be revised as part of upcoming project restructuring. Comments: Capacity Building and Education Environment Enhancement IN01419823 ►Operational criteria, procedures and investment specifications completed by MOES (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No Yes Yes Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 Target achieved. MoES has developed operational criteria and procedures for Component 3 investment packages and they have been approved and formally launched. This indicator measures completion of Comments: readiness steps needed to launch investment packages and support change management plans of HEIs under Component 3 IN01419826 ►Number of HEI proposals approved by MOES (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In progress. MoES expected to receive at least 36 proposals by June 2024 as part of the first funding window under Component 3 on war-affected universities. Comments: This indicator measures the number of proposals submitted by HEIs and approved by MOES in support of investments for capacity building and enhancements to education environments under Component 3. IN01419830 ►Total number of laboratories delivered under Component 3 (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 150.00 Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In preparation. This indicator measures the number of laboratories procured and delivered to HEIs under both Components 2 (mergers) and 3 (capacity building and educational environment Comments: enhancement). Delivery will start after selection of HEIs, completion of agreement works and procurement. 5/28/2024 Page 6 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) IN01419833 ►Share of female students enrolled in STEM programs in project-supported HEIs (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target To be determined in Year Value In progress In progress Increase from baseline 1 of project Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 In progress. MoES has received proposals from 36 universities covering 167,000 students of which 66,500 are female (40%). However, among STEM programs, there are 75,500 students enrolled, of which Comments: 14,100 are female (19%). Measures share of female students enrolled in science, technology, engineering, and mathematics programs in project-supported HEIs. IN01419836 ►Students benefiting from direct interventions to enhance learning (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 222,764.00 222,764.00 120,000.00 Date 05-May-2021 17-Oct-2023 08-May-2024 31-Dec-2026 Target exceeded. Figures include beneficiaries of academic and social scholarships programs financed Comments: under Component 5. IN01419838 Students benefiting from direct interventions to enhance learning - Female (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 99,020.00 60,000.00 IN01429869 ►Number of students supported with better education (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 222,764.00 120,000.00 Date 05-May-2021 -- 08-May-2024 31-Dec-2026 Support to Academic and Social Scholarships for Higher Education Students IN01419824 ►Number of months during 2021-2022 academic year for which at least 90% of HEIs under MoES received funds through State Treasury Service for payment of academic scholarships to students (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 10.00 10.00 8.00 Date 13-Sep-2021 17-Feb-2023 17-Feb-2023 30-Dec-2022 Target exceeded. Scholarships were paid for 10 fiscal months during 2021-2022 academic year Comments: (September 2021 - June 2022). IN01419827 5/28/2024 Page 7 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) ►Number of students who received academic scholarships by the end of the 2021-2022 academic year (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 163,179.00 163,179.00 172,000.00 Date 13-Sep-2021 17-Feb-2023 17-Feb-2023 30-Dec-2022 IN01419831 ►Number of students who received social scholarships by the end of the 2021-2022 academic year (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 59,585.00 59,585.00 50,000.00 Date 13-Sep-2021 17-Feb-2023 17-Feb-2023 30-Dec-2022 IN01419834 ►Review of scholarship programs completed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 13-Sep-2021 17-Oct-2023 17-Oct-2023 31-Dec-2026 Target achieved. Both MoES and Ministry of Social Policy have completed reviews of academic and Comments: social scholarship programmes and both reviews are publicly available. Performance-Based Conditions IN01419841 ►PBC 1 Performance-based funding formula for HEIs (Text, Intermediate Outcome, 10,000,000.00, 100.00%) Baseline Actual (Previous) Actual (Current) 2026 Resolution of the Cabinet Resolution of the Cabinet No performance-based of Ministers of Ukraine on of Ministers of Ukraine on Value funding formula for higher a performance-based a performance-based -- education is in place funding formula has been funding formula has been issued issued Date -- 17-Oct-2023 08-May-2024 -- IN01419842 ►PBC 2 Amendments to package of laws to provide for HEIs' financial autonomy (Text, Intermediate Outcome, 10,000,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) 2026 5/28/2024 Page 8 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) HEIs do not have financial HEIs do not have HEIs do not have financial Value -- or budget autonomy financial autonomy autonomy Date -- 17-Oct-2023 08-May-2024 -- Indicator to be revised. This indicator measures formal enactment of amendments to legislation to provide for HEIs' financial autonomy (linked to PBC 2). However, this is suspended due to force majeure circumstances Comments: caused by the full-scale invasion. Currently, MoES and the Bank have agreed to drop the indicator as part of the UIHERP project restructuring. IN01419843 ►PBC 3 Amendments to bylaws on HEIs' financial autonomy (Text, Output, 5,000,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) 2026 HEIs do not have HEIs do not have financial HEIs do not have financial Value financial or budget -- or budget autonomy or budget autonomy autonomy Date -- 17-Oct-2023 08-May-2024 -- Indicator to be revised. This measures formal adoption of legal changes on budget and financial autonomy for HEIs (linked to PBC 3). This activity is currently suspended due to force majeure circumstances caused by the Comments: full-scale invasion. Currently, MoES and Bank have agreed to drop the indicator as part of the UIHERP project restructuring. IN01419844 ►PBC 4 HEI performance-based contracts with KPIs (Number, Intermediate Outcome, 20,000,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) 2026 Value 0.00 88.00 86.00 -- Date -- 17-Oct-2023 08-May-2024 -- Target exceeded. This indicator measures progress towards establishing a system of performance-based Comments: contracts with rectors across the higher education system, thereby contributing to further transparency in the sector. Currently, MoES and Bank have agreed to scale up this indicator as part of the UIHERP restructuring. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P171050 IBRD-92380 Effective USD 200.00 200.00 0.00 134.69 65.31 67% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P171050 IBRD-92380 Effective 05-May-2021 13-Sep-2021 03-Dec-2021 31-Dec-2026 31-Dec-2026 5/28/2024 Page 9 of 10 The World Bank Implementation Status & Results Report Ukraine Improving Higher Education for Results Project (P171050) Cumulative Disbursements Restructuring History Level 2 Approved on 09-Mar-2022 Related Project(s) There are no related projects. 5/28/2024 Page 10 of 10