The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) Mongolia Education Quality Reform Project (P148110) EAST ASIA AND PACIFIC | Mongolia | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 14 | ARCHIVED on 06-Jan-2021 | ISR42753 | Implementing Agencies: Ministry of Education and Science, Ministry of Labor and Social Protection, Mongolia Key Dates Key Project Dates Bank Approval Date: 06-Jun-2014 Effectiveness Date: 17-Aug-2015 Planned Mid Term Review Date: 08-May-2018 Actual Mid-Term Review Date: 15-May-2018 Original Closing Date: 31-Dec-2019 Revised Closing Date: 31-Dec-2022 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objectives are to improve the quality of education for primary school children in Mongolia, with particular emphasis on improving native language and mathematical skills, and strengthen school-level planning. Has the Project Development Objective been changed since Board Approval of the Project Objective? Yes Board Approved Revised Project Development Objective (If project is formally restructured) The Project Development Objectives are to improve the quality of education for primary school children in Mongolia, with particular emphasis on improving native language and mathematical skills, strengthen school-level planning and increase support for child welfare transfers during the COVID-19 emergency. Components Table Name Support for child welfare during the COVID-19 emergency:(Cost $5.00 M) Improving learning outcomes:(Cost $11.40 M) Pre- and in-service professional development of teachers:(Cost $3.10 M) Implementation of a school support program:(Cost $8.60 M) System management, monitoring and evaluation:(Cost $1.90 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions The EQRP has disbursed over 83% of the US$30 million IDA funding. Most recently, the EQRP disbursed US$5 million to support the national COVID-19 crisis response through the child money program as planned during the project restructuring completed in June 2020. With the 1/6/2021 Page 1 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) limited opening of schools in 2020 (for only September and October), the project was not able to implement many of the planned school level activities (e.g., classroom and national assessments, teacher training, school grant data collection/monitoring). However, the EQRP continued to recruit key consultancies, finalize procurement packages for goods and furniture for 8 of the 21 special education resource rooms and produce 54,000 manuals for teachers to support their delivery of catch up curriculum utilized during school reopening in September. Some project activities aimed at strengthening the primary education assessment system are underway (although the national primary assessment has been cancelled for 2020), and the project is supporting Mongolia's participation in the Programme for International Student Assessment (PISA) which is now slated for 2022. The 4th cycle of school support grants has been implemented by 351 grant recipient schools. An additional 5th cycle of school grants will be rolled out next academic year focusing on improving the capacity of schools to use educational technology solutions for primary teaching and learning and student "catch-up" after the long school closure. The school grant handbooks are being revised and would be available by March 2021. The scale up of the teacher training related to the Early Grade Mathematics Assessment (EGMA) is currently scheduled to take place in January 2021 as the project explores how to provide this training on-line. Progress towards achieving the PDO as measured by improved language and mathematics skills is likely to be challenged by the learning lags from school closures for most of calendar year 2020. With the scheduled reopening of school in February 2021, the EQRP would aim to resume many of the school level activities. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Moderate Macroeconomic -- Substantial Substantial Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and -- Moderate Moderate Sustainability Fiduciary -- Low Low Environment and Social -- Low Low Stakeholders -- Moderate Low Other -- -- Substantial Overall -- Moderate Moderate Results PDO Indicators by Objectives / Outcomes Improved learning outcomes IN00870504 1/6/2021 Page 2 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) ►The average number of words read correctly per minute at end of grade 2 (oral reading fluency). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 44.00 46.00 46.00 50.00 Date 01-Jul-2014 20-May-2019 10-Dec-2020 30-Dec-2022 This indicator will only be updated by endline assessment. Comments: IN00870506 The average number of words read correctly per minute at end of Grade 2 by Males (oral reading fluency) (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 40.00 42.00 42.00 48.00 Date 19-May-2017 31-May-2019 10-Dec-2020 30-Dec-2022 IN00870507 The average number of word read correctly per minute at the end of Grade 2 by Females (oral reading fluency) (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 47.00 50.00 50.00 52.00 Date 19-May-2017 31-May-2019 10-Dec-2020 30-Dec-2022 IN00870508 ►The average number of correct additions per minute at the end of grade 2. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 14.00 14.00 14.00 16.00 Date 19-May-2017 19-May-2017 10-Dec-2020 30-Dec-2022 This indicator will only be updated by endline assessment since the EGMA training and activity has not yet been rolled out. Comments: IN00870509 The average number of correct additions per minute at end of Grade 2 for Males (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 14.00 0.00 14.00 16.00 Date 19-May-2017 15-May-2020 10-Dec-2020 30-Dec-2022 IN00870510 The average number of correct additions per minute at end of Grade 2 for Females (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 14.00 0.00 14.00 16.00 Date 19-May-2017 15-May-2020 10-Dec-2020 30-Dec-2022 1/6/2021 Page 3 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) Strengthened school-level planning IN00870505 ►Of the total number of school financing recipient schools in the project, the percentage that have successfully achieved the school proposal objectives and targets agreed in the school financing (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 70.00 0.00 70.00 Date 01-Jul-2014 19-Apr-2019 10-Dec-2020 30-Dec-2022 There is a delay in conducting the third party monitoring of the School Grants Cycle IV because of the Comments: COVID-19 restrictions. The monitoring is expected to report on this indicator by April 2021. Support to child welfare funds in response to COVID-19 emergency IN00870503 ►Social Welfare Fund top up allocated to children during COVID-19 emergency (Amount(USD), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 5,000,000.00 5,000,000.00 Date 29-Apr-2020 29-Apr-2020 25-Sep-2020 30-Dec-2022 This indicator has been achieved. Comments: Intermediate Results Indicators by Components Improving learning outcomes IN00870511 ►Number of schools benefiting from full set of reading books available in the classrooms (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 511.00 553.00 550.00 Date 30-Dec-2014 31-Dec-2018 10-Dec-2020 30-Dec-2022 Kazakh language books delivered to additional 42 schools in Bayan-Ulgii. Comments: IN00870515 ►Primary National Assessment conducted annually (Yes/No) (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes No Yes Date 01-Jul-2014 19-Nov-2019 10-Dec-2020 30-Dec-2022 The Grade 4 national assessment planned in 2020 has been postponed because of COVID-19 school Comments: closures. 1/6/2021 Page 4 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) IN00870518 ►System for learning assessment at the primary level (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 01-Jul-2014 19-Nov-2019 10-Dec-2020 30-Dec-2022 IN00870522 Utility of the learning assessment system (Number, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 1.00 1.00 1.00 2.00 IN00870523 ►Mongolia participation in PISA 2022 assessment (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 31-Dec-2018 04-May-2020 10-Dec-2020 30-Dec-2022 Mongolia is participating in the PISA assessment and was making progress on field testing and Comments: sampling. OECD has now postponed the PISA to April 2022 because of the COVID-19 crisis. IN00870526 ►Number of schools received distance learning materials for distribution during COVID-19 emergency (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 300.00 Date 30-Apr-2020 29-Apr-2020 10-Dec-2020 30-Dec-2022 Government has not yet decided on methodology to be used to reach remote schools. Comments: IN00870527 ►Number of inclusive education resource rooms available (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 22.00 Date 29-May-2020 29-May-2020 10-Dec-2020 30-Dec-2022 Procurement for 8 resource rooms has been completed, but not yet delivered because of COVID--19 Comments: restrictions. Pre- and in-service professional development of teachers IN00870512 ►Percentage of grade 2 teachers reporting native language assessments results (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target 1/6/2021 Page 5 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) Value 0.00 90.00 90.00 93.00 Date 01-Jul-2014 19-Nov-2019 10-Dec-2020 30-Dec-2022 Due to COVID-19 school closures, this indicator could not be measured at the end of grade 2 in 2020. Comments: IN00870516 ►Percentage of grade 2 teachers reporting assessment results on: (a) additions and subtractions; and (b) identification of missing numbers in a sequence (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 86.00 86.00 89.00 Date 01-Jul-2014 19-Nov-2019 10-Dec-2020 30-Dec-2022 Due to COVID-19 school closures, this indicator could not be measured at the end of grade 2 in 2020. Comments: IN00870519 ►Of the total number of primary school teachers to be trained during the project life, the average % that improved their knowledge in native language assessment methodology (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 35.00 35.00 65.00 Date 01-Jul-2014 28-Dec-2018 10-Dec-2020 30-Dec-2022 Due to COVID-19 school closures and national restrictions, teachers could not participate in the planned Comments: 2020 training that measures this indicator. IN00870520 ►Of the total number primary school teachers to be trained during the project life, the average % that improved their knowledge in early grade mathematical skills assessment (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 65.00 Date 01-Jul-2014 24-Nov-2015 10-Dec-2020 30-Dec-2022 Due to COVID-19 school closures and national restrictions, teachers could not participate in the planned Comments: 2020 training that measures this indicator. IN00870524 ►Average percentage of the school year allocated for instruction in the classroom. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 69.00 69.00 69.00 75.00 Date 19-May-2017 19-May-2017 10-Dec-2020 30-Dec-2022 This indicator will only be updated by an end line assessment. Comments: Implementation of a school support program IN00870513 1/6/2021 Page 6 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) ►The percentage of schools under the project, used school grant funding for pedagogical-related activities (as defined in the School Support Handbook) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 32.00 32.00 60.00 Date 01-Jul-2014 19-Nov-2019 10-Dec-2020 30-Dec-2022 The third party monitoring of Cycle IV School Grants was delayed because of COVID-19 restrictions and Comments: school closures. The report to update this indicator would only be available in April 2021. System management, monitoring and evaluation IN00870514 ►Direct project beneficiaries (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 338,981.00 338,981.00 520,000.00 Date 01-Jul-2014 19-Nov-2019 19-Nov-2019 30-Dec-2022 Now that the project is being implemented nationally, the number of beneficiaries includes all primary students and teachers as well as school administrators and local education specialists. The end target will Comments: be revised as part of the planned restructuring. IN00870517 Female beneficiaries (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 52.00 52.00 52.00 IN00870521 ►Students benefiting from direct interventions to enhance learning (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 326,000.00 326,000.00 506,000.00 Date 01-Jul-2014 19-Nov-2019 19-Nov-2019 30-Dec-2022 Number of primary students. Comments: IN00870525 Students benefiting from direct interventions to enhance learning - Female (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 150,000.00 150,000.00 240,000.00 Performance-Based Conditions 1/6/2021 Page 7 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) IN00870528 ►PBC 1 Improved learning outcomes (Text, Output, 13,500,000.00, 40.74%) Baseline Actual (Previous) Actual (Current) Dropped Full set of new reading Full set of new reading Value No actions completed books available in 80% of books available in 80% of -- schools in country schools in country Date -- 28-Jun-2019 28-Jun-2019 -- IN00870529 ►PBC 2 Implementation of a school grants program (Text, Output, 6,100,000.00, 67.21%) Baseline Actual (Previous) Actual (Current) Dropped First batch of schools First batch of schools (200) have completed (200) have completed implementation of their implementation of their school proposals. At school proposals. At least least 10% of the first School support 10% of the first batch of batch of schools have completion reports Value No actions completed schools have satisfactorily satisfactorily completed have been completed implementation implementation of their submitted to MES of their school proposal. school proposal. Second Second batch of schools batch of schools (450) (450) are implementing are implementing their their school proposals. school proposals. Date -- 11-Jun-2018 11-Jun-2018 -- Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P148110 IDA-54880 Effective USD 30.00 30.00 0.00 22.52 4.70 83% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P148110 IDA-54880 Effective 06-Jun-2014 18-Jun-2015 17-Aug-2015 31-Dec-2019 31-Dec-2022 Cumulative Disbursements 1/6/2021 Page 8 of 9 The World Bank Implementation Status & Results Report Mongolia Education Quality Reform Project (P148110) PBC Disbursement Achievement Disbursed amount in Disbursement % PBC ID PBC Type Description Coc PBC Amount Status Coc for PBC Restructuring History Level 2 Approved on 11-Jun-2015 ,Level 2 Approved on 06-Jul-2020 Related Project(s) There are no related projects. 1/6/2021 Page 9 of 9