The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) Basic Education Strengthening and Transformation Project (P166744) EAST ASIA AND PACIFIC | Timor-Leste | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2020 | Seq No: 5 | ARCHIVED on 22-Dec-2022 | ISR54466 | Implementing Agencies: Democratic Republic of Timor-Leste, Ministry of Education, Youth and Sports Key Dates Key Project Dates Bank Approval Date: 22-Apr-2020 Effectiveness Date: 11-Aug-2020 Planned Mid Term Review Date: 13-Mar-2023 Actual Mid-Term Review Date: Original Closing Date: 30-Jun-2025 Revised Closing Date: 30-Jun-2025 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) To improve the learning environment of basic education schools and increase the efficiency and equity of basic education programs. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Component 1: Developing 21st Century Learning Spaces:(Cost $15.00 M) Component 2: Improving Teacher Effectiveness:(Cost $2.58 M) Component 3: Improving Teaching-Learning Material and Assessment:(Cost $2.27 M) Component 4: Data Driven Planning, Budgeting, Financing and Implementation:(Cost $2.30 M) Component 5: Project Management and Implementation:(Cost $1.40 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Unsatisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions Implementation of the project slowed between June and September but gained momentum after the Project Steering Committee meeting in October 2022. Thanks to the continued engagement of the National Directorate of School Park and INFORDEPE and the increased World Bank’s technical assistance in teacher training, significant progress was observed in two components. First, in Component 1- Enhancing 21st-century school learning space: 21st-century school standards were approved and used for school prototypes at all levels. The detailed engineering design commenced for the first batch of new construction and rehabilitation of classrooms and WASH and drinking water facilities. Two, in Component 2-Improving teacher effectiveness: the upgraded classroom observation tool was approved, and the instructional leadership training was launched to support school leaders in the observation of classroom teaching practices. Strengthened coordination with development partners has avoided duplication of effort and resulted in improved synergies. In the next six months, the government will focus on delivering the first result targets under the first two components and expedite the implementation of activities in component 4: Improving Teaching-Learning Materials and Learning assessment and 12/23/2022 Page 1 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) component 5: Data-driven planning, budgeting and implementation. Implementation capacity in fiduciary and monitoring and evaluation will be further enhanced as project implementation extends to all municipalities. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Substantial Substantial Substantial Macroeconomic Substantial Substantial Substantial Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Moderate Moderate Institutional Capacity for Implementation and Moderate Moderate Moderate Sustainability Fiduciary Moderate Moderate Moderate Environment and Social Moderate Moderate Moderate Stakeholders Substantial Substantial Substantial Other -- -- Moderate Overall Moderate Moderate Moderate Results PDO Indicators by Objectives / Outcomes To improve the learning environment of basic education schools IN01233582 ►Number of students accessing classrooms meeting newly developed 21st Century School Standards (cumulative) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15,360.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. School/classroom construction meeting 21st-century school standards is expected to start in April 2023. Comments: Expected achievement by June 2023: 1,750 students. IN01233585 Number of students accessing classrooms meeting newly developed 21st Century School Standards--Female (cumulative) (Number, Custom Breakdown) 12/23/2022 Page 2 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 7,680.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 IN01233586 ►Share of students in Cycles 1 and 2 who use individual textbooks in the classroom (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Value Unknown Unknown TBD TBD Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 TBD. Baselines and targets will be established once the school census is completed in March 2023. Comments: To increase the efficiency and equity of basic education programs IN01233583 ►Share of basic education teachers in rural areas who utilize effective mathematics and language teaching approaches in the classroom (Percentage, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Value 45.00 0.00 0.00 55.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 No data is available. (i) The ratings provided under the current COT are unrealistic and not reliable to determine a baseline (The result under the current COT indicates a percentage of teachers rated good or better over 80 percent, well above the 45 percent baseline). For this reason, the COT data cannot be used as a Comments: benchmark. (ii) The upgraded COT has not been in use. IN01233584 ►Verified EMIS data utilized for the preparation of annual budgets and making infrastructure investment decisions (Yes/No, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. EMIS data will not be verified via the school census until March 2023. Expected achievement by June 2023: Verified EMIS data will be utilized for the preparation of annual Comments: budgets and making infrastructure investment decisions. IN01233587 ►Total number of project beneficiaries (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 77.00 149,100.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 12/23/2022 Page 3 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) Not achieved (77 project beneficiaries). Comments: Expected achievement by June 2023: 11,067. IN01233588 Total number of project beneficiaries - Female (cumulative) (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 10.00 74,085.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 IN01233589 ►Students benefiting from direct interventions to enhance learning (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 144,000.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. Comments: Expected achievement by June 2023: 8,400 students. IN01233590 Students benefiting from direct interventions to enhance learning - Female (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 72,000.00 Intermediate Results Indicators by Components Component 1: Developing 21st Century Learning Spaces IN01233591 ►Development/upgrade and use of standards for infrastructure (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 21st Century-School Standard was All new public school 21st Century-School approved by Minister infrastructure Standards have been in September 2022. Standards under development Value finalised and will be Legal procedures are development completed this FY has adopted via Minister's in process for formal been based on Diploma in June 2022 adoption. School approved standards prototype update is under progress. Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Partially achived. The 21st-century standard was approved by Minister in September 2022. Legal procedures are in process for formal adoption. School prototype update is under progress. Comments: Expected achievement by June 2023: All new public school infrastructure development completed by June 2023 will have been based on approved standards. IN01233596 12/23/2022 Page 4 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) ►Development/upgrade and use of new infrastructure development prioritization system (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Prioritization criteria developed and used for the selection of 10 schools for All schools targeted for construction in April infrastructure Prioritization system Prioritization system 2023. Technical Value development selected under development under development Assistance (TA) is using the prioritization being recruited to system develop the prioritization guidelines and provide training for MEYS. Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Partially achieved. Prioritization criteria developed and used for the selection of 10 schools for construction in April 2023. Technical Assistance (TA) is being recruited to develop the prioritization guidelines and provide training for MEYS. Comments: Expected achievement by June 2023: All schools targeted for infrastructure development selected will have used the completed/ adopted prioritization system and school census results. IN01233601 ►Implementation of school infrastructure census (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The census started on 6 December 2022. Preliminary findings School infrastructure Old census data not The census is expected will be available by the census and survey Value sufficient to start in June 2022 end of December reports prepared and 2022. A full report to published be known by the end of March 2023 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Partially achieved. The small purposive infrastructure survey of school infrastructure was completed. School Census data collection commenced on December 7. Comments: Expected achievement by June 2023: School census reports will be available in Feb/Mar 2023 and published on MOEYS 's website. IN01233605 ►Number of classrooms meeting minimum standards in basic education schools (cumulative) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 200.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. School construction will start in April 2023. Comments: Expected achievement by June 2023: 50 classrooms. Component 2: Improving Teacher Effectiveness IN01233593 12/23/2022 Page 5 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) ►Teachers recruited or trained (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 4,500.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. School teacher training plan was approved by INFORDEPE in October 2022 and 24 INFORDEPE National Trainers were deployed in November 2022 to deliver training for teachers and leaders across the country until May 2025. Module development will be completed in January 2023. TOT Comments: will commence in late February and roll out in municipalities in March 2023. Expected achievement by June 2023: 240 teachers will have been trained. IN01233599 Teachers recruited or trained - Female (RMS requirement) (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 1,845.00 IN01233604 Number of teachers trained (Number, Corporate Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 4,500.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 IN01233606 ►Share of teachers monitored using a classroom observation tool (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 25.00 0.00 0.00 75.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. COT has been updated and was approved by MOEYS in September 2022. TOT on building skills for instructional leadership (including how to observe teaching practices) was launched in November Comments: 2022. Training for school leaders will be rolled out January-March 2023 in 11 municipalities. IN01233607 ►Number of school leaders who completed the new leadership training (cumulative) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 600.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. Instructional leadership training plan was approved by INFORDEPE in October 2022. Phase 1 Train the Trainer (TOT) commenced in November 2022; Leadership training in 11 municipalities will be rolled out in January 2023; Phase 2 training modules will be developed by end of March 2023; Comments: Phase 2 TOT will commence in April 2023. Expected achievement by June 2023: 637 school leaders will have completed the new leadership training. IN01233608 12/23/2022 Page 6 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) ►Share of females among those completing the new leadership training program during the current fiscal year (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 25.00 0.00 0.00 40.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. Instructional leadership training plan was approved by INFORDEPE in October 2022. Phase 1 Train the Trainer (TOT) commenced in November 2022; Leadership training in 11 municipalities will be rolled out in January 2023; Phase 2 training modules will be developed by end of March 2023; Comments: Phase 2 TOT will commence in April 2023. Expected achievement by June 2023: Share of female among those completing the new leadership training program: 11 percent. IN01233609 ►Female-male difference in primary net enrollment rate (percentage points) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 5.97 2.00 0.00 3.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Achieved (0.00 percent). Comments: Component 3: Improving TLM and Assessment IN01233592 ►Share of basic education schools that receive full package of teaching-learning materials (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 50.00 0.00 0.00 90.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 The data are not available. A consultant to develop the TLM tracker is being recruited. Comments: IN01233597 ►Share of Cycle 1 and 2 students in public schools with access to book corners/libraries in their classrooms (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. The book selection proposal is being put on hold. Comments: IN01233602 ►Implementation of a sample-based nationally representative assessment of foundational literacy and numeracy skills of students in grades 2 and 3 (results disaggregated by gender) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Nationally representative Nationally representative Nationally Two assessment Value assessment not done assessment not done representative reports published 12/23/2022 Page 7 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) assessment has not been conducted Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. REOI for EGRA and EGMA was readvertised on November 30, 2022. Selection of the Comments: consulting firm will not be completed until end of February 2023. Component 4: Data Driven Planning, Budgeting, Financing and Implementation IN01233594 ►Integrated platform for EMIS and other applications (Gestão Escolar) developed (with provisions for accessing gender specific data) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Not achieved. Selection of the EMIS Gestion Escolar platform Gestão Escolar platform developer launched in Gestion Escolar Value not operational not operational May was terminated. platform operational TOR update is in the process. Date 22-Apr-2020 03-Jun-2022 30-Nov-2022 30-Jun-2025 Not achieved. Selection of the EMIS developer launched in May was terminated. TOR update is in the Comments: process. IN01233598 ►Share of basic education schools completing electronic data entry in EMIS through the Gestão Escolar platform by March of the current academic year (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. Selection of the EMIS developer launched in May was terminated. TOR update is in the Comments: process. IN01233603 ►Independent verification of EMIS data completed (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target One verification Independent census and one Independent verification Independent Verification Verification of EMIS Value sample-based of EMIS data not done of EMIS data not done data has not been verification completed conducted. during project period Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. School Census data collection only commenced on December 7. Comments: Component 5: Project Management and Implementation IN01233595 ►Review of education sector progress, including progress on project activities, through stakeholder consultation and community engagement (Text, Custom) 12/23/2022 Page 8 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) Baseline Actual (Previous) Actual (Current) End Target No stakeholder Formal community Formal community Conducted in all Value consultation has been consultation not done consultations not done municipalities conducted so far. Date 22-Apr-2020 03-Jun-2022 15-Nov-2022 30-Jun-2025 Not achieved. The first consultation will be conducted in Quarters 2-3 of 2023 in parallel with the Comments: implementation of project activities under the four components. IN01233600 Feedback from beneficiaries has been used to make needed adjustments to the project (Yes/No, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Performance-Based Conditions IN01233610 ►PBC 1 Share of students in Cycles 1 and 2 who use individual textbooks in the classroom (Text, Process, 730,000.00, 0.00%) July 1, 2024–June Baseline Actual (Previous) Actual (Current) 30, 2025 Unknown Value Unknown Unknown -- Date -- 03-Jun-2022 15-Nov-2022 -- DLR1.1 due June 30, 2022 was not achieved. Request for DLI extension to June 30, 2023 was submitted to Comments: the GPE Secretariat IN01233611 ►PBC 2 Share of basic education teachers in rural areas who utilize effective mathematics and language teaching approaches in the classroom (Percentage, Outcome, 1,000,000.00, 0.00%) July 1, 2024–June Baseline Actual (Previous) Actual (Current) 30, 2025 Value 45.00 0.00 0.00 -- Date -- 03-Jun-2022 15-Nov-2022 -- The ratings provided under the current COT are unrealistic and not reliable for determining a baseline: (i) The result under the current COT indicates a percentage of teachers rated good or better over 80 percent, well Comments: above the 45 percent baseline. For this reason, the COT data cannot be used as a benchmark. (ii) The upgraded COT will be used from January 2023. IN01233612 ►PBC 3 Verified EMIS data utilized for the preparation of annual budgets and making infrastructure investment decisions (Yes/No, Output, 1,000,000.00, 0.00%) 12/23/2022 Page 9 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) July 1, 2024–June Baseline Actual (Previous) Actual (Current) 30, 2025 Value No No No -- Date -- 03-Jun-2022 15-Nov-2022 -- DLR 3.1 due June 30, 2022, was not achieved. Request for DLI extension to June 30, 2023, submitted to GPE Comments: Secretariat. DLR 3.2 due June 30, 2023 has not been achieved. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P166744 IDA-65510 Effective USD 15.00 15.00 0.00 0.20 13.71 1.4% P166744 TF-B2130 Effective USD 8.55 8.55 0.00 0.56 7.99 6.5% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P166744 IDA-65510 Effective 22-Apr-2020 29-Dec-2020 20-Oct-2021 30-Jun-2025 30-Jun-2025 P166744 TF-B2130 Effective 22-Apr-2020 05-Aug-2020 11-Aug-2020 30-Jun-2025 30-Jun-2025 Cumulative Disbursements 12/23/2022 Page 10 of 11 The World Bank Implementation Status & Results Report Basic Education Strengthening and Transformation Project (P166744) Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 12/23/2022 Page 11 of 11