The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) Georgia – Innovation, Inclusion, and Quality Project (I2Q) (P168481) (Loan No. 8955) Implementation Support Mission Aide Memoire April 4 – 11, 2024 I. INTRODUCTION 1. A World Bank task team1 conducted the implementation support mission for Georgia Innovation, Inclusion, and Quality Project (Georgia I2Q) from April 4 – 11, 2024, to review the progress in achieving the project development objectives (PDOs) and identify necessary actions and next steps to accomplish the PDOs. The mission’s objectives were to (i) review the ongoing project implementation progress, fiduciary and safeguards aspects; (ii) identify any pending issues and agree on measures to resolve them; (iii) follow up on the project restructuring needs identified at the mid- term review (MTR) in March 2023; and (iv) organize the 4th education sector donor coordination meeting. 2. The Bank Team would like to express its gratitude for their support of the mission to Mr. Giorgi Amilakhvari (Minister, Ministry of Education, Science, and Youth of Georgia - MoESY), Mr. Nodar Papukashvili (Deputy Minister, MoESY), Mr. Kakha Khandolishvili (Head of Strategy and International Relations Department of MoESY), Ms. Tamar Sanikidze (Executive Director, MoESY, Project Management Unit - PMU), Mr. Giorgi Mikeladze (Project Manager, Municipal Development Fund (MDF), Project Management Team (PMT)), representatives of MoESY departments and autonomous agencies, and the PMU/PMT members. The team also appreciates the generous cooperation extended by schools and universities that the team visited during the mission. The list of officials met and schools visited is provided in Annex 1. II. PROJECT DATA AND RATINGS Table 1: Key Project Data and Ratings Project Data Previous (Oct 2023) Current (Apr 2024) Original Project Amount EUR 90 m Total Disbursement (EUR) 20.1 m 29.7 m Disbursement Rate 22.3% 33.0% Closing Date Mar 31, 2026 Project Components Previous (Oct 2023) Current (Apr 2024) PDO Satisfactory Satisfactory Implementation Progress (IP) Satisfactory Moderately Satisfactory Component 1: Improving Quality of and Access to Satisfactory Highly Satisfactory Early Childhood Education and Care (ECEC) Component 2: Fostering Quality Teaching and Satisfactory Moderately Satisfactory Learning in General Education 1 The team comprised Mr. Shiro Nakata (Senior Economist, Task Team Leader), Ms. Anna Berdzenadze (Education Specialist), Mr. Ahmet Levent Yener (Practice Leader), Mr. Nikolozi Chantladze (Procurement Specialist), Sepehr Fotovat (Senior Procurement Specialist), Mr. Tural Jamalov (Senior Financial Management Specialist), Ms. Darejan Kapanadze (Senior Environmental Specialist), Mr. David Jijelava (Social Development Specialist), Mr. Davit Dekanosidze (Consultant), and Ms. Lela Ghongadze (Program Assistant). Page 1 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) Component 3: Strengthening Financing Options and Satisfactory Satisfactory Promoting Internationalization in Higher Education Component 4: System Strengthening and Stakeholder Moderately Satisfactory Moderately Satisfactory Communication Project Management, Monitoring, and Evaluations Satisfactory Satisfactory Procurement Satisfactory Satisfactory Financial Management Satisfactory Satisfactory Safeguard Satisfactory Satisfactory III. IMPLEMENTATION PROGRESS AND KEY FINDINGS A. Overall Progress: 3. Progress towards PDO: The PDOs are to (i) expand access to preschool education, and (ii) improve the quality of education and learning environments. Progress towards PDO is satisfactory based on the progress to date. All PDO indicators are on track or overachieved. PDO indicator 1 on the enrollment of School Readiness Programs (SRP) is on track to achieve the end target. PDO indicator 2 on the beneficiary number has overachieved the target. PDO indicator 3 on learning outcome is to be assessed. See Annex 4 for progress on all the indicators. 4. The pace of implementation has remained accelerated across all the components. The school infrastructure activity has made steady progress, barring complicated rehabilitation works of Tbilisi schools. All civil works contracts for school renovation and construction, except for four Tbilisi schools, have been signed or will be signed soon by May 2024. The overall disbursement stands at 33.0 percent as of April 9, 2024. EUR 15.9 million has been disbursed in FY24 so far. Approximately additional EUR2.5 million is expected for disbursement by the end of June 2024. However, there are two key implementation issues to be resolved, putting a significant risk of delaying the project implementation. 5. Key progress includes (i) for school construction (out of 14 schools in total), civil work ongoing for 4 schools, and contracts to be signed by May for the 10 remaining schools; (ii) for school rehabilitation (out of 23 schools), civil work ongoing for 13 schools, contracts to be signed by May for 6 schools, and detail design ongoing for 4 schools in Tbilisi; (iii) 130 SRP rehabilitation have been completed; (iv) Science, Technology, Engineering, Arts, and Mathematics (STEAM) pilot is implemented at 80 schools; and (v) the 2nd call for proposal of Competitive Innovation Fund (CIF) collected 46 proposals and the evaluation process finalized. 6. Key issues discussed include (i) pending decisions by the MoESY on the national student assessment; (ii) the delays and complexity of the remaining 4 school rehabilitation works in Tbilisi; and (iii) the need for a no-cost extension of at least 9 months. B. Component-wise Progress: Component 1 - Improving Quality of and Access to Early Childhood Education and Care 7. This component aims to expand access to quality preschool services by establishing a quality assurance system and its implementation mechanisms, ECEC data collection systems, ECEC caregiver-pedagogues’ and caregivers’ professional development, a certification and licensing system for ECEC professionals, a functional SRP, and new model schools. The project also supports Page 2 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) the rehabilitation work to set up SRP classrooms at 150 schools. The performance of this component is improved to highly satisfactory with all activities on track and meeting additional requestes from the MoESY. 8. Key progress in this component since the last mission includes (a) the first annual conference for ECE stakeholders organized; (b) the infrastructure technical regulation for ECE revised; (c) 2-5 year- old ECE curriculum and SRP curriculum revised and agreed with the MoESY; (d) training modules for caregivers, caregiver-pedagogue, and administrators developed, professional development (PD) pilot completed in Gori municipality; (e) 10 trainers and 80 ECE institution authorization experts trained for kindergarten authorization; (f) the rehabilitation work of SRP classrooms completed at 130 schools (out of 150 schools); (g) the draft merit-based remuneration scheme instruments developed and consultations with the Parliament, Ministry of Finance and MoESY in progress; (h) qualification requirements for administrative and technical staff for ECE institutions developed; (i) draft professional development scheme of the ECE institutions’ educational personnel elaborated and presented to the MoESY and 6 pilot municipalities. 9. Key Agreed Actions: The project will (a) complete the ongoing professional development pilot in 5 out of 6 target municipalities from April to June 2024; (b) based on the findings of the conducted pilot, implement another round of professional development trainings in Gori municipality (for another sample of educational and administrative staff); (c) conduct a simulation of kindergarten authorization experts’ visits in Gori by May 31, 2024; (d) provide training on nutrition, conflict management, and effective communication for authorization experts by May 31, 2024; (e) pilot data reporting tools and merit-based remuneration scheme in 6 municipalities from June to August 31, 2024; (f) rehabilitate the remaining 20 SRP centers, train SRP teachers, and provide equipment to SRPs by August 31, 2024; (g) conduct a simulation of kindergarten authorization council meeting by September 30, 2024; and (h) initiate implementation of the revised SRP classes at 150 schools by September 30, 2024. Component 2 - Fostering Quality Teaching and Learning in General Education 10. This component aims to enhance the learning environment in general education by upgrading infrastructure in selected schools, developing school infrastructure standards, strengthening capacity for whole school improvement, capacity development of teachers and principals, and developing enhanced mechanisms for formative assessment and national student assessment. The progress of this component is downrated to moderately satisfactory due to pending decisions by the MoESY on the national student assessment and the delays in the 4 school rehabilitation works in Tbilisi. 11. School Infrastructure - Rehabilitation: The project aimed to improve the learning environment of up to 60 selected schools through rehabilitation. However, the MDF identified 12 schools as unfeasible for rehabilitation. In addition, due to the cost escalation and depreciation of EUR, as well as the enhanced infrastructure requirements introduced by the new school infrastructure standard, the MDF and MoESY agreed, in consultation with the Bank team, to reduce the scope of rehabilitation work to 23 schools, prioritizing schools with urgent and greater needs. Discussion is ongoing with other development partners to take over the excluded 25 schools. So far, the MDF has completed the contract signing for 13 schools and will complete the contract signing for 6 schools shortly. The MDF is finalizing the draft detailed designs for 4 schools in Tbilisi, which are of significant importance for MoESY and have more complex technical requirements. The schools in Tbilisi are scheduled for completion tentatively by September 2026, stretching beyond the current Page 3 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) project completion date. The delays in completing the detailed design pose uncertainty about the timeline for completion of the work for the Tbilisi schools. 12. Agreed Actions: The MDF will (a) sign the civil works contract for 6 schools by May 31, 2024; and (b) share detailed design documents for the 4 schools in Tbilisi with the Bank by May 31, 2024. 13. School Infrastructure – New Construction: The project aims to construct 14 model schools, including nine new model primary schools with preschool (under Component 1) and five full- fledged general education schools (under Component 2), based on the new school infrastructure standard. The MDF completed the Employer’s Requirements (TOR) for the ‘Design and Build’ modality, cleared by the Bank team. Contracts have been signed for 6 schools by April 2024. Bid evaluation is ongoing for the remaining 8 schools. Due to the fraudulent case2, 5 packages needed to be retendered. The MDF, in consultation with the Bank team, reorganized the work package lots and adjusted bidding requirements to expedite the retendering process. As a result, all tenders successfully attracted multiple bidders and will be signed shortly. Nevertheless, the expected civil work completion date for 5 schools is September 2026, stretching beyond the current closing date of the project. 14. Agreed Actions: The PMT will sign the civil works contracts for the remaining schools by May 31, 2024. 15. Quality Enhancement Activities in General Education: Key progress includes (a) 88 teachers trained on whole school improvement (WSI) and continuous formative assessment (CFA); (b) Science, Technology, Engineering, Art, and Mathematics (STEAM) extracurricular program implemented at the first batch of 80 pilot schools with 165 trained teachers, including STEAM lab spaces in two hub schools were set up and are operational; (c) the school authorization activities fully completed with user’s guide submitted to MoESY; (d) e-resource effectiveness survey completed; (e) revised principal recruitment policy with recommendations developed; (f) moodle platform introduced at pilot schools; (g) STEAM baseline assessment completed; and (h) LabXchange program introduced to STEAM teachers. 16. A critical challenge for this activity are the pending decision by the MoESY about the national assessments for Grades 9 and 12. The team discussed the issues with the Pre-school and General Education Development Department of MoESY and the National Assessment and Examination Center (NAEC) and was informed that the decision related to the national assessment is expected by July 2024. It is critical that the MoESY makes the decision by then in order for the project to complete the national student assessment related activities by the project closure. 17. Key Agreed Actions: The PMU will (a) receive a confirmation from the MoESY on the national assessment-related activities to be considered under the project by July 31, 2024; (b) conduct follow- on capacity building and monitoring for the WSI and CFA stage 1 pilot by September 30, 2024; (d) procure STEAM equipment for the remaining 120 pilot schools and initiate STEAM pilot by October 31, 2024; and (e) update the action plan and budget for the national assessment activities following the decisions of the MoESY. 2The fraud was committed by a bidder and caught by MDF. The fraudulent case was duly escalated to INT, which completed the review and closed the case on February 16, 2024, without pursuing further investigative activities. Page 4 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) Component 3 - Strengthening Financing Options and Promoting Internationalization in Higher Education 18. This component aims to improve the quality and competitiveness of higher education in Georgia through the introduction of the new performance-based funding (PBF) formula, the establishment of a competitive innovation fund (CIF), revamping the core funding model (a new activity upon request from the ministry), merit-based scholarship, and the promotion of the internationalization of higher education. The progress of this component is satisfactory. 19. Key progress in this component includes (a) 46 proposals submitted under the 2nd round of CIF and evaluation of proposals finalized; (b) the structural design of the software platform for PBF and merit-based scholarship modules completed and software development initiated; (c) basic approaches and sample of universities determined for the core funding revision; (d) new English language and entrepreneurship modules prepared; (e) draft of the new joint PhD program in the field of education and science management elaborated; f) the first International Excellence School (IES1), titled "Competitive Projects: Application and Management" conducted, and the second International Excellence School (IES2) initiated; and (g) the 2nd round of CIF awarded. 20. Key Agreed Actions: The project will (a) deploy the pilot system – release of the merit-based scholarship module, including university portal and MoESY portal, by August 31, 2024; (b) conduct academic program costing analysis by July 31, 2024; (c) implement the IES2 by July 31, 2024; (d) develop the new core funding model by September 30, 2024; and (e) deploy the pilot system – release of the PBF module by December 31, 2024. Component 4 - System Strengthening and Stakeholder Communication 21. This component aims to improve the capacity of the education system to collect and utilize data for monitoring and decision-making purposes and supports the MoES in developing effective communication strategies for education reforms. The progress of this component is moderately satisfactory due to the delays in EMIS activities. 22. Supporting Data-Driven Decision Making: Key progress for this sub-component includes (a) the contract negotiation for the consultancy for the Learning Management System (LMS) ongoing; and (b) the first-stage of IT procurement for e-School system upgrading completed. 23. Key Agreed Actions: The project will (a) sign a contract with a firm for LMS by May 31, 2024; (b) sign a contract for the e-School system upgrading by July 31, 2024; and (c) agree with the MoESY on the recurrent cost for LMS by May 31, 2024. 24. Communication and Stakeholder Consultations for Education Reform: The project continued with various consultation and communication events with stakeholders of the project-supported reforms, including (i) TV coverages of ECEC events in November, 2023; (ii) TV show on I2Q (December 2023); (iii) radio show and TV show on higher education (January 2024); (iv) TV and radio shows on STEAM (February 2024); (v) TV show on ECEC quality assurance training (February 2024); (vi) TV show on higher education legislation (March 2024); and (vii) TV shows on professional development of kindergarten (March 2024). Component 5 - Supporting Project Management, Monitoring, and Evaluations Page 5 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) 25. Project Management: PMU and PMT are performing satisfactorily with solid and steady leadership and close coordination between each other. The PMU maintains frequent and timely communication and collaboration with relevant agencies and departments of the MoESY. All the relevant agencies and departments expressed satisfaction and appreciation about the close collaboration with and flexibility of the project to meet the needs of the MoESY. 26. Monitoring and Evaluation (M&E): The project shares semi-annual monitoring reports timely with the Bank team and relevant stakeholders. The Results Framework is kept up-to-date. The project has completed the first round of the Performance Evaluation Study with a representative sample to provide qualitative information about the relevance, effectiveness, and impacts of the project activities. The 2nd round will be completed by Jan 31, 2026. The project has prepared draft revised results indicators and targets for the upcoming restructuring to reflect the continuous evolution of the project design. C. Fiduciary: 27. Procurement: Both the PMU and the MDF are staffed with qualified and experienced procurement specialists, and STEP is kept updated. Procurement Performance Rating remains Satisfactory, with Project Procurement Risk remaining as Substantial as per April 2024 Procurement Risk Assessment and Management System (PRAMS). 28. Works contracts for 37 schools, include construction of 14 new schools, and rehabilitation / reconstruction of 23 existing schools. 29. Construction of 14 new schools. Works contracts for 4 new schools have already been signed. Evaluation of biddings for 3 schools have been finalized, Notifications of Intention to Award the Contract have been sent out, and once the Standstill Period is over in each bidding, the Works contracts will be signed. Evaluation of the biddings for the remaining 7 schools is ongoing and planned to be finalized in May 2024. 30. Rehabilitation of 23 existing schools. Works contracts for the rehabilitation of 13 schools have already been signed. Biddings for 6 schools are at the evaluation stage. The Detailed Design preparation for the remaining 4 schools in Tbilisi is still ongoing (at “Stage 2� deliverable as per MDF), and biddings are planned to be announced in May / June 2024 as per MDF. If the Consultant fails to provide the final detailed design package (which is “Stage 3� deliverable as per MDF), in that case MDF will tender out the schools with Design Build approach (if this will be the final arrangement, MDF will consult with the Bank prior to tendering out). For the 2 schools in Tbilisi, that have cultural heritage status, revision and approval of scope of works (Employer’s Requirements) will be needed from the Cultural Heritage Department of Tbilisi City Hall. This external dependency may delay the bid announcements and, therefore, Works implementation of those 2 schools in Tbilisi. 31. As regards to the PMU, the prior review contract for procurement of GE-MESCS-334602-NC-RFP “Upgrade of the eSchool General Education and Early Childhood Education software system and the Enterprise Architecture, Data and Domain Models for the EMIS education systems “, with 2 stage procurement approach, is progressing and the PMU will start evaluation of the second stage Page 6 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) proposals after the submission deadline of 2nd Stage Technical and Financial Proposals on April 10, 2024. 32. Post Review Report is being finalized by the Bank and will be shared with MDF and PMU in due course. 33. With the majority of contracts already awarded and the remaining contracts planned to be awarded by June – September 2024, the major risk remains successful contract implementation. MDF and PMU both manage multiple contracts and despite having qualified staff, they still face delays in procurement processes. The risks of procurement & implementation delays can be further manageable through continued close monitoring of activities, including by: a) having good preparation by collecting required data, b) having KPIs for contract management, c) active and close supervision of activities by the Borrower, as well as by the Bank team as part of implementation support, d) continuation of involvement of experienced technical supervision consultant(s) in the review of the design and implementation activities, and e) through continued capacity building, especially for Contract Management. 34. The procurement staff of both PMU and MDF will attend the South Caucasus Regional Procurement Training (including on rated criteria and contract management) in April 2024, in Tbilisi. 35. Financial Management: The project submits interim an-audited financial statements on time, which are found to be acceptable. Audited Project Financial Statements for the year ended Dec 31, 2022, were submitted on time, and found to be acceptable. The auditor has issued unmodified audit opinion and no control deficiencies nor accounting errors communicated in the management letter. No potential FM relates issues nor risks came to our attention that may hinder the project from implementation. Full FM supervision of the project was completed in February 2024, and the next one is planned in November-December 2024. D. Safeguards: 36. Environmental and Social Performance: The project triggers the World Bank’s OP 4.01 Environmental Assessment and OP 4.12 Involuntary Resettlement and is classified as an environmental category B. Project compliance with the safeguard policies is satisfactory. 37. Physical works supported by the project are being procured and administered by the MDF, which has dedicated Environmental and Social staff to oversee safeguards compliance during the provision of works. By the time of the mission, MDF has developed detailed designs and Environment & Social Management Plans (ESMPs) for the rehabilitation of 19 schools. Contracts for the provision of civil works at 13 schools are signed and procurement of works for 6 more schools is ongoing. Along with other relevant details, ESMPs carry important information about (i) screening for structural integrity performed during the selection of school buildings for the project support and more in-depth engineering assessment prior to design approval, (ii) students with special needs and the elements of universal access incorporated into the school designs, and (iii) arrangements required for uninterrupted teaching process at schools where rehabilitation works are likely to overlap with the school year. MDF has due arrangements in place to undertake technical supervision of works, including environmental and social monitoring. Consultant company EPTISA is recruited by MDF to perform these tasks. The environmental performance of contractors delivering school Page 7 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) rehabilitation works is satisfactory. The Bank’s Task Team applied due diligence to revealing any recorded or, possibly, unrecorded occupational health and safety accidents that may have occurred between the previous and present implementation support missions and found none. 38. Construction of 14 new school buildings is commencing this spring, and MDF plans to conclude design-build contracts for these works. Hired companies will be responsible for developing ESMPs in parallel with detailed designs. MDF carried out upfront environmental and social screening at the sites selected for new construction and shared reports with the Bank. No showstoppers are identified at any of the sites from environmental and social standpoints. MDF carries overall responsibility for the quality of ESMPs, their timely disclosure, and stakeholder consultation. 39. Resettlement Policy Framework has been prepared for the project, but compulsory land acquisition is not expected. MDF conducts thorough screening to reveal potential resettlement cases. All ESMPs submitted to the Bank note that there is no impact on informal or formal businesses as a result of school rehabilitation. In case of disruption of the study process, transportation arrangements are in place to assist school children in reaching alternative schools, managed by the MoESY and the local governments. No challenges have been detected in terms of transportation of students thus far. Planning of the works is being conducted in an inclusive manner, with parents and teachers involved in the process. Several suggestions from the parents, such as arranging a water sink in a resource room for children with special educational needs, were accepted and incorporated in the design. For each school rehabilitation, there is active stakeholder engagement with the school staff, parents/students, and the neighboring community. For example, in Khashuri municipality, the families living next to the school territory requested to arrange a high, closed fence instead of the originally planned lower transparent fence to better separate their property from the school. This has resulted in changes in the design to accommodate the requests of the local community. 40. Grievance Redress: The project has a grievance redress system with accessible contacts listed on the website. All construction sites have banners with details about the grievance mechanism. The grievance log has 7 registered requests, including from students and communities in ethnic minority areas. The requests are mostly about the components of the project design or simply express gratitude. All of the requests are considered closed. E. Others: 41. Project Restructuring: The MTR in March 2023 identified the need for a project restructuring to revise results indicators to align with the project's actual situation, update the component description to reflect the evolution of project design, and extend the project closing date to allow for the completion of key activities. The extent of the closing date extension will be determined based on the progress of the key pending issues. 42. Development Partner (DP) Coordination: The mission held an education DP coordination meeting (for the 4th time) at the World Bank office on April 10, 2024, inviting representatives from DPs active in ECE, general education, and technical education. The meeting was attended by representatives from the United States Agency for International Development (USAID), Japan International Cooperation Agency (JICA), European Union (EU), and the World Bank. Each DP shared the latest updates and the next plan for their respective engagement in the sector. The mission also held a separate bilateral meeting with the representatives of the Asian Development Bank. Page 8 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) IV. NEXT STEPS AND AGREED ACTIONS 43. The summary of key agreed actions for the next six months is as follows: № Key Actions Responsible Due Date Component 1 – Improving Quality of and Access to Early Childhood Education and Care 1. Conduct professional development system piloting for kindergarten PMU June 30, 2024 educational and administrative personnel in 5 out of 6 target municipalities 2 Pilot data reporting tools and merit-based remuneration scheme in 6 PMU August 31, 2024 municipalities 3 Introduce revised SRP in classes at 150 schools PMU September 30, 2024 Component 2 – Fostering Quality Teaching and Learning in General Education 4 Sign contracts for all the remaining school construction and MDF May 31, 2024 rehabilitation works, except for 4 schools in Tbilisi 5 Share the detailed design and ESMP for 4 schools in Tbilisi MDF June 31, 2024 6 Receive a confirmation from the MoESY on the national assessment PMU July 31, 2024 for basic and upper secondary level 7 Procure STEAM equipment for the remaining 120 pilot schools and PMU October 31, 2024 initiate STEAM pilot Component 3 – Strengthening Financing Options and Promoting Internationalization in Higher Education 8 Release of the merit-based scholarship module, including university PMU August 31, 2024 portal and MoESY portal 9 Conduct academic program costing analysis PMU July 31, 2024 10 Conduct the second International Excellence School (IES 2) PMU July 31, 2024 Component 4 – System Strengthening and Stakeholder Communication 11 Sign the contract with a firm for LMS development PMU May 31, 2024 12 Sign the contract with a firm for eSchool development PMU July 31, 2024 Component 5 - Supporting Project Management, Monitoring, and Evaluations 44. The status of the key agreed actions from the previous mission in October 2023 are as follows: № Key Actions Responsible Due Date Component 1 – Improving Quality of and Access to Early Childhood Education and Care 1. Organize the first annual conference on ECE quality and management PMU Completed 2 Develop the draft salary projection tool for six target municipalities PMU Completed 3 Revise 2-5 year-old ECE curriculum and SRP curriculum PMU Completed 4 Provide a cycle of training of trainers for QA experts PMU Completed 5 Complete the rehabilitation work for SRP for the remaining schools PMU Completed, except 20 schools Component 2 – Fostering Quality Teaching and Learning in General Education 5 Share updated cost-estimation for all the civil works of the project MDF Completed Page 9 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) 6 Complete the tender/re-tender announcement for all the remaining MDF Completed construction work 7 Share the detailed design documents and ESMPs for school renovation MDF Completed, except 4 for the Bank’s no objection for all the remaining schools, except Tbilisi schools unfeasible ones 8 Sign contracts for the first batch of new construction MDF Completed 9 Obtain MES and MOF decision on the infrastructure works financial gap MDF Completed Component 3 – Strengthening Financing Options and Promoting Internationalization in Higher Education 10 Take a procurement action for hiring expertise for the core funding PMU Completed reform 11 Complete the selection and award of the 2nd call of CIF PMU Completed Component 4 – System Strengthening and Stakeholder Communication 12 Sign the contract with a firm for LMS development PMU To be completed by May 31, 2024 13 Initiate the e-School system upgrading work PMU Ongoing Component 5 - Supporting Project Management, Monitoring, and Evaluations 14 Send a restructuring request letter to the World Bank PMU/MoES To be decided. 45. Next Steps: The next implementation support mission is tentatively in October 2024. The Bank team and PMU and MDF will continue to hold monthly check-in meetings via virtual tools. Annexes: Annex 1: List of officials met and composition of WB team Annex 2: Status of 5 largest procurement packages Annex 3: Results Framework Page 10 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) Annex 1: List of officials met and composition of WB team 1. The Bank’s Task Team consisted of Shiro Nakata (Task Team Leader, Senior Economist), Anna Berdzenadze (Education Specialist), Ahmet Levent Yener (Program Leader for Human Development), Nikolozi Chantladze (Procurement Specialist), Sepehr Fotovat (Senior Procurement Specialist), Tural Jamalov (Senior Financial Management Specialist), Darejan Kapanadze (Senior Environmental Specialist), and David Jijelava (Social Development Specialist). Lela Ghongadze (Program Assistant) provided support to the mission. 2. The officials met during this mission include the following: No. Name Organization 1. Nodar Papukashvili Deputy Minister of Ministry of Education,Science, and Youth 2. Lali Kalandadze Head of Preschool and General Education Development Department, MoESY 3. Nino Tsereteli Director, NAEC 4. Dimitri Kordzaia Professor, Tbilisi State University (TSU) Institute of Morphology; \Manager of the Project (“Development and Implementation of a Modern Translational Neuroscience Program in Georgian Universities for the Improvement of Higher Medical Education�) financed under the first call of the CIF 5. Lika Svanadze – Manager of Internationalization direction at the TSU Medical Faculty 6. Irine Mchedlidze Principal, Tbilisi Public School No. 126 7. Tamar Sanikidze Executive Director, PMU 8. Elene Nikolaishvili Project Manager, PMU 9. Tamar Tchkonia Early Childhood Education Component Lead, PMU 10. Khatia Tsiramua General Education Component Lead, PMU 11. Nino Begiashvili Higher Education Component Lead, PMU 12. Maka Makhatadze ICT/Data Integration Manager, PMU 13. Maka Beraia Capacity Development, Outreach and Communications Specialist, PMU 14. Vakhtang Babutsidze Project Coordinator for Infrastructure Projects – Engineer, PMU 15. Zurab Simonia Monitoring and Evaluation Specialist, PMU 16. Aleksandre Melkadze Financial Management Specialist, PMU 17. Nana Gogia Disbursement Specialist/Accountant, PMU 18. Ia Iashvili Procurement Specialist, PMU 19. Iana Samkharadze Procurement Specialist, PMU 20. Marine Zhvania Administrative Manager, PMU 21. Ana Gomelauri Head of Competitive Innovation Fund (CIF) Administrative Unit, PMU 22. Nazi Parsadanishvili Education Specialist of CIF Administration Unit, PMU 23. Giorgi Ivanidze Legal Specialist of CIF Administration Unit, PMU 24. Giorgi Mikeladze Program Manager, MDF 25. Eka Ezugbaia Procurement Specialist, MDF 26. Mariam Gvazava Project Manager, MDF Page 11 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) 27. Zviad Tchurtchelauri Engineer, MDF 28. Merab Svanidze Engineer, MDF 29. Revaz Gigilashvili Project Manager, MDF 30. Salome Meparishvili Safeguard Specialist, MDF 31. Mariam Abuladze Procurement Specialist, MDF 32. Nino Udzilauri Education Team Leader, USAID 33. Marina Kutateladze Project Management Specialist, USAID 34. Nino Kochashvili Programme Manager, EU 35. Nino Edilashvili Associate Education Specialist, ADB 36. Mamatkalil Razaev Social Sector Specialist, ADB 37. Masahiro Kato Adviser, JICA 38. Sophie Bzishvili Public Affair Officer, US Embassy Page 12 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) Annex 2: Status of 5 largest procurement packages High-Value Contracts Total Value Status GE-MESCS-192159-GO-RFB / Procurement USD 3.6 million Completed of Technology Equipment for Schools (Laptops and Projectors) GE-MESCS-212213-CS-QCBS / Improving USD 4.2 million Awarded ECE Institution Management System and Enhancing the Quality of Programs Across the Country, Increasing Equitable Access to Preschool Education for Successful Transition to School GE-MESCS-212276-CS-QCBS / Fostering USD 2.9 million Awarded Quality Teaching and Learning in General Education through Introduction of Effective Quality Management System, Whole School Improvement Plan and Programs, Improved Assessment Policy, Practice and Methodology GE-MESCS-212344-CS-QCBS / USD 1.9 million Dropped and changed to GE- Strengthening the quality of pre-service MESCS-342896-CS-QCBS teacher education programs and continuous professional development options, supporting capacity-building of teachers and school professionals to develop and implement school-based curriculum IBRD/I2Q/CS/QCBS/07-2021 / Supervision of USD 2.4 million Awarded Civil Works under the Georgia Innovation, Inclusion and Quality Project GE-MESCS-342896-CS-QCBS Consulting USD 1.3 million Dropped Services for Strengthening the Quality of Pre- service Teacher Education Page 13 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) Annex 3: Results Framework Indicator Name Baseline End Target Previous (Sept Current Note 2023) (April 2024) PDO Indicators Objective 1: Expand access to preschool education 1 5 to 6 year old children enrolled 80 92 87.4 86 On Track. in School Readiness Programs Based on the data received by the (Pre-school level) (Percentage) Ministry in December 2023. - Female children enrolled 80 92 51 (Percentage) Objective 2: Improve the quality of education and learning environments 2 Beneficiary students with access 0 116,000 269,652 269,652 Overachieved to improved learning Data were collected from the pool of 554 environments in project- duplicates free intervention schools for supported schools (Number) the 2023-24 school year. The pool was created from the schools as follows: (i) 121 wifi equipped schools, (ii) 433 schools supplied with computers, (iii) 48 rehab schools, and (iv) 140 schools selected for ToT trainings. In addition, 2250 students shall benefit from the SRP in 150 schools, as well as 2310 students from the newly constructed 14 schools. - Female beneficiary students 0 58,065 131,193 131,193 Overachieved (Number) 3 Learning outcomes of students Baseline Endline to be Learning Learning On Track in national formative TBD measured outcome outcome This indicator is to be revised in the assessments in project-supported assessment assessment restructuring to be aligned with the general education schools conducted in July conducted in July project activities. There is no national 2022 2022 formative assessments as formative Page 14 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) assessments are classroom based. New wording of the indicator agreed at the Mid-Term Implementation Support Mission and was reflected in the respective AM. - Learning outcomes of Female Baseline Endline to be children TBD measured Intermediate Results Indicators by Components Component 1: Improving quality of and access to early childhood education and care 1 New architectural blueprints 0 2 Requirements for On Track developed and 2 to 10 new ECE developed Civil work ongoing for 1 schools, and model buildings accommodating contracts to be singed by May 2024 for preschools constructed the 8 remaining schools. 2 New School Readiness Programs 0 150 0 On Track introduced and provided with 130 SRPs rehabilitated. Rehabilitation of equipment, furniture and remaining schools expected by end May, technology 2024. 3 Diagnostic study completed and No Diagnostic study Diagnostic study complete and Completed recommendations made for diagnostic completed and complete and recommendations development and expansion of study recommendations recommendations made quality ECEC completed in Yr 1 made made and Yr 4 4 System for preschool data No Systematic data Systematic data Systematic data On Track reporting and consolidation systematic reporting and reporting and reporting and This activity falls under the scope of the mechanism established and reporting and consolidation consolidation consolidation multi-component contract signed with incorporated in the EMIS consolidation mechanism mechanism mechanism San Diego State University Research mechanisms established and designed designed Foundation, covering ECE data reporting exist streamlined in system establishment. EMIS 5 Child-level ECEC quality No quality Quality Quality Draft child-level On Track monitoring instrument to monitoring monitoring monitoring tools ECE quality This activity falls under the scope of the strengthen support for school instrument in instrument being developed monitoring multi-component contract signed with readiness and smooth transition place developed, tested instruments San Diego State University Research Page 15 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) to school introduced (based on and developed Foundation, covering establishment of the MODEL/MELQO or other introduced child-level ECE quality monitoring appropriate instrument) instrument Component 2: Fostering quality teaching and learning in general education 6 School architectural standards Standards Standards Standards Completed reviewed and updated to be used not updated updated updated in the construction and rehabilitation of schools 7 Number of rehabilitated general 0 60 0 0 In Progress education schools Civil work ongoing at 13 schools 8 0 5 0 0 In Progress Number of new general Civil work ongoing for 3 schools, and education schools constructed contracts to be singed by May 2024 for the remaining 2 schools. 9 New teacher training modules Does not New modules CFA practices This indicator is no longer relevant and and manuals developed on exist developed analyzed needs to be replaced with the new modern child centred pedagogy indicator related to the development of and formative continuous the HE core funding model. assessment 10 Collaborative e-platform Currently Collaborative e- Firm hiring Firm hiring In Progress identified and strengthened to does not platform underway for underway for support audiovisuals, web links, exist identified, LMS LMS lesson plans documents for strengthened and development development teachers and education used professionals 11 0 200 0 80 In Progress In November 2023 pilot of Establishment of Thematic STEAM extracurricular programs was Innovation Clubs in every successfully initiated in 80 pilot schools. region/municipality targeting 165 teachers were trained and 80 schools gifted and other student interests equipped with the STEAM extracurricular and a system to ensure its program resources. The pilot will continue sustainability (Number of through 2023-2024 academic year. In fall innovation and STEAM 2024, the pilot will be expanded to Extracurricular programs) remaining 120 pilot schools. Note: As per Aide Memoire dated March Page 16 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) 27 -31, 2023 the indicator name shall be modified and changed to “Number of general education schools which developed and introduced STEAM Extracurricular Programs (Number)�. 12 Percentage of girls participating 0 50 0 in the Thematic Innovation clubs 13 0 200 433 554 Completed As part of the whole school improvement package, in order to support the distance learning process, 433 schools were equipped with the necessary computer equipment (laptops, projectors). Also, 121 out of those schools are being supported in terms of supply and installation of Wi-Fi networks. Number of beneficiary schools will Select schools resourced with a increase after equipping 200 schools school improvement package to with equipment necessary for STEAM strengthen the implementation of the whole school approach extracurricular programs. 80 schools (out of 200) are equipped with STEAM extracurricular program resource. Total number of schools to be resourced with a school improvement package to strengthen the implementation of the whole school approach as of reporting period constituted 742. Once duplicate entries were remove the number of selected schools remained is 554. 14 National formative assessment No formative Formative Formative Piloting of the In Progress system introduced and national assessment assessment proposed tools Within the contract, the analysis of the Page 17 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) established for primary and assessments system practice analyzed ongoing existing formative assessment secondary grades (tools and conducted established methodology and mechanisms was mechanisms revised) prepared. Actual mechanisms were reviewed and additional well tested tools proposed to MES for further introduction and pilot in project schools. With the consent of MES, the piloting of the proposed tools at this moment has been initiated in 12 pilot schools and is ongoing until the end of 2023-2024 academic year (with the plan to upscale to 50 schools). 15 Feasibility study conducted with Not Feasibility study NIER Completed recommendations for the undertaken completed and Established The national institute of educational establishment of National recommendations research was established in Feb 2023. Institute of Educational Research made completed 16 Trainers and coaches of 0 1,600 568 677 In Progress education workforce staff that Provided number is based on IPTT receive training (ToT) reflecting progress up to January 2024. 17 Survey of change in female Baseline to Endline to be Baseline study Endline data collection and analysis attitudes towards STEAM be measured completed in Feb (Completion Report) due on January 30, conducted amongst girls determined 2023 2026. participating in the Thematic and set in Innovation clubs 2020. Component 3: Strengthening financing options and and promoting internationalization in Higher Education 18 Higher education grants Not present Upto 45 grants 13 proposal Evaluation of In Progress established under Competitive awarded to foster selected under poposals Innovation Fund and awarded modernization of the 1st call; the received under teacher call for proposal 2nd call finalized. education announced for programs and the 2nd round strengthen labor market linkages 19 Pre-service teacher education Not Accreditation Cancelled Activity Dropped Page 18 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) program accredited in at least undertaken received in one one university university program Component 4: System strengthening and stakeholder communication 20 Development of a data A data A data EMIS Completed integration strategy and action integration integration diagnostics and plan from PreK to HE strategy strategy and action plan action plan action plan completed does not developed exist 21 Development of a data No A data Tender is Tender is monitoring dashboard with monitoring monitoring ongoing ongoing quality monitoring indicators dashboard dashboard based on whole school approach exists developed and operationalized 22 GIS education mapping system Under initial Fully developed GIS has been Completed. established and integrated development and established purchased and educational tracking system in run by EMIS place 23 Multiyear communications Does not Developed and Developed and Completed strategy drafted and adopted exist adopted adopted by based on general education MoES policy principles 24 Representative groups who 0 70 Performance In Progress report that the national evaluation study Endline data collection and analysis consultation (and feedback) completed as a (Completion Report) due on January 30, process on Georgia's Education baseline 2026. policy principles was responsive to their views through an appropriate CE mechanism (Targeted responsiveness rate set at 30%) 25 Parents that report satisfaction 0 30 Performance In Progress with their engagement in the evaluation study Endline data collection and analysis whole school improvement completed as a (Completion Report) due on January 30, Page 19 The World Bank Georgia Innovation, Inclusion and Quality Project (P168481) effort and demonstrate baseline 2026. understanding of student- centered learning through beneficiary surveys in Year 1, 4 and 6 (Targeted satisfaction rate set at 30%) Page 20