The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Vietnam Enhancing Teacher Education Program (P150060) EAST ASIA AND PACIFIC | Vietnam | Education Global Practice | Requesting Unit: EACVF | Responsible Unit: HEAED IBRD/IDA | Program-for-Results Financing | FY 2016 | Team Leader(s): Dung Kieu Vo Seq No: 8 | ARCHIVED on 30-Jul-2020 | ISR42533 | Created by: Hanh Minh Bui on 21-Jun-2020 | Modified by: Huyen Thi Thanh Le on 23-Jul-2020 Program Development Objectives Program Development Objective (from Program Appraisal Document) The project development objective is to strengthen teacher training institutions to enhance teacher and principal effectiveness through improved continuous professional development. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Unsatisfactory Implementation Status and Key Decisions The Implementation Support Mission recognized the efforts dedicated by the Ministry of Education and Training (MOET) and its Program Management Unit (PMU) in enforcing the critical decisions made at the Mid-term Review in November 2019. As a result, enhanced institutional arrangement and implementation capacity has contributed to positive implementation progress of the Program in the past six months. Specifically, disbursement has doubled, the Lead Teacher Training Universities (LTTUs) have achieved the target scores in the Teacher Education Institution Development Index (TEIDI), the first training of the core teachers and principal advisors across the country in 2019 was rated as satisfactory and highly satisfactory by 98% of learners, a set of policies and implementation guidelines for Continuous Professional Development (CPD) for teachers and principals was issued embracing school-based, peer coaching and support and stakeholder coordination introduced by the Program; and arrangement for the Learning Management System (LMS) and CPD support is being put in place for the national roll-out of CPD program for teachers and principals. Challenges, however, have been emerging in the coordination of CPD implementation between sub-national and national authorities which require continued leadership and timely guidance by Minister of Education to ensure all teachers and principals have equitable access to the training and CPD support targeted for 2020 and the years to come. In addition, technical assistance by international consultants should also be mobilized without delays to ensure capacity building for the LTTUs can be timely conducted and TEIDI target scores can be achieved as committed. Given the limited achieved results albeit positive implementation momentum, apart from a set of time-bound actions, a restructuring proposal with partial cancellation of US$19 million was agreed with the Minister to reduce the scope of the Program, focusing on realistic activities that could be effectively implemented before the closing date of June 30, 2022. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P150060 IDA-58780 Effective USD 95.00 95.00 0.00 20.17 73.83 21% Key Dates (by loan) 7/30/2020 Page 1 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P150060 IDA-58780 Effective 29-Jun-2016 06-Feb-2017 05-Jun-2017 30-Jun-2022 30-Jun-2022 DLI Disbursement Achievement Disbursed amount in Disbursement % for DLI ID DLI Type Description Coc DLI Amount Status Coc DLI Loan: IDA58780-001 DLI2 Regular SYSTEMS ARE IN PLACE XDR 12,860,000.00 Not Achieved 0.00 NO OF CORE TEACHERS DLI3 Regular XDR 15,670,000.00 Not Achieved 0.00 SELECTED N TRAINED NO OF CORE TEACHERS DLI4 Regular XDR 10,010,000.00 Not Achieved 0.00 PROVDING SBCPD NO OF TEACHERS DLI5 Regular XDR 10,000,000.00 Not Achieved 0.00 SATISFIED WITH ITC INSTITUTIONAL DLI1 Regular XDR 19,260,000.00 Not Achieved 0.00 CAPACITY OF LTTU Program Action Plan The Recipient shall develop and execute a Capacity Building Plan for the LTTUs to ensure sustainable provision of Action Description teacher school based continuous professional development support, all in form and substance satisfactory to the Association. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Completion Measurement A Capacity Building Plan developed, costed and executed (in cooperation with LTTUs) The action was not met: ETEP has dedicated all efforts to address implementation bottlenecks and therefore yet to Comments mobilize resources for this action. By September 30, 2020, the contract for the consultant(s) to carry out the study would be awarded. The Recipient shall carry out a study – under the terms of reference acceptable to the Association - to identify options Action Description and recommendations for financing teacher- continuous professional development. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2020 Delayed Completion Measurement Study validated by MOET ETEP has dedicated all its efforts over the past years to address implementation bottlenecks and therefore yet to Comments have mobilized resources for this action. A consultant contract was agreed to be awarded by September 30 to carry out the study. 7/30/2020 Page 2 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) The Recipient shall disclose information on the Program’s activities to the public, including financial information Action Description throughout the implementation of the Program. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous In Progress Completion Measurement Evidence of information disclosure Information on the Program’s activities, including financial information, is disclosed to the public via the ETEP website Comments and LTTUs' ETEP websites and updated frequently. Information has also been disclosed via consultation meetings with stakeholders The Recipient shall maintain a system of receiving, recording and following-up on complaints, including anonymous Action Description ones. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly In Progress Completion Measurement Log of complaints and reports No complaints have been received so far. Besides channels established by ETEP PMU and LTTUs, MOET also Comments deploys a software to house complaints and denunciations, including those relating to ETEP. The Recipient shall maintain a database on complaints and denunciations from all the participating agencies and Action Description follows up on the resolution of those complaints and denunciations. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly In Progress Completion Measurement Database verified MOET is in charge of maintaining the database. PMU receives every six months LTTUs' reports on complaints and Comments denunciations received and consolidates and reports such complaints and denunciations to the Bank/ MOET. The Recipient shall (a) review LTTUs internal audit capacity; and (b) prepare and execute – or cause to be executed - Action Description plans to build the capacity of internal audit function in LTTUs. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 05-Jun-2019 Delayed Internal audit capacity assessed and LTTUs capacity building plans developed, costed, approved and executed (in Completion Measurement cooperation with LTTUs). An internal audit firm was contracted in May 2019 to review the LTTUs' internal audit capacity. The review was Comments completed in September 2019. Capacity building plans shall be developed, cost, approved, and executed by September 30, 2020. 7/30/2020 Page 3 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Action Description The Recipient shall issue guidance on the performance based budgeting/allocation Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous Completed Completion Measurement Guidance on the performance based budgeting/ allocation was issued by MOET. Comments The action was completed. Guidance was issued in POM and Performance Agreement. All proposals for detailed designs, construction supervision and bids for civil works, whether below or above cost Action Description estimates, shall be evaluated; proposals and bids shall not be rejected only on the basis of minor, non-substantive deviations. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion Measurement n/a Comments Compliant as noted in June 2020 Implementation Support Mission. The Recipient shall design and adopt a mechanism – satisfactory to the Association - to coordinate teacher Action Description continuous professional development initiatives and activities among teacher education providers and concerned teacher management department Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Issuance of a circular on teacher continuous professional development which includes the regulated coordination Completion Measurement mechanism. Comments Circular 19/2019/TT-BGDDT was issued on November 12, 2019. At least 60 percent of contracts for consultancies and 85 percent of contracts for works shall be competitively bid Action Description annually. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion Measurement n/a Compliant, as noted in the June 2020 Implementation Support Mission. 70% of consultant contracts and 87% of Comments goods and non-consulting services contracts have been competitively bid. No contract having cost estimate above the thresholds for using DC/SSS method set forth in the national public Action Description procurement law and regulation will be awarded on DC/SSS basis. Source DLI# Responsibility Timing Timing Value Status 7/30/2020 Page 4 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Fiduciary Systems Client Recurrent Continuous In Progress Completion Measurement n/a Comments Compliant, as noted in June 2020 Implementation Support Mission. Action Description Firms on the local, national, or Bank debarment list shall not be allowed to participate. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion Measurement n/a Comments Compliant, as noted in the June 2020 Implementation Support Mission. The Recipient shall develop a guideline to facilitate meaningful consultation and inform participation of beneficiary Action Description principals and teachers, including those from ethnic minorities and vulnerable groups. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 Completed Systems Completion Measurement Formal issuance of the guideline Comments The guideline was formally issued in November 2018. The above referenced guideline, which will be implemented by LTTUs should fully operationalize the existing Action Description Vietnamese legislation with respect to ethnic minorities through a process of free, prior, and informed consultations. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 In Progress Systems Completion Measurement n/a Comments No significant issue was noted in the reporting period. Action Description The Recipient will prepare an Operational Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2017 Completed Completion Measurement OM agreed by the Bank Comments This action was completed. 7/30/2020 Page 5 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Action Description The Recipient will execute the Operation according to the Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous In Progress Completion Measurement Implementation Support Missions will review implementation quality Comments Program is being implemented according to the Operation Manual. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Low Low Macroeconomic -- Low Low Sector Strategies and Policies -- Low Low Technical Design of Project or Program -- Substantial Substantial Institutional Capacity for Implementation and -- Substantial Moderate Sustainability Fiduciary -- Substantial Moderate Environment and Social -- Low Low Stakeholders -- Moderate Low Other -- Moderate Moderate Overall -- Substantial Moderate RiskComments Comments Comments The overall risk rating of the program is reduced to Moderate, mainly because: 1. Institutional capacity for Implementation and Sustainability risk is reduced from Substantial to Moderate given the enhanced institutional arrangement and PMU capacity. Specifically, (i) PMU capacity has been improved in several areas including program strategic management, coordination of continuous professional development (CPD) support for teachers, M&E and fiduciary; (ii) Ministry functional departments have been actively participating in the planning, development, and delivery of CPD for teachers and issuance of CPD policies and implementation guidelines; and; (iii) LTTUs have been delegated with more autonomy and authority to implement activities agreed in the Performance Agreements. In the area of CPD for teachers, LTTUs have taken on their leading role in the development and delivery of CPD for teachers and principals, working closely with provinces across the country. In addition, the agreed restructuring of the project will further align activities with the available implementation capacity. 2. Fiduciary risk is reduced from Substantial to Moderate given (i) that procurement related actions are compliant as defined in the Program Action Plan, and (ii) the improved allocation of the fund for 2020 program activities. 3. Stakeholder risk is reduced from Moderate to Low since concerned Stakeholders especially beneficiaries are well informed about ETEP and actively supporting the Program. No stakeholders have been identified as opposed to the Operation to date. Results 7/30/2020 Page 6 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) PDO Indicators by Objectives / Outcomes Strengthened teacher education institutions to enhance teacher and principal effectiveness IN00864077 ►Improved performance of the eight Lead Teacher Training Universities to provide CPD as measured by the Teacher Education Institutional Development Index (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 18%-39% increase over 10% increase over the the baseline in 2019 baseline in TEIDI score TEIDI score for all 15% increase over the Baseline established for for all LTTUs, as LTTUs, as verified by Value baseline in TEIDI each LTTU assessed by the peer the Independent score for each LTTU review of 2019 TEIDI Verification of LTTUs' assessment score. 2019 TEIDI self- assessment reports. Date 31-Dec-2017 14-Dec-2019 19-Jun-2020 30-Jun-2022 Comments IN00864078 ►Number of teachers and principals satisfied with school-based continuous professional development (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 480,000.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 30-Jun-2022 Due to delay to the development of LMS/TEMIS, no training, and hence no satisfaction survey, has been conducted via the LMS. Training via the LMS/ satisfaction survey shall commence from 2020, to be verified Comments in 2021. Intermediate Results Indicators by Results Areas Improved capacity of Lead Teacher Training Universities to enhance teacher and principal effectiveness IN00864079 ►Number of LTTUs that sign Performance Agreements with MOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 8.00 8.00 8.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 30-Jun-2022 Comments Development of teacher and principal training needs assessment system to informed CPD program development IN00864080 ►Number of TEMIS-generated annual reports on CPD needs by DOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 45.00 7/30/2020 Page 7 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 30-Jun-2022 The Ministry owned TEMIS is expected to be developed by August 2021. 2020 TEMIS reports will be Comments generated via a temporary system in Quarter 4, 2020. School-based and continuous professional development for teachers and principals IN00864191 ►Number of deployed Core Teachers and/or Principal Advisors having completed six or more priority trainin modules (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 28,600.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 30-Jun-2022 30,984 core teachers and principal advisors have completed module 1 (27,033 core teachers and 3,951 Comments principal advisors). The reported result by PMU has not been verified. Teachers and principals have access to CPD programs and resources through a ICT based system IN00864192 ►Number of teachers completing all online modules of the CPD program for the new curriculum through the LMS. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 640,000.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 30-Jun-2022 All teachers are expected to receive training on Module 1 and 2 (out of five modules) by December 2020. Comments Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 Performance Agreements are signed with the MOET by all eight LTTUs. The PAs include actions that will enhance LTTU institutional capacity to meet TEIDI targets and that will contribute to meeting DLIs (Output, 27,000,000.00, 100%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 8.00 8.00 8.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 -- Fully met: Eight PAs and 08 TEIDI baseline assessment reports were completed by end 2018 and verified by the Independent Verification Agency (IVA) in 2020. 2019 TEIDI self assessment reports were completed by Comments end of 2019 and verified by the IVA. NOL has been issued for both IVA reports. ►DLI 2 Systems are in place to: (i) measure whether teachers and principals meet new professional standards; (ii) track and record evaluations of CPD programs; and (iii) record assessments CPD needs of teach (Output, 18,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 0.00 45.00 7/30/2020 Page 8 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 -- For 2017: the DLI 2 which is due in 2017 includes a Circular describing guidelines and procedures to assess school principals and teachers against new professional standards. For 2018: The DLI 2 which is due in 2018 includes a Teacher Education Management Information System TEMIS established by MOET to (i) track teacher and principal professional standards rating; (ii) records beneficiary evaluations of CPD programs and interventions; and (iii) records teacher and principal CPD needs. The TEMIS was not established by the due date. For 2019: The DLI 2 which is due in 2019 includes up to fifteen (15) DOETs publish a TEMIS-generated CPD Annual Report for its respective province. The Annual Report present trends on professional standards, beneficiary assessments of CPD programs and assessment of CPD needs of teachers and principals. For 2020: The DLI 2 which is due in 2020 includes up to fifteen (30) DOETs publish a TEMIS-generated CPD Annual Report for its respective province. The Annual Report present trends on professional standards, Comments beneficiary assessments of CPD programs and assessment of CPD needs of teachers and principals. Progress by June 19, 2020: Unmet There has been no TEMIS-generated CPD annual report so far due to delay to the TEMIS development. MOET shall deploy Viettel system for TEMIS function in 2020 to generate 30 TEMIS reports by end 2020. Verification shall take place early 2021. Circulars describing guidelines and procedures to assess school principals and teachers against new professional standards were issued in 2018 as follows:  Circular 14/2018/TT-BGDĐT dated July 20, 2018 on professional standards for school principals  Circular 20/2018/TT-BGDĐT dated August 22, 2018 on professional standards for school teachers ►DLI 3 LTTUs train 25,000 Core Teachers and 3,600 Principal Advisors to provide face-to-face school-based CPD to teachers and principals. (Output, 22,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 28,620.00 30,984.00 28,600.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 -- 2017: DLI 3 that is due in 2017 includes ''the Circular that defines rules and regulations for the selection, roles, responsibilities and working conditions of Core TEachers and Principal Advisors''. By the due date, this Circular is yet to be in place. For 2018, 2019 2020, the DLI 3 that is due in 2018-2019 -2020 includes ''LTTUs provide basic training to 25,000 Core Teachers and 3,600 Principal Advisors''. No training for core teachers and principal advisors took Comments place in 2018. Progress by June 19, 2020: Partially met. In 2019, the LTTUs provided training to 27,033 core teachers and 3,951 principal advisors on Module 1. Training for core teachers and principal advisors on Module 2, 3 and 4 in 2020 shall commence from August 2020. The training results will be verified towards the end of 2020. ►DLI 4 25,000 Core Teachers and 3,600 Principal Advisors provide face to-face school-based continuous professional development to teachers and principals every year. (Output, 14,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 0.00 28,600.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 -- Comments For 2018: the DLI 4 which is due in 2018 is ''up to 6,000 Core Teachers and 900 Principal Advisors provide school-based continuous professional development to teachers and principals during Period 3, as per their individual annual plan''. 7/30/2020 Page 9 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) For 2019: the DLI 4 which is due in 2019 is ''up to 12,000 Core Teachers and 1,800 Principal Advisors provide school-based continuous professional development to teachers and principals during Period 2, as per their individual annual plan''. For 2020: the DLI 4 which is due in 2020 is ''up to 18,000 Core Teachers and 2,700 Principal Advisors provide school-based continuous professional development to teachers and principals during Period 4, as per their individual annual plan''. Progress by June 19, 2020: Unmet. Neither core teachers nor principal advisors selected in 2019 could provide school-based continuous professional development support to teachers and principals. This support shall be provided in 2020, and to be verified in early 2021. ►DLI 5 Up to 480,000 teachers and principals are satisfied with their access to ICT-based interactive CPD services every year. (Output, 14,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 0.00 480,000.00 Date 30-Jun-2016 14-Dec-2019 19-Jun-2020 -- For 2019: DLI 5 that is due in 2019 includes up to 160,000 teachers and principals are satisfied with ICT- based interactive CPD services every year. For 2020: DLI 5 that is due in 2019 includes up to 320,000 teachers and principals are satisfied with ICT- Comments based interactive CPD services every year. Progress by June 19, 2020: Unmet. Due to delay to the development of LMS/TEMIS, no training has been provided yet via the LMS. Training via the LMS shall commence from 2020 and to be verified in 2021. 7/30/2020 Page 10 of 10