The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Vietnam Enhancing Teacher Education Program (P150060) EAST ASIA AND PACIFIC | Vietnam | Education Global Practice | Requesting Unit: EACVF | Responsible Unit: HEAED IBRD/IDA | Program-for-Results Financing | FY 2016 | Team Leader(s): Dung Kieu Vo Seq No: 7 | ARCHIVED on 27-Dec-2019 | ISR39977 | Created by: Hanh Minh Bui on 12-Dec-2019 | Modified by: Dung Kieu Vo on 24-Dec-2019 Program Development Objectives Program Development Objective (from Program Appraisal Document) The project development objective is to strengthen teacher training institutions to enhance teacher and principal effectiveness through improved continuous professional development. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Unsatisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Unsatisfactory Moderately Unsatisfactory Implementation Status and Key Decisions The Mid-Term Review (MTR) recognized efforts dedicated by the Ministry of Education and Training (MOET) and its PMU in pooling in technical expertise from the concerned Functional Departments and the Lead Teacher Training Universities (LTTUs) to carry out the first training module for core teachers and principal advisors all over the country. Assessment reports on the LTTU development against the Teacher Education Institution Development Index over the last two years have also been completed and being verified by an Independent Verification Agency (IVA). Critical decisions addressing the capacity and coordination constraints which were identified as key to program implementation delays were also made during the MTR. These include: (i) delegated authority to the LTTUs and the PMU and streamlined appraisal/approval processes; (ii) reinforced PMU capacity via seconding staff from the related Functional Departments, mobilizing 63 project Coordinators from provincial Departments of Training and Education and recruiting an international consulting firm to provide required Technical Assistance and capacity building support; and (iii) delegated LMS development and management to the LTTUs. Such positive developments are found to be conducive to the ETEP implementation. Nevertheless, challenges faced by ETEP to fully achieve its intended results by the end of the program remains significant, which shall require immediate enforcement of the decisions made, timely and sufficient resources provided to LTTUs in 2020 and beyond, enhanced monitoring as well as technical support provided from the PMU, and prioritization of ETEP investment. Accordingly, it was agreed that the Minister of Education would make a proposal to the Bank to prioritize ETEP investment in high performing LTTUs to deliver the intended program results. Subject to the final option proposed by the Minister and agreed by the Bank in January 2020, formal program restructuring shall take place, in parallel with the revision of the ETEP Results Framework (RF) and the Program Operation Manual. In addition, a list of time-bound actions were agreed to further advance ETEP implementation. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed 12/27/2019 Page 1 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) P150060 IDA-58780 Effective USD 95.00 95.00 0.00 10.21 83.34 11% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P150060 IDA-58780 Effective 29-Jun-2016 06-Feb-2017 05-Jun-2017 30-Jun-2022 30-Jun-2022 DLI Disbursement Achievement Disbursed amount in Disbursement % DLI ID DLI Type Description Coc DLI Amount Status Coc for DLI Loan: IDA58780-001 DLI2 Regular SYSTEMS ARE IN PLACE XDR 12,860,000.00 Not Achieved 0.00 NO OF CORE TEACHERS DLI3 Regular XDR 15,670,000.00 Not Achieved 0.00 SELECTED N TRAINED NO OF CORE TEACHERS DLI4 Regular XDR 10,010,000.00 Not Achieved 0.00 PROVDING SBCPD NO OF TEACHERS DLI5 Regular XDR 10,000,000.00 Not Achieved 0.00 SATISFIED WITH ITC INSTITUTIONAL DLI1 Regular XDR 19,260,000.00 Not Achieved 0.00 CAPACITY OF LTTU Program Action Plan The Recipient shall develop and execute a Capacity Building Plan for the LTTUs to ensure sustainable provision of Action Description teacher school based continuous professional development support, all in form and substance satisfactory to the Association. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Completion A Capacity Building Plan developed, costed and executed (in cooperation with LTTUs) Measurement Comments The Plan was finalized in December 2019. The Recipient shall carry out a study – under the terms of reference acceptable to the Association - to identify options Action Description and recommendations for financing teacher- continuous professional development. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2020 Not Yet Due Completion Study validated by MOET Measurement Comments The study is not yet due 12/27/2019 Page 2 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) The Recipient shall disclose information on the Program’s activities to the public, including financial information Action Description throughout the implementation of the Program. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous In Progress Completion Evidence of information disclosure Measurement Information on the Program’s activities, including financial information, is disclosed to the public via the ETEP Comments website. PMU issued a guideline in April 2019 on information disclosure, among others, to be followed by PMU/ LTTUs. The Recipient shall maintain a system of receiving, recording and following-up on complaints, including anonymous Action Description ones. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly In Progress Completion Log of complaints and reports Measurement No complaints have been received so far. Besides channel established by ETEP PMU and LTTUs, MOET also Comments deploys a software to house complaints and denunciations, including those relating to ETEP. The Recipient shall maintain a database on complaints and denunciations from all the participating agencies and Action Description follows up on the resolution of those complaints and denunciations. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly In Progress Completion Database verified Measurement MOET is in charge of maintaining the database. No complaints have been received so far. The project is at too early Comments stage to receive the complaints. The Recipient shall (a) review LTTUs internal audit capacity; and (b) prepare and execute – or cause to be executed - Action Description plans to build the capacity of internal audit function in LTTUs. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 05-Jun-2019 In Progress Completion Internal audit capacity assessed and LTTUs capacity building plans developed, costed, approved and executed (in Measurement cooperation with LTTUs). 12/27/2019 Page 3 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) An internal audit consultancy firm was selected with contract awarded in May 2019. The review of LTTU internal audit Comments capacity should be finalized and the internal audit capacity building plan should be ready for execution by December 31, 2019. Action Description The Recipient shall issue guidance on the performance based budgeting/allocation Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous Completed Completion Guidance on the performance based budgeting/ allocation was issued by MOET. Measurement Comments The action was completed. All proposals for detailed designs, construction supervision and bids for civil works, whether below or above cost Action Description estimates, shall be evaluated; proposals and bids shall not be rejected only on the basis of minor, non-substantive deviations. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion n/a Measurement Comments The Project is compliant, as noted in the November 2019 Mid-term review The Recipient shall design and adopt a mechanism – satisfactory to the Association - to coordinate teacher Action Description continuous professional development initiatives and activities among teacher education providers and concerned teacher management department Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Completion Issuance of a circular on teacher continuous professional development which includes the regulated coordination Measurement mechanism. Comments Circular 19/2019/TT-BGDDT was issued on November 12, 2019. At least 60 percent of contracts for consultancies and 85 percent of contracts for works shall be competitively bid Action Description annually. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion n/a Measurement 12/27/2019 Page 4 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) The Project is compliant, as noted in the November 2019 Mid-term review, with regards to the contracts for Comments consultancies. No works have been taking place so far. No contract having cost estimate above the thresholds for using DC/SSS method set forth in the national public Action Description procurement law and regulation will be awarded on DC/SSS basis. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion n/a Measurement Comments The Project is compliant, as noted in the November 2019 Mid-term review. Action Description Firms on the local, national, or Bank debarment list shall not be allowed to participate. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion n/a Measurement Comments The Project is compliant, as noted in the November 2019 Mid-term review. The Recipient shall develop a guideline to facilitate meaningful consultation and inform participation of beneficiary Action Description principals and teachers, including those from ethnic minorities and vulnerable groups. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 Completed Systems Completion Formal issuance of the guideline Measurement Comments The guideline was formally issued in November 2018. The above referenced guideline, which will be implemented by LTTUs should fully operationalize the existing Action Description Vietnamese legislation with respect to ethnic minorities through a process of free, prior, and informed consultations. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 In Progress Systems Completion n/a Measurement Comments No significant issue was noted in the reporting period. 12/27/2019 Page 5 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Action Description The Recipient will prepare an Operational Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2017 Completed Completion OM agreed by the Bank Measurement Comments This action was completed. Action Description The Recipient will execute the Operation according to the Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous In Progress Completion Implementation Support Missions will review implementation quality Measurement Comments Slow implementation was noted in the Implementation Support Mission in November- December 2018 and May 2019. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Low Low Macroeconomic -- Low Low Sector Strategies and Policies -- Low Low Technical Design of Project or Program -- Substantial Substantial Institutional Capacity for Implementation and Sustainability -- Substantial Substantial Fiduciary -- Substantial Substantial Environment and Social -- Low Low Stakeholders -- Moderate Moderate Other -- Moderate Moderate Overall -- Substantial Substantial Results 12/27/2019 Page 6 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) PDO Indicators by Objectives / Outcomes Strengthened teacher education institutions to enhance teacher and principal effectiveness IN00784663 ►Improved performance of the eight Lead Teacher Training Universities to provide CPD as measured by the Teacher Education Institutional Development Index (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 10% increase over the baseline in TEIDI score 15% increase over the Baseline established for for all LTTUs, as Value -- baseline in TEIDI each LTTU assessed by the peer score for each LTTU review of 2019 TEIDI assessment score. Date 31-Dec-2017 24-Jul-2019 14-Dec-2019 30-Jun-2022 Comments IN00784664 ►Number of teachers and principals satisfied with school-based continuous professional development (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 480,000.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 30-Jun-2022 Comments Intermediate Results Indicators by Results Areas Improved capacity of Lead Teacher Training Universities to enhance teacher and principal effectiveness IN00784665 ►Number of LTTUs that sign Performance Agreements with MOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 8.00 8.00 8.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 30-Jun-2022 Comments Development of teacher and principal training needs assessment system to informed CPD program development IN00784756 ►Number of TEMIS-generated annual reports on CPD needs by DOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 45.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 30-Jun-2022 12/27/2019 Page 7 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Comments School-based and continuous professional development for teachers and principals IN00784757 ►Number of deployed Core Teachers and/or Principal Advisors having completed six or more priority trainin modules (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 28,600.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 30-Jun-2022 Comments Teachers and principals have access to CPD programs and resources through a ICT based system IN00784758 ►Number of teachers completing all online modules of the CPD program for the new curriculum through the LMS. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 640,000.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 30-Jun-2022 Comments Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 Performance Agreements are signed with the MOET by all eight LTTUs. The PAs include actions that will enhance LTTU institutional capacity to meet TEIDI targets and that will contribute to meeting DLIs (Output, 27,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 8.00 8.00 8.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 -- For 2017 and 2018: The DLI 1 which is due in 2017 and 2018 includes ''all eight (08) Performance Agreements have been signed between the MOET and eight LTTUs''. 08 PAs have been signed, now subject to IVA's verification. For 2019: The DLI 1 which is due in includes 2019 ''Each LTTU conducts an annual TEIDI assessment and Comments MoET publishes the TEIDI scores on its website''. On track TEIDI self assessment was completed and verified by the Indepent Verification Agency (IVA). Assessment reports will be published on MOET website after IVA reports issued by December 31, 2019. ►DLI 2 Systems are in place to: (i) measure whether teachers and principals meet new professional standards; (ii) track and record evaluations of CPD programs; and (iii) record assessments CPD needs of teach (Output, 18,000,000.00, 0%) 12/27/2019 Page 8 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 0.00 45.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 -- For 2017: the DLI 2 which is due in 2017 includes a Circular describing guidelines and procedures to assess school principals and teachers against new professional standards. Circulars as such were issued in 2018 as follows:  Circular 14/2018/TT-BGDĐT dated July 20, 2018 on professional standards for school principals  Circular 20/2018/TT-BGDĐT dated August 22, 2018 on professional standards for school teachers For 2018: The DLI 2 which is due in 2018 includes a Teacher Education Management Information System TEMIS established by MOET to (i) track teacher and principal professional standards rating; (ii) records beneficiary evaluations of CPD programs and interventions; and (iii) records teacher and principal CPD needs. The TEMIS was not established by the due date. Comments For 2019: The DLI 2 which is due in 2019 includes up to fifteen (15) DOETs publish a TEMIS-generated CPD Annual Report for its respective province. The Annual Report present trends on professional standards, beneficiary assessments of CPD programs and assessment of CPD needs of teachers and principals. Unmet There has been no TEMIS-generated CPD annual report so far due to delay to the TEMIS development ►DLI 3 LTTUs train 25,000 Core Teachers and 3,600 Principal Advisors to provide face-to-face school-based CPD to teachers and principals. (Output, 22,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 28,620.00 28,600.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 -- 2017: DLI 3 that is due in 2017 includes ''the Circular that defines rules and regulations for the selection, roles, responsibilities and working conditions of Core TEachers and Principal Advisors''. By the due date, this Circular are yet to be in place. For 2018 and 2019, the DLI 3 that is due in 2018-2019 includes ''LTTUs provide basic training to 25,000 Core Teachers and 3,600 Principal Advisors''. No training for core teachers and principal advisors took place in Comments 2018. On track By December 14, 2019, 28,620 core teachers and principal advisors have been trained with module 1 on the reformed general education curriculum. The training will be verified in Q1 2020. ►DLI 4 25,000 Core Teachers and 3,600 Principal Advisors provide face to-face school-based continuous professional development to teachers and principals every year. (Output, 14,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 0.00 28,600.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 -- 12/27/2019 Page 9 of 10 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) For 2018: the DLI 4 which is due in 2018 is ''up to 6,000 Core Teachers and 900 Principal Advisors provide school-based continuous professional development to teachers and principals during Period 2, as per their individual annual plan''. For 2019: the DLI 4 which is due in 2019 is ''up to 12,000 Core Teachers and 1,800 Principal Advisors provide school-based continuous professional development to teachers and principals during Period 2, as per Comments their individual annual plan''. Unmet By December 2019, neither core teachers nor principal advisors selected in 2019 could provide school-based continuous professional development support to teachers and principals as the training of those core teachers could not be conducted earlier in the year. ►DLI 5 Up to 480,000 teachers and principals are satisfied with their access to ICT-based interactive CPD services every year. (Output, 14,000,000.00, 0%) From January to Baseline Actual (Previous) Actual (Current) December 2021 Value 0.00 0.00 0.00 480,000.00 Date 30-Jun-2016 24-Jul-2019 14-Dec-2019 -- For 2019: DLI 5 that is due in 2019 includes up to 160,000 teachers and principals are satisfied with ICT- based interactive CPD services every year. Comments Unmet Due to delay to the development of LMS/TEMIS, no training has been provided yet via the LMS. 12/27/2019 Page 10 of 10