The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Vietnam Enhancing Teacher Education Program (P150060) EAST ASIA AND PACIFIC | Vietnam | Education Global Practice | Requesting Unit: EACVF | Responsible Unit: HEAED IBRD/IDA | Program-for-Results Financing | FY 2016 | Team Leader(s): Dung Kieu Vo Seq No: 11 | ARCHIVED on 22-Feb-2022 | ISR48593 | Created by: Hanh Minh Bui on 05-Oct-2021 | Modified by: Dung Kieu Vo on 14-Feb-2022 Program Development Objectives PDO Table Program Development Objective (from Program Appraisal Document) The project development objective is to strengthen teacher training institutions to enhance teacher and principal effectiveness through improved continuous professional development. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Implementation Status and Key Decisions Notable progress in implementation was recorded from July to December 2021, leading to positive achievement in both areas of strengthening teacher education institutions and improved continuous professional development (CPD) for teachers and principals. The progress towards achieving the program development objectives is on track to be met by the program closure in June 2022. In the first area, all the six Lead Teacher Training Universities (LTTUs) reported achieving the Teacher Education Institution Development Index (TEIDI) target scores. Based on the past verification results and ongoing review of the scores and evidence, it is likely that only four or five LTTUs will achieve the TEIDI scores set out for the end target by June 30, 2022. In the second area, over half a million teachers and school principals were reported by the Teacher Education Management Information System (TEMIS) to have completed the 2021 CPD programs, with 96 percent rating the 2021 school-based CPD support as satisfactory. More than 29,000 core teachers and principal advisors across the country were registered in TEMIS to be trained on the six mandatory modules by the LTTUs to provide onsite support for their peers. By December 31, 2021, 61 out of 63 provinces had published TEMIS reports, out of which 47 reported meeting the expected quality by ETEP. According to provinces and schools, TEMIS has provided helpful information on teachers' and principals' performance against professional standards, their CPD needs, the relevance of the current CPD programs and thus can inform future CPD policies and programs. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P150060 IDA-58780 Effective USD 95.00 75.30 19.70 48.04 28.07 63% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date 2/22/2022 Page 1 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) P150060 IDA-58780 Effective 29-Jun-2016 06-Feb-2017 05-Jun-2017 30-Jun-2022 30-Jun-2022 DLI Disbursement Achievement Disbursed amount in Disbursement % for DLI ID DLI Type Description Coc DLI Amount Status Coc DLI Loan: IDA58780-001 Partially DLI2 Regular SYSTEMS ARE IN PLACE XDR 11,430,500.00 1,426,500.00 12 % Achieved NO OF CORE TEACHERS Partially DLI3 Regular XDR 14,242,800.00 3,826,466.00 27 % SELECTED N TRAINED Achieved NO OF CORE TEACHERS DLI4 Regular XDR 7,049,900.00 Not Achieved 0.00 PROVDING SBCPD NO OF TEACHERS DLI5 Regular XDR 4,320,000.00 Not Achieved 0.00 SATISFIED WITH ITC INSTITUTIONAL Partially DLI1 Regular XDR 17,120,000.00 13,910,000.00 81 % CAPACITY OF LTTU Achieved Program Action Plan The Recipient shall develop and execute a Capacity Building Plan for the LTTUs to ensure sustainable provision of Action Description teacher school based continuous professional development support, all in form and substance satisfactory to the Association. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Completion Measurement A Capacity Building Plan developed, costed and executed (in cooperation with LTTUs). Comments The Plan was finalized in December 2019 and was fully executed in 2021. The Recipient shall carry out a study – under the terms of reference acceptable to the Association - to identify options Action Description and recommendations for financing teacher- continuous professional development. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 30-Jun-2020 Completed Completion Measurement Study validated by MOET Comments The study has been conducted with the final draft report submitted to the Bank in January 2021. The Recipient shall disclose information on the Program’s activities to the public, including financial information Action Description throughout the implementation of the Program. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous Completed 2/22/2022 Page 2 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Completion Measurement Evidence of information disclosure Information on the program's activities, including financial information, is disclosed via the PMU/ LTTUs' websites and Comments fan page. PMU issued a guideline in April 2019 on information disclosure, among others, to be followed by PMU/ LTTUs. The Recipient shall maintain a system of receiving, recording and following-up on complaints, including anonymous Action Description ones. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly Completed Completion Measurement Log of complaints and reports. One complaint was received on January 9, 2022, via email and on January 13, 2022, by MOET’s official letter relating Comments to activity under the investment project implemented by Vinh LTTU, which is being followed up and handled. The Recipient shall maintain a database on complaints and denunciations from all the participating agencies and Action Description follows up on the resolution of those complaints and denunciations. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly Completed Completion Measurement Database verified MOET is in charge of maintaining the database. One complaint was received on January 9, 2022, via email and on Comments January 13, 2022, by MOET’s official letter relating to activity under the investment project implemented by one LTTU, being followed up. The Recipient shall (a) review LTTUs internal audit capacity; and (b) prepare and execute – or cause to be executed - Action Description plans to build the capacity of internal audit function in LTTUs. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 05-Jun-2019 Completed Internal audit capacity assessed and LTTUs capacity building plans developed, costed, approved and executed (in Completion Measurement cooperation with LTTUs). Comments The action was completed as required by the completion measurement. Action Description The Recipient shall issue guidance on the performance based budgeting/allocation Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous Completed Completion Measurement Guidance on the performance based budgeting/ allocation was issued by MOET. 2/22/2022 Page 3 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Comments The action was completed. All proposals for detailed designs, construction supervision and bids for civil works, whether below or above cost Action Description estimates, shall be evaluated; proposals and bids shall not be rejected only on the basis of minor, non-substantive deviations. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the January 2022 implementation support mission. The Recipient shall design and adopt a mechanism – satisfactory to the Association - to coordinate teacher Action Description continuous professional development initiatives and activities among teacher education providers and concerned teacher management department Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Issuance of a circular on teacher continuous professional development which includes the regulated coordination Completion Measurement mechanism. Comments Circular 19/2019/TT-BGDDT was issued on November 12, 2019. At least 60 percent of contracts for consultancies and 85 percent of contracts for works shall be competitively bid Action Description annually. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the January 2022 implementation support mission. No contract having cost estimate above the thresholds for using DC/SSS method set forth in the national public Action Description procurement law and regulation will be awarded on DC/SSS basis. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the January 2022 implementation support mission. Action Description Firms on the local, national, or Bank debarment list shall not be allowed to participate. 2/22/2022 Page 4 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the July 2021 implementation support mission. The Recipient shall develop a guideline to facilitate meaningful consultation and inform participation of beneficiary Action Description principals and teachers, including those from ethnic minorities and vulnerable groups. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 Completed Systems Completion Measurement Formal issuance of the guideline Comments The guideline was formally issued in November 2018. The above referenced guideline, which will be implemented by LTTUs should fully operationalize the existing Action Description Vietnamese legislation with respect to ethnic minorities through a process of free, prior, and informed consultations. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 Completed Systems Completion Measurement n/a Comments Complied. No significant issue was noted in the January 2022 implementation support mission. Action Description The Recipient will prepare an Operational Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2017 Completed Completion Measurement OM agreed by the Bank Comments This action was completed. Action Description The Recipient will execute the Operation according to the Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous Completed Completion Measurement Implementation Support Missions will review implementation quality Comments Complied with good implementation progress was noted in the January 2022 implementation support mission. 2/22/2022 Page 5 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Low Low Macroeconomic -- Low Low Sector Strategies and Policies -- Low Low Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and -- Moderate Moderate Sustainability Fiduciary -- Moderate Moderate Environment and Social -- Low Low Stakeholders -- Low Low Other -- Moderate Moderate Overall -- Moderate Low RiskComments Comments Covid 19 pandemic outbreak prevents provinces from organizing as many learning and sharing events for teachers and principals as part of the school-based professional development. Virtual events were not held as regularly as face-to-face events, which would have been organized otherwise to facilitate peer support within districts' schools and school clusters. Results PDO Indicators by Objectives / Outcomes Strengthened teacher education institutions to enhance teacher and principal effectiveness IN01049585 ►Improved performance of the six Lead Teacher Training Universities to provide CPD as measured by the Teacher Education Institutional Development Index (TEIDI) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Hanoi LTTU 5.35; Thai Hanoi LTTU 4.55; Thai Nguyen LTTU 5.35; Nguyen LTTU 4.71; Vinh TEIDI score of each Baseline established for Vinh LTTU 5.56; Hue Value LTTU 4.29; Hue LTTU LTTU increases to at each LTTU LTTU 5.0; Danang 4.84; Danang LTTU 4.84; least level 5 (>4.43) LTTU 5.11; HCMC HCMC LTTU 4.83. LTTU 5.18. Date 31-Dec-2017 30-Jun-2021 31-Dec-2021 30-Jun-2022 Partially achieved (66-83 percent). By December 31, 2021, six LTTUs’ TEIDI scores were reported to have exceeded the end target of level 5 (i.e. over 4.43). However, the World Bank Task Team’s review of TEIDI self-assessment reports by Hanoi, Comments Thai Nguyen and Hue LTTUs indicated a lack of evidence to prove that LTTUs have achieved level 6 and level 5 as self-assessed in several indicators. Unless LTTUs provide further proof, likely, the PDO 1 will only be partially completed by 66-83 percent by June 30, 2022. 2/22/2022 Page 6 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) The result is yet to be verified. The concerned IVA verification report is expected by May 15, 2022. IN01049586 ►Number of teachers and principals satisfied with school-based continuous professional development (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 519,271.00 541,696.00 320,000.00 Date 30-Jun-2016 30-Jun-2021 31-Dec-2021 30-Jun-2022 Achieved (169 percent). Out of the 560,820 teachers/ principles/ core teachers and principal advisors who took part in the satisfaction survey on the school-based CPD in 2021, 541,696 (or 96 percent) were reported to have rated Satisfactory vs. 2021 target of 320,000. The result is yet to be verified. The verification rate of DLI 5 in Comments period 4 (related to PDO2) is 100 percent. The concerned IVA verification report is expected by May 15, 2022. Intermediate Results Indicators by Results Areas Improved capacity of Lead Teacher Training Universities to enhance teacher and principal effectiveness IN01049587 ►Number of LTTUs that sign Performance Agreements with MOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6.00 6.00 6.00 Date 30-Jun-2016 30-Jun-2021 31-Dec-2021 30-Jun-2022 Achieved (100 percent). Six Performance Agreement (PAs) were signed between MOET and LTTUs, and the PAs/ revised PAs were Comments verified by the IVA. Development of teacher and principal training needs assessment system to informed CPD program development IN01049588 ►Number of TEMIS-generated annual reports on CPD needs by DOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 33.00 47.00 45.00 Date 30-Jun-2016 30-Jun-2021 31-Dec-2021 30-Jun-2022 Achieved (104 percent). 47 reports (vs. the 2021 target of 45) were generated from the Teacher Education Management Information System (TEMIS) on CPD needs by DOET. All reports were reported to have met the quality set by the program. Comments The result is yet to be verified. The concerned IVA verification report is expected by May 15, 2022. 2/22/2022 Page 7 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) School-based and continuous professional development for teachers and principals IN01049589 ►Number of deployed core teachers and/ or principal advisors having completed different priority training modules set for the year (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target No core teachers/ 30,512 core teachers and 24,000 core teachers 28,600 core teachers principal advisors principal advisors have and principal advisors and principal advisors Value completed any training completed all three have completed six having completed six modules modules 1-2-3 mandatory modules. modules Date 30-Jun-2016 05-Feb-2021 31-Dec-2021 30-Jun-2022 Partially achieved (85 percent) The six LTTUs were reported to have provided training on six mandatory modules to 29,189 deployed core teachers and principal advisors, vs 2021 target of 28,600. Based on the previous verification rate of 80 percent* and the ongoing additional verification, 85 percent of the end target is expected to be achieved by June 30, 2022. The mission uses this 85 percent to estimate the acquired number to be 24,000. Comments The result is partially verified—additional verification with all final verification reports will be finalized by May 15, 2022. * First verification of module 1 and 2 learners was conducted with 23,051 core teachers and principals advisors verified to be selected and trained according to the program's criteria and quality standards out of 28,600 reported. Teachers and principals have access to CPD programs and resources through a ICT based system IN01049590 ►Number of teachers and school principals having completed different mandatory online modules of the CPD program set for the year through the Learning Management System(s) (LMS(s)) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 519,465 teachers and school principals completed four out of No teachers/ principals five mandatory online 480,000 teachers/ 541,617 teachers/ school having completed any modules and 220,469 school principals principals have Value online module of the CPD teachers and school having completed five completed modules 1 program through the principals completed all modules through the and 2 through the LMS(s) LMS(s) five mandatory online LMS(s) modules through the Learning Management Systems (LMS). Date 30-Jun-2016 30-Jun-2021 31-Dec-2021 30-Jun-2022 Partially achieved (89 percent*). 519,465 teachers and school principals completed four out of five mandatory online modules and 220,469 teachers and school principals completed all five mandatory online modules through the Learning Management Systems (LMS) (vs. the year 5 end target of 480,000 teachers and school principals completed all five mandatory modules). The result is yet to be verified and will be verified by Task Team in May 2022. Comments * 89 percent equals (480,000 teachers and school principals completing four modules (1,920,000 times of completion) plus 220,469 teachers and school principals completing the fifth module (220,469 times of completion)) out of 480,000 teachers and school principals completing five modules (2,400,000 times of completion). Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 Institutional capacity of LTTUs to support the new Continuous Professional Development system for teachers and principals enhanced (Output, 24,693,495.00, 43%) 2/22/2022 Page 8 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 Up to six LTTUs Six out of eight LTTUs Six out of eight LTTUs conduct an annual LTTUs have inadequate have conducted annual have conducted annual TEIDI assessment capacity to support the TEIDI-self assessments, TEIDI-self assessments, Value and MOET continuous professional and the MOET has and the MOET has publishes the TEIDI development published the TEIDI published the TEIDI scores on its scores on its websites. scores on its websites. website. Date 30-Jun-2016 31-Mar-2021 31-Dec-2021 -- Six out of eight LTTUs have conducted annual TEIDI self-assessments, and the MOET has published the TEIDI scores on its websites. The TEIDI self -assessments reports are being verified by IVA. Final verification Comments reports are expected by May 15, 2022. ►DLI 2 Systems are in place to:(i)measure whether teachers/principals meet new professional standards;(ii) track & record evaluations of CPD programs;(iii) record assessments CPD needs of teachers/principals (Output, 16,487,091.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 Up to forty-five DOETs publish a TEMIS-generated CPD annual report for its respective province. The annual reports present trends on professional standards, beneficiary assessments of Existing systems to assess CPD programs and teacher and principal CPD assessments of needs are not aligned with CPD needs of requirements of the teachers and 33 TEMIS -generated 47 TEMIS -generated fundamental and principals. MOET Value CPD annual reports were CPD annual reports were comprehensive education establishes an in- published. published. reform (FCER) nor house Teacher adequately inform the Education development of CPD Management programs. Information System (TEMIS) that: (i) tracks teacher and principal professional standards rating; (ii) records beneficiary evaluations of CPD programs and interventions; and (iii) records teacher and principal CPD needs. Date 30-Jun-2016 31-Mar-2021 31-Dec-2021 -- Comments The July 2021 mission acknowledged the MOET's decision (by Decision No.2164/QD-BGDĐT, dated June 29, 2021) to cancel the development of the MOET in-house TEMIS, given the remaining time for ETEP implementation is too short of having such a system developed and operational, and MOET's Information and Communication Technology (ICT) master plan will include the development of the teacher and principal 2/22/2022 Page 9 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) education management information system. The assessment of the DLRs under the disbursement linked indicator (DLI) #2, achieved in period 5, has considered this cancellation. The DLR will be verified during February- April 2022 with the final verification report expected by May 15, 2022. ►DLI 3 Number of core teachers and principal advisors selected and trained to provide systematic face-to-face school based CPD to teachers and principals (Output, 14,242,800.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 A corps of trained school- 24,000 (including 30,101 (including 26,151 LTTUs provide based specialists that approximately 21,500 core core teachers and 3,950 basic training to provide systematic face-to- teachers and 2,500 Value principal advisors) have 25,000 core face school-based CPD to principal advisors) have been trained on modules teachers and 3,600 teachers and principals been trained on six 1, 2 and 3 principal advisors does not exist. mandatory modules. Date 30-Jun-2016 31-Mar-2021 31-Dec-2021 -- 29,189 deployed core teachers and principal advisors vs. the target of 28,600 were trained with six CPD modules of 1,2,3,4,5, and 9. However, given the past verification rate of 80 percent, and the ongoing additional verification, only 85 percent of the end target is expected to be achieved. First verification of module 1 and 2 learners was conducted with 23,051 core teachers and principals advisors Comments verified to be properly selected according to the Ministry's guidance and trained according to the quality assurance standards set out by the program. Further verification is going on with final verification report expected by May 15, 2022. ►DLI 4 Number of core teachers and principal advisors providing school-based continuous professional development to teachers and principals (Output, 10,168,614.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 Up to 25,000 core teachers and 3,600 principal advisors A corps of trained 14,682 (including 13,260 13,785 (including 13,689 provide school- specialists that provide core teachers and 1,422 core teachers and 87 based continuous systematic fact-to-face principal advisors) have principal advisors) have professional Value school-based CPD to provided school-based provided school-based development to teachers and principals CPD to teachers and CPD to teachers and teachers and does not exist. principals. principals. principals during period 5, as per their individual annual plan. Date 30-Jun-2016 31-Mar-2021 31-Dec-2021 -- 13,785 core teachers and principal advisors provided school-based peer support vs. the target of 28,600 (48 percent). 90 percent of the DLR is expected given the significant progress over the past months. The DLR will be verified during March-April 2022 with the final verification report expected by May 15, 2022. Comments Note: by the end of period 4 (i.e. March 31, 2021), 14,682 core teachers and principal advisors were verified to have provided school-based peer support vs. the period 4 target of 20,700 (70.9 percent). ►DLI 5 Number of teachers and principals who are satisfied with ICT-based interactive CPD services provided under the program (Output, 6,231,069.00, 0%) 2/22/2022 Page 10 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 389,569 teachers and Up to 320,000 541,696 teachers and principals are satisfied teachers and principals are satisfied with ICT-based principals are Value 0.00 with ICT-based interactive interactive CPD services satisfied with ICT- CPD services provided provided under the based interactive under the program program CPD services Date 30-Jun-2016 31-Mar-2021 31-Dec-2021 -- 541,696 teachers and principals are satisfied with ICT-based interactive CPD services provided under the program. The DLR will be verified during March-April 2022 with the final verification report expected by May 15, 2022. Note: by the end of Period 4 (i.e. March 31, 2021), IVA verified that 385.682 teachers and principals are Comments satisfied with ICT-based interactive CPD services provided under the program vs. the period 4 target of 160,000 (241 percent). 2/22/2022 Page 11 of 11