The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) Improvement of Skills Development in Mozambique (P167054) EASTERN AND SOUTHERN AFRICA | Mozambique | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2021 | Seq No: 6 | ARCHIVED on 20-Jun-2023 | ISR55704 | Implementing Agencies: International Center of Insect Physiology and Ecology- icipe., Ministry of Science and Technology Higher and Technical and Professional Education (MCTESTP), National Authority for Professional Education (ANEP), Republic of Mozambique Ministry of Economy and Finance Key Dates Key Project Dates Bank Approval Date: 08-Sep-2020 Effectiveness Date: 26-Apr-2021 Planned Mid Term Review Date: 25-Oct-2023 Actual Mid-Term Review Date: Original Closing Date: 31-Dec-2025 Revised Closing Date: 31-Dec-2025 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) Increase access to quality education and training at TVET and HE levels in priority areas Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Increase access to quality education and training in HE with focus in priority areas:(Cost $35.00 M) Increase access to quality of education and training in selected areas of TVET:(Cost $36.50 M) Strengthening institutional capacity for higher education and TVET Governance:(Cost $27.50 M) Project management and monitoring and evaluation:(Cost $5.00 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions The Improvement of Skills Development in Mozambique Project (MozSkills) has registered progress in the implementation of activities across all project components and remains on track to achieve the project development objectives, as per the summary below by subsystem of education supported by the project:  In higher education, progress was noted in the following activities, among others: (a) the execution of sub-projects awarded in the first call for proposals (38) under the Institutional Development Fund; (b) the training of faculty in the use of new educational technologies to enable more effective use of teaching with resource information and communication technologies (ICTs); (c) consolidation of quality assurance mechanisms and evaluation and accreditation of higher education courses and institutions; (d) the development and approval of the national qualification framework of the overall system of education and the approval of the legislative package of higher education; (e) the 6/20/2023 Page 1 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) enrollment of postgraduate scholars and the award of research and innovation funds to higher education institutions (HEIs) with a good start in implementation; (f) the completion of a second batch of training of trainers to support the training of science, technology, engineering and math teachers; and (g) progress on the preparatory work required for the provision of digital resources to training institutions.  In technical education, progress was registered in the following activities, among others: (a) increased support to the six technical and vocational education and training (TVET) Centers of Reference; (b) the development of qualifications in priority areas; (c) training of trainers and managers of Professional Education (Certificates B and A), the training of teachers of HEIs, as trainers of TVET teachers (aiming to acquire the professional certification) as well as accreditation of HEIs as providers of such training, and monitoring of implementation of such trainings which resulted in the cumulative training of 1,200 teachers currently working in TVET institutions; (d) improvement of quality assurance mechanisms through the update of the instruments of evaluation and the establishment of the launching of the third regional center of quality assurance which brings the support on matters of quality assurance closer to the training institutions and the continues establishment of quality assurance units in training institutions; (e) completion of evaluation of proposals under the competitive fund aimed to provide short-term training to youth, and the initiation of implementation of the sub-projects awarded under the second call for proposals, the evaluation of proposals under the third call, and the monitoring of the sub-projects under implementation. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Substantial Substantial Substantial Macroeconomic Substantial Moderate Moderate Sector Strategies and Policies Substantial Moderate Moderate Technical Design of Project or Program Substantial Moderate Moderate Institutional Capacity for Implementation and Substantial Substantial Substantial Sustainability Fiduciary Substantial Substantial Substantial Environment and Social Moderate Moderate Moderate Stakeholders Moderate Moderate Moderate Other Moderate Moderate Moderate Overall Substantial Moderate Moderate Results PDO Indicators by Objectives / Outcomes Increase access to quality education and training at TVET and HE levels in priority areas IN01276404 ►Students enrolled in accredited HE programs (Number (Thousand), Custom) Baseline Actual (Previous) Actual (Current) End Target 6/20/2023 Page 2 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) Value 20.00 34.80 77.00 45.00 Date 31-Dec-2018 10-Oct-2022 11-May-2023 31-Dec-2024 Measures quality and relevance. Comments: IN01276405 ►Student enrollment at flagship TVET institutes in selected programs (by type of program, by gender) (Number (Thousand), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 2.40 2.64 4.70 5.00 Date 30-Mar-2020 10-Oct-2022 30-Mar-2023 30-Jun-2025 Only includes students in long term duration courses. In addition, 3 of the Reference Centers are Comments: providing short training to 500 youth of which 55% are girls. IN01276406 ►TVET qualifications endorsed by private sector (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 35.00 54.00 94.00 75.00 Date 31-Dec-2018 10-Oct-2022 11-May-2023 31-Dec-2025 Measures relevance and quality of partnership with industry defined by their involvement in the definition of occupational standards up to the validation of qualifications. The number of qualifications fully financed by the project are 49 and 11 qualifications were co-financed by the Ministry of Health. In addition, through the project the sector developed the appropriate procedures and quality assurances processes which helped developed 34 qualifications in priority areas funded by other government Comments: agencies and Development Partners. Also to support the implementation of Recognition of Prior Learning (RPL) MozSkills provided technical assistance to support the development of guidelines for assessment of competencies in the areas of electricity, construction, mechanics and welding. Training and accreditation of institutions to implement the RPL is ongoing. IN01276407 ►HE qualifications endorsed by private sector/associations or professional bodies (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 9.00 9.00 9.00 25.00 Date 31-Dec-2018 10-Oct-2022 11-May-2023 29-Dec-2023 Measures the number of programs designed in collaboration with professional associations or private sector. The process of recruitment of specialists for the development of selected qualifications is ongoing Comments: and the consultation process with relevant training institutions and entities is expected to initiate in August 2023. IN01276408 ►HE students in teacher training programs benefiting from trained lecturers with support of the project (Number (Thousand), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 2.40 2.50 5.00 6/20/2023 Page 3 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) Date 31-Jan-2020 10-Oct-2022 30-Mar-2023 31-Dec-2025 Measures the number of beneficiary students trained by teachers that received training in new teaching techniques/ methodologies. Comments: In addition to the training of 144 higher education trainers, 227 teachers were trained in robotics. The support aims to reach about 10,000 ESG, TVET and IFP students. Intermediate Results Indicators by Components Increase access to quality education and training in HE with focus on priority areas IN01276409 ►STEM trainers of teachers trained in new teaching methodologies (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 176.00 190.00 400.00 Date 31-Dec-2019 10-Oct-2022 11-May-2023 29-Dec-2023 Measures the number of STEM teachers that benefitted from structured training in new methodologies. 144 higher education teachers benefitted from training in teaching methodologies on various subjects of STEM and a group of 172 higher education teachers and 8 teachers from Teacher Training Institutes received training in robotic educational. In addition, a group of 180 teachers received training on the use Comments: of innovative methodologies with resource to information communication technologies. The number for this indicator is preliminary but not cumulative because some of the faculty were beneficiaries of the three types of trainings. IN01276412 ►Accredited higher education programs (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 99.00 240.00 252.00 250.00 Date 31-Dec-2019 10-Oct-2022 30-Mar-2023 31-Dec-2024 Number of programs submitted for external evaluation and accredited. Only 60% the courses courses submitted for evaluation were accredited with grade A or B. Comments: STEM courses correspond to 34.5%. The cumulative includes only accredited operational courses. IN01276415 ►Newly enrolled RSIF PhD students supported through the MoZSkills Government contribution (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 7.00 39.00 20.00 Date 31-Jan-2020 30-Sep-2022 11-May-2023 31-Dec-2025 The indicator measures the number of lecturers and researchers enrolled in PhD programs under the regional sub-component of the Project. 40 candidates have been awarded with scholarships of which 32 Mozambicans and 8 from countries in the region. Except for one scholar from Mozambique all others have Comments: reported to respective host universities and have initiated their programs. The difference by the end target and actual numbers reflects a higher proportion in the allocation of funds towards scholarships to support faculty and researchers. 6/20/2023 Page 4 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) IN01276418 ►Female students benefting from counseling (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 50.00 50.00 50.00 Date 31-Jan-2020 10-Oct-2022 11-May-2023 31-Dec-2025 Percentage of higher education female students in final year of studies in priority areas that receive counselling about work opportunities. Although major HEIs are providing support to students to make the Comments: transition from school to work through internship arrangements, this support is expected to raise with the implementation of proposals awarded under the second call of the competitive fund. Increase access to quality education and training in selected areas of TVET IN01276410 ►Trainers trained in new teaching methodologies (CBT) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 1,093.00 482.00 482.00 3,000.00 Date 30-Jan-2020 10-Oct-2022 30-Mar-2023 31-Dec-2025 Measures the number of TVET teachers that received training in new teaching methodologies. There was significant progress in the access of training by teachers. A batch of 1239 TVET teachers (26% female) were enrolled in accredited HEIs to acquire professional certification in new teaching methodologies or in educational management which is due to be completed in the first semester of 2023. Comments: Once the certification is provided the actual number of TVET teachers trained in Certificate A and B will be updated. In technical specialization, as planned the 24 teachers enrolled in technology and soil analysis have completed the training raising the number of teachers trained in this area of expertise to 36. IN01276413 ►Beneficiaries of the National Fund for Professional Education (Number (Thousand), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 3.00 3.00 15.00 Date 28-Feb-2019 10-Oct-2022 11-May-2023 31-Dec-2025 Beneficiaries of the 1st and 2nd call. This does not include the youth benefiting from short term courses Comments: provided by the 3 Reference Centers. IN01276417 Female beneficiaries (Number (Thousand), Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 1.10 1.10 3.75 Date 31-Jan-2020 10-Oct-2022 11-May-2023 31-Dec-2025 IN01276419 6/20/2023 Page 5 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) ►Industry advisory committee established at every flagship (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 66.00 66.00 100.00 Date 31-Dec-2019 10-Oct-2022 30-Mar-2023 29-Dec-2023 Measures the participation of private sector in the Board of flagship institutions. Only 66% are fully operational. The remaining are going through restructuring due to part of its members Comments: had been transferred. IN01276421 ►Amount of funds collected throught the National Training Fund for Professional Education (Amount(USD), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 500,000.00 Date 30-Jan-2019 10-Oct-2022 30-Mar-2023 31-Dec-2025 Measures productive sector contribution to the National Training Fund which is yet to be fully operational. In the meantime, selected firms have provided direct support in goods and equipment to a number of TVET institutions Comments: PBC1- The legislative package has been approved. The sector is proceeding with the processes for the Fund operationalization. IN01276423 ►NFPE fully operational (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target The competitive The competitive mechanism is active mechanism is active since 2021 but the since 2021 but the operationalization of operationalization of the the NFPE as NFPE fully operational NFPE as envisaged is envisaged is still and with continued still awaiting the approval awaiting the approval support from industry Value N/A of the legislative of the legislative in Board and package. Call for package. Call for Evaluation of proposals and evaluation proposals and proposals of proposals are taking evaluation of place following the proposals are taking procedures described in place following the the manual. procedures described in the manual. Date 31-Dec-2019 30-Sep-2022 30-Sep-2022 29-Dec-2023 The indicator measures the operationalization of the NFPE. The indicator will be fully achieved when the following elements are completed (i) levy collection mechanism and funds collection mechanism and implementation guidelines for the national training fund are approved; (ii) call for proposals designed in Comments: collaboration with private sector; (iii) collection of Levy is implemented; (iv) evaluation of proposals in collaboration with industry and; (v) the Fund is fully operational and with continued support from representatives of industry in the Board and in the evaluation of proposals. Strengthening institutional capacity for higher education and TVET governance IN01276411 6/20/2023 Page 6 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) ►Establishment of Wi-Fi networks in selected universities and TVET flagship instituions (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 1.00 3.00 3.00 10.00 Date 30-Jan-2020 10-Oct-2022 30-Mar-2023 30-Jun-2023 Institutions with access to Wi-Fi networks. With project funds through the Institutional Development Fund, 10 more higher education institutions established wi-fi and reinforced wi-fi systems and not yet reported Comments: because data is being verified. IN01276414 ►Number of HE institutions implementing quality assurance mechanisms (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target The assessment The assessment instruments were instruments were revised revised and capacity and capacity building to building to institutions Additional 20% of institutions is ongoing (20 is ongoing ( HEIs with quality Current framework needs Value units of quality assurance cumulatively 36 units assurance units in improvements of HEIs benefited from of quality assurance of place (cumulative training on quality HEIs benefited from 40%) assurance training on quality methodologies). assurance methodologies). Date 31-Dec-2019 10-Oct-2022 11-May-2023 29-Dec-2023 The indicator measures the percentage increase in the number of institutions with quality assurance units. The Performance Based Condition (PCB) will be fully achieved through the (i) the revision of assessment instruments in collaboration with HEIs and capacity building to institutions completed and (ii) 40% of HEIs (cumulative) have quality assurance units established. It was expected that 10% of HEIs will have such Comments: units established in 2021, 20% in 2022 and 40% in 2023. Based on the number of courses and requests of institutional evaluation submitted to CNAQ a growing number of institutions have established quality assurance units. The report is expected by June 2023. IN01276416 ►HE strategic plan developed (2021-2030) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N/A N/A N/A Yes Date 31-Dec-2019 10-Oct-2022 11-May-2023 31-Dec-2021 Measures the existence of a strategic plan developed in consultation with main stakeholders. MCTES is Comments: preparing to relaunch the bidding for this activity IN01276420 ►Delivered training workshops on GBV (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 2.00 2.00 4.00 Date 31-Jan-2020 10-Oct-2022 11-May-2023 30-Jun-2022 6/20/2023 Page 7 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) Measures the number of workshops delivered to HE and TVET institutions on topics related to Gender Comments: including GBV IN01276422 ►Level of satisfaction of the students (Number) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 3.00 Date 31-Jan-2019 10-Oct-2022 11-May-2023 30-Jun-2025 Average satisfaction level of students on a scale from 0 to 5 surveying main aspect of education provision: Comments: relevance of course, teaching quality and learning environment. The surveys are yet to be conducted. IN01276424 ►Strengthen the NREN capacity to provide high connectivity to training institutions (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The connectivity requires improvement to respond to the growing needs of training and research The connectivity institutions. The demand requires improvement is high as seen by the to respond to the increase in the number of growing needs of institutions connected to training and research the NREN including to institutions. To prepare respond to the challenge for better service posed by the COVID. To delivery relevant staff Improved connectivity prepare for better service continued to benefit Value Low connectivity access to training delivery relevant staff from training in institutions benefitted from training in technical areas (i.e., technical areas (i.e., network network administration, administration, cybersecurity). The cybersecurity). There NREN also provided is also progress in the training to beneficiary preparatory work to institutions, with focus on meet the increase of the use of digital connectivity. platforms, access and use of academic and scientific repositories. Date 31-Mar-2020 31-Mar-2022 11-May-2023 30-Jun-2023 Increase in the capacity of NREN bandwidth from 3.12 Gbps to at least 60 Gbps and improve the last mile Comments: to 1 Gbps for small and medium size institutions and at least 10 Gbps for the 4 major institutions. IN01276425 ►Students and faculty access to digital technologies (Number (Thousand), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 70.00 120.00 180.00 180.00 Date 31-Dec-2019 10-Oct-2022 11-May-2023 31-Dec-2025 Number of higher education faculty and students with access to online resources in training institutions. Comments: The number does not include TVET students. IN01276426 6/20/2023 Page 8 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) ►Targeted students enrolled in priority areas with acess to digital devices (Number (Thousand), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 20.00 Date 28-Feb-2020 10-Oct-2022 11-May-2023 31-Jan-2023 The indicator measures the number of targeted students provided with digital devices to enable online Comments: access to learning resources throughout the project life. IN01276427 ►GRM reports published (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target GRM reports published in The dissemination of implementing agencies the GRM is a Websites show Value N/A N/A continued activity and increase percentage of the first report has issues been published resolved/addressed within stipulated service standards Date 31-Jan-2020 10-Oct-2022 11-May-2023 31-Dec-2025 GRM periodic reports published by project-supported institutions. The reports should be available and Comments: published in the implementing agencies Websites on a annual basis from 2022 onwards. Performance-Based Conditions IN01276428 ►PBC 1 NFPE fully operational (Text, Output, 3,000,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) 2023 The competitive The competitive mechanism is active since mechanism is active 2021 but the since 2021 but the operationalization of the operationalization of the NFPE as envisaged is still Value N/A -- NFPE as envisaged is awaiting the approval of still awaiting the approval regulations following the of the legislative approval of the regulatory package. framework in December 2022. Date -- 30-Sep-2022 11-May-2023 -- IN01276429 ►PBC 2 Number of HE institutions implementing quality assurance mechanisms (Text, Output, 2,000,000.00, 0.00%) 6/20/2023 Page 9 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) Baseline Actual (Previous) Actual (Current) 2023 The assessment The assessment instruments were revised instruments were revised and capacity building to and capacity building to institutions is ongoing (20 institutions is ongoing (36 Current framework needs Value units of quality assurance units of quality assurance -- improvements of HEIs benefited from of HEIs benefited from training on quality training on quality assurance assurance methodologies). methodologies). Date -- 10-Oct-2022 11-May-2023 -- Comments: Visits to the field were conducted by the Verification Agency and the report is being finalized. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P167054 IDA-D7160 Effective USD 104.00 104.00 0.00 26.01 76.10 25% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P167054 IDA-D7160 Effective 08-Sep-2020 03-Nov-2020 26-Apr-2021 31-Dec-2025 31-Dec-2025 Cumulative Disbursements 6/20/2023 Page 10 of 11 The World Bank Implementation Status & Results Report Improvement of Skills Development in Mozambique (P167054) Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 6/20/2023 Page 11 of 11