The World Bank Pakistan: Third Punjab Education Sector Project (P154524) REPORT NO.: RES40927 RESTRUCTURING PAPER ON A PROPOSED PROJECT RESTRUCTURING OF PAKISTAN: THIRD PUNJAB EDUCATION SECTOR PROJECT APPROVED ON JUNE 3, 2016 TO ISLAMIC REPUBLIC OF PAKISTAN EDUCATION SOUTH ASIA Regional Vice President: Hartwig Schafer Country Director: Patchamuthu Illangovan Regional Director: Lynne D. Sherburne-Benz Practice Manager/Manager: Mario Cristian Aedo Inostroza Task Team Leader(s): Tazeen Fasih, Koen Martijn Geven The World Bank Pakistan: Third Punjab Education Sector Project (P154524) ABBREVIATIONS AND ACRONYMS APF Assessment Policy Framework COVID-19 The disease caused by the novel coronavirus (SARS-CoV-2) CPD Continuous Professional Development DLI Disbursement Linked Indicator (now referred to as Performance Based Condition or PBC) FA Formative Assessment HR Human Resources LSA Large Scale (Sample Based) Assessment ISP Institutional Strengthening Plan NSB Non-Salary Budget PBC Performance Based Condition (formerly referred to as Disbursement Linked Indicator or DLI) PDO Project Development Objective PEC Punjab Examination Commission PESRP Punjab Education Sector Reform Program PESP-III Third Punjab Education Support Project PMIU Project Management and Implementation Unit PSPA Punjab Social Protection Authority SBA School Based Assessment SED School Education Department TA Technical Assistance TPV Third Party Validation The World Bank Pakistan: Third Punjab Education Sector Project (P154524) BASIC DATA Product Information Project ID Financing Instrument P154524 Investment Project Financing Original EA Category Current EA Category Not Required (C) Not Required (C) Approval Date Current Closing Date 03-Jun-2016 31-Dec-2021 Organizations Borrower Responsible Agency PESRP, School Education Department, Government of Islamic Republic of Pakistan Punjab Project Development Objective (PDO) Original PDO The project development objective is to support Punjab province to improve school participation, completion, and teaching-learning practices with a particular focus on low-performing districts. OPS_TABLE_PDO_CURRENTPDO Summary Status of Financing Net Ln/Cr/Tf Approval Signing Effectiveness Closing Commitment Disbursed Undisbursed IBRD-86200 03-Jun-2016 31-Aug-2016 05-Oct-2016 31-Dec-2021 300.00 187.16 112.84 Policy Waiver(s) Does this restructuring trigger the need for any policy waiver(s)? No The World Bank Pakistan: Third Punjab Education Sector Project (P154524) I. PROJECT STATUS AND RATIONALE FOR RESTRUCTURING A. Background 1. Pakistan is at a crossroads as it deals with the COVID-19 pandemic. Periodic macroeconomic crises and a low human capital basis have constrained the country’s growth prospects. Over the last two decades, economic growth in Pakistan has averaged at 4.4 percent a year, below the South Asian annual average of 6.3 percent.[1] Low investment in human capital (HC), slow progress of structural reforms, low private investment, and slow export growth due to an overvalued currency, among others, have hindered growth prospects. The country was making good progress in stabilizing its economy and implementing much needed structural reforms. However, the global coronavirus disease (COVID-19) pandemic will have significant negative impacts on the economy. The closure of businesses and disruption to the supply chains are significantly affecting the services and manufacturing sectors, which account for nearly 80 percent of total gross domestic product (GDP). The impact of the ongoing economic disruption is expected to contract GDP by 1.3 percentage points in FY20. 2. The World Bank’s rapid response to the COVID-19 crisis in Pakistan included the Pandemic Response Effectiveness in Pakistan project ($200 million) and eight ongoing projects that quickly mobilized $40 million for urgently needed equipment and supplies. The second phase of the COVID-19 response is currently underway, which focuses on interventions to mitigate socio-economic mitigation. This includes repurposing and restructuring existing operations and aligning the design of proposed operations to prioritize COVID-19 related interventions as well as support for the medium-term reform agenda so that Pakistan can rebound stronger as the COVID-19 crisis subsides. In Punjab, the response has included support from immediate procurements through the Disaster Climate Resilience Improvement Project (P154036) and the Punjab Skills Development Project (P130193), and planned restructurings of the Punjab Green Development Project (P165388), Punjab Jobs and Competitiveness Program (P155963) and Punjab Tourism for Economic Growth project (P158099). 3. The rapid rise of COVID-19 is presenting an unprecedented challenge school system in Punjab. This poses increased risk to further implementation of several Performance Based Conditions (PBCs, previously DLIs) under the Third Punjab Education Support Project. To prevent further spread of the virus, the Government of Punjab has closed all public and private schools in the province since March 15, and schools are currently projected to remain closed at least through June. School closures were a necessary step to increase social distancing and thus reduce the spread of the virus. As an unintended consequence, however, these school closures pose substantial challenges for the education system. The ensuing closure of government offices also poses increased risks to further implementation of several disbursement linked indicators. 4. A prolonged period of school closures puts hard-won gains in learning and enrolment at risk. First, students who are out of school tend to forget what they have learned. Given that students in Punjab on average learn 0.3 standard deviation of learning over six months of schooling, students are expected to lose 0.05 standard deviation of learning per month of closures without mitigation. Secondly, students are likely to drop out of school at higher rates, due to a variety of mechanisms, including health shocks, income effects, and the increased risk perception of schooling. This is likely to affect girls’ enrolments in particular, given families’ unequal intra- household expenditures. Private schools are also at risk of closure, given that they may not be able to collect tuition fees from families. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) 5. The School Education Department (SED) has been quick to launch an initial response to COVID-19 and the resulting school closures. Within only a few days of school closures, the SED launched a social media campaign with behavioral videos regarding handwashing and social distancing. Within two weeks after lockdown, the department launched the distance education program Taleem Ghar. This system provides animated lessons over television and online channels (including an app) within the regular curriculum for science and mathematics for grades 1-8. The department is currently engaged in planning of medium- and longer-term responses as the timeline for school closures is being progressively extended. 6. In the last few years, the Third Punjab Education Support Program (PESP-III) has built on a history of ambitious school reform projects, and is now in its fourth year of implementation, since September 2016. The project focuses on two main objectives, namely to improve school enrolment (participation and completion) and improving school quality (i.e. the teaching and learning environment). These goals are supported by 9 disbursement linked indicators that address a wide range of actions, namely (PBC-1) the use of vouchers to enroll more children, (PBC-2) expanding and improving the management of public-private partnerships, (PBC-3) stipends to keep girls in schools, (PBC-4) improved early childhood education, (PBC-5) better teacher recruitment, (PBC-6) improved teaching professional development, (PBC-7) student assessment, (PBC-8) non-salary budgets (NSB) managed at school level, and (PBC-9) data integration to improve the use of evidence in policy-making. 7. Progress towards the achievement of the Project Development Objective (PDO) and implementation progress are currently both rated as Satisfactory. Project implementation has picked up speed during and after the Mid-Term Review which took place in April 2019. School participation and primary school completion rates in the province have already increased dramatically, above and beyond the expected targets (with the exception of the participation indicator for boys 11-15 for which there is no specific intervention in the project). Moreover, the province has started key strategic initiatives to target the teaching and learning outcomes. These strategic initiatives include a new Continuous Professional Development (CPD) program for teachers that is based on observation and coaching of classroom practices. Early Childhood Education (ECE) is now receiving attention from high level policy makers, and the Program Management and Implementation Unit (PMIU) of the School Education Department (SED) has created a coordination cell to strengthen implementation of the new policy and curriculum. 8. Disbursement had already increased and is now at US$ 186.65m or 62% of the total US$300m. Last year, the project disbursed for 7 out of 9 PBCs, which included results for PBCs 1 (Vouchers, at 80% disbursement), 2 (Public-Private Partnerships, at 80% disbursement), 4 (Early Childhood Education, at 80% disbursement), 5 (Human Resources, at 80% disbursement), 8 (Non-Salary Budgets, at 80% disbursement) and 9 (Data Integration, at 80% disbursement). Implementation of PBC 6, which had not disbursed until June 2019, has made rapid strides following restructuring in June 2019, and now stands at 26% disbursement. 9. PBC 7 on student assessment, has remained unmet annually during project implementation. The government has used the past year to recalibrate its strategy regarding student assessment, resulting in the adoption of the new Assessment Policy Framework (APF). The APF sets out a new strategy around the student assessment, focusing on (1) large-scale, sample-based assessment, (2) school-based assessment of students in every grade, and (3) formative assessments to help diagnose and treat learning difficulties at an early stage. While introducing this new system, the province has decided to phase out the Grade 5 and Grade 8 exams, which was the focus of the PBC at project appraisal. Moreover, the PEC is planning to hire new staff, so that it has the right technical expertise to deliver on this new strategy. 10. The PBC 3 on Girls’ Stipends, which is at 53% disbursement, has not disbursed in Year 3, following a Third-Party Validation (TPV) that uncovered the difficulties in verifying the chain of data collection to disbursement. The existing procedure led to delays in disbursements of up to 18 months between enrolment and The World Bank Pakistan: Third Punjab Education Sector Project (P154524) funds being available to families. Further consultations revealed that the province has been developing multiple new data collection systems that remain scattered across different departments. While PBC 9 has supported on the integration of datasets, integration has mostly focused on the various school-level datasets, but not on the student-level stipend datasets. Over the last few years, however, a number of new applications have been developed that gather live data about students and teachers. These new applications generate data which are stored in separate systems, and are not designed to connect with each other. The Third-Party Validation found that only about a quarter of students can be verified between the different data systems that are in place. B. Rationale for restructuring 11. The proposed restructuring will introduce the following changes. First, there is a change in the scope and costs of the Technical Assistance component. Second, there is a change in the results of PBC 3, in order to speed up registrations and disbursements of the stipends. Third, there are changes in PBC 7 to bring the results in line with the new Assessment Policy Framework. Fourth, there are changes to PBC 1 (Vouchers), PBC 4 (Early Childhood Education), PBC 6 (Continuous Professional Development), and PBC 8 (Non-Salary Budgets), as well as related intermediate results indicators to accommodate the new reality due to COVID-19. Fifth, there is an update of the wording of PBCs 4 and 9 which were inconsistent between the PAD and the World Bank Operations Portal. 12. The government will need a larger Technical Assistance (TA) component to mobilize funds for its campaigns to respond to COVID-19. The Technical assistance component was relatively small (at US$9.36m or 3.1% of the total project budget) and has been largely spent and committed at this point. Additional TA-funds will be needed to mitigate risks to the school system because of the crisis, and to maintain the hard-won gains in learning and enrolment. The government will use TA funds to implement a program that responds to COVID-19, using the education system as a channel of information dissemination about the viral disease, providing distance education, and planning for social mobilization campaigns once schools re-open. 13. The increased TA will also help speed up project implementation once schools reopen. Having an increased TA will allow the project to strengthen technical support across the PBCs, particularly through hiring of local experts that can contribute to effective implementation. Moreover, the Government of Punjab will build capacity towards data warehousing and data usage, given the increase in the number of data-sources on education, as well as the number of apps being used throughout the school education department. Housing data centrally would give department more control over the data it currently collects and give it more flexibility to integrate different solutions. 14. PBC 3 on Girls’ Stipends is being revised in order to simplify the system of registration and disbursements. The COVID-19 pandemic has increased the urgency of vulnerable and cash-dependent families, while the current system cannot deliver the stipend rapidly. The main bottlenecks in the system are in the registration and verification protocols. The current system uses a registration procedure at Tehsil (regional) level, which involve long travel times for families and creates long waiting lines. There are many technical errors in the registration process, leading families to become ineligible for stipends. Moreover, registration for the current year has not been finished in all districts, given that the schools closed during the registration period. Due to the long waiting lines, it would be unsafe to do another registration campaign at tehsil level. Secondly, the system requires data to be shared between two government agencies (the SED and the PSPA), which use different data structures. The new system will simplify and integrate the registration, collection of payment information and verification of attendance, at the school level. 15. PBC 7 on student assessment is being restructured to align with the assessment policy framework which sets out an entirely different system of assessments. This new system focuses less on exams, which were The World Bank Pakistan: Third Punjab Education Sector Project (P154524) perceived as punitive to students and schools. Instead, the new system is more diagnostic and impactful. As these new assessment systems come into place, the Grade 5 and Grade 8 exams (which were the focus of the original PBC) are being phased out. The restructuring is seen as an opportunity to align student assessment more directly with initiatives to improve learning outcomes, in line with the PDO. First of all, the new assessment system will give the province the opportunity to track learning outcomes more directly through the large-scale assessment. Data will be available at student learning outcome level, and this information can be used to recalibrate teaching and learning materials. This data can be used by the province to adapt teaching and learning material. Secondly, the school-based exams will allow schools and teachers to communicate with relevant stakeholders about how much children learn throughout the year. For example, schools will create report cards which will be shared with parents so that they can track the progress made by their children in school. This approach has been rigorously tested and is shown to improve learning outcomes. Thirdly, the province will develop low-stakes, and informal methods of assessment, which can be used in the classroom by teachers. This aligns well with other initiatives. For instance, the teacher professional development system, which was strengthened in the previous restructuring, is developing a module on how teachers can regularly check whether students understand what is being taught. II. DESCRIPTION OF PROPOSED CHANGES A. Elements to the Restructuring 16. The Technical Assistance component will be allocated with additional US$12m, giving the department more room to maneuver. The scope of the technical assistance component is being amended in the financing agreement to expand the scope of how these funds can be used, and the funds will be implemented by the PMIU, using the existing financial management structures. Given that the PMIU has a long history in implementing large projects, there is adequate capacity to manage these additional resources. The funds are sourced from funds allocated to PBC 7 (reduction from US$32.21m to US$20.21m), as the PBC has been considerably reduced in scope. 17. Additional funds will be used for three main programs related to COVID-19. First of all, the department is coordinating a social mobilization campaign around good health behavior. This involves material development, social media campaigns and printing of materials. Secondly, the government is rolling out and expanding the Taleem Ghar program so that students can access lessons at home. The initial version of this program only covers mathematics and science, and as it rolls out, the Government of Punjab will add further material and a quality assurance system to this system. Thirdly, the government is planning re-enrolment campaigns to mobilize families and children once schools re-open, particularly targeting girls in the poorest performing 16 (program) districts across Punjab. 18. The Technical Assistance Component will also be used to improve implementation support and data warehousing and usage. Up to US$3m of TA funds will be used to procure more implementation support and technical expertise to speed up delivery. Secondly, up to US$5m will be used to procure and install a data center at the School Education Department. This will also include the creation of a data analytics and software development unit to increase data usage, as well as the procurement of a data integration system. This data center will collect, process and store data on schools, human resources in the school education system and students. Data being hosted will be protected and processed in accordance with international best practices regarding privacy and security. This data center will be housed in existing facilities. The PMIU will establish in-house capacity on matters of data protection and data management, and will hire an experienced procurement specialist to The World Bank Pakistan: Third Punjab Education Sector Project (P154524) manage the procurement of the data center. As a first step, PMIU will develop Operational Guidelines on how to implement the data center, and the protection of personal data. 19. PBC 3 on Girls’ Stipends is being revised in order to simplify the system of registration and disbursements. The province is currently developing a strategy for the simplification of the system. The new system will primarily rely on the school information system for registration, collection of payment information and verification of attendance. The school will also share the Khidmat cards (or equivalent) with the student’s family. Registration and attendance data will be shared on (at minimum) a weekly basis with the Punjab Social Protection Authority (PSPA), so that disbursements can happen regularly, and normally within one month of registration into the program. The PBC is being made scalable so that the results that have been achieved within each district can be disbursed against. 20. The PBC 7 is being revised to bring the actions in line with the new APF. The updated Results Framework is annexed to this proposal. Under the revised PBC, the results from the first three years are removed. In the fourth year, the province will develop an Institutional Strengthening Plan to accompany the APF; pilot a large-scale (sample-based) assessment; implement the first school-based assessment; and hire human resources in the Punjab Examination Commission. In the fifth year, the province will continue with this process, implement the large scale, sample-based assessment, and develop a strategy for formative assessments. Moreover, PBC 7 will be made scalable so that disbursements can follow each important step in implementation. While each step is crucial, there may be some delays in some of the results, which are sometimes beyond the control of the School Education Department or the Punjab Examination Commission. 21. Large volumes of personal data, personally identifiable information and sensitive data will be collected and used in connection with the management of the schooling system. This is being done under circumstances where measures to ensure the legitimate, appropriate and proportionate use and processing of that data may not feature in national law or data governance regulations, or be routinely collected and managed in school information systems. In order to guard against abuse of that data, the Project will incorporate good international practices for dealing with such data in such circumstances. Such measures may include data minimization (collecting only data that is necessary for the purpose); data accuracy (correct or erase data that are not necessary or are inaccurate), use limitations (data are only used for legitimate and related purposes), data retention (retain data only for as long as they are necessary), informing data subjects of use and processing of data, and allowing data subjects the opportunity to correct information about them, etc. In practical terms, the Government of Punjab will ensure that these principles apply through assessments of existing or development of new data governance mechanisms and data standards for education administration, data sharing protocols, rules or regulations, revision of relevant regulations, training, sharing of global experience, unique identifiers for students and teachers, strengthening of school information systems, etc. B. Changes to the Results Framework 22. The results for PBCs 1 (Vouchers) and 4 (Early Childhood Education) are revised downwards for Year 4, given the extended closure of schools due to COVID-19 pandemic. The following changes are highlighted: a) PBC 1 (Vouchers): The target for Year 4 is revised downwards to 90,000 (from 270,000) additional students in the Voucher Program (this number is cumulative since the beginning of the project, above and beyond the baseline of 322,679). The end target is reduced to 150,000 (from 420,000), above and beyond the baseline of 322,679. The same is reflected in a downwards revision of intermediate results indicators. This is due to anticipated school closures in the private sector as a result of the COVID-19 pandemic. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) b) PBC 4 (Early Childhood Education): There is a reduction in the target for Year 4 from 4,500 schools to 3,800 schools, due to COVID-19 related school closures, which presents difficulties to upgrade quality standards. The result for Year 5 (7,000 school meet the quality standards) is being maintained, given that implementation can pick up as soon as schools reopen. The verification protocol has been modified to allow for trainings to teachers and care-givers to be provided through distance education. This PBC has also been updated in the World Bank Operations Portal to match the PAD. c) PBC 6 (Teacher Professional Development): The training and verification activities in this PBC will be done through distance protocols. d) PBC 8 (Non-Salary Budgets): The word ‘bi-annually’ is being removed in order to allow more flexibility in disbursement periods. e) PBC 9 (Data Integration): This PBC has been updated in the World Bank Operations Portal to match the PAD. These changes are not expected to impact the PDO substantially, given the planned mitigation strategies for re- enrolment campaigns once schools re-open. 23. There are no major changes to the implementation system. The project continues to be implemented by the Punjab of Education Sector Reforms Program (PESRP) Project Management Implementation Unit (PMIU) under the School Education Department (SED). The name of the implementing agency has been clarified in the World Bank Operations Portal, to clarify that the implementation mechanism is part of the Government of Punjab. The Financial Management arrangements will remain the same, while procurement capacity will be strengthened by the hiring of a specific procurement specialist who will lead the procurement of the data center, as described above. 24. The overall project risk remains Moderate. The leadership of the associated departments of the School Education Department, including the PMIU, have been able to continue functioning throughout the pandemic period. That being said, the leadership and technical staff of several associated departments has been placed on a break period during the pandemic period, and this leads to some implementation challenges. This causes the risk to institutional capacity for implementation to be increased to Substantial. III. SUMMARY OF CHANGES Changed Not Changed Implementing Agency ✔ Results Framework ✔ PBCs ✔ Components and Cost ✔ Reallocation between Disbursement Categories ✔ Overall Risk Rating ✔ DDO Status ✔ Project's Development Objectives ✔ The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Loan Closing Date(s) ✔ Cancellations Proposed ✔ Disbursements Arrangements ✔ Disbursement Estimates ✔ Safeguard Policies Triggered ✔ EA category ✔ Legal Covenants ✔ Institutional Arrangements ✔ Financial Management ✔ Procurement ✔ Implementation Schedule ✔ Other Change(s) ✔ Economic and Financial Analysis ✔ Technical Analysis ✔ Social Analysis ✔ Environmental Analysis ✔ IV. DETAILED CHANGE(S) OPS_DETAILEDCHANGES_IA_TABLE IMPLEMENTING AGENCY Implementing Agency Name Type Action School Education Department Implementing Marked for Deletion Agency PESRP, School Education Department, Implementing New Government of Punjab Agency OPS_DETAILEDCHANGES_COMPONENTS_TABLE COMPONENTS Current Current Proposed Proposed Cost Action Component Name Component Name Cost (US$M) (US$M) Component 1: Improved access, Component 1: Improved quality and education system 290.00 Revised access, quality and education 278.00 management system management The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Component 2: Capacity Building, Component 2: Capacity Project Management, 10.00 Revised Building, Project Management, 22.00 Monitoring, and Evaluation Monitoring, and Evaluation TOTAL 300.00 300.00 OPS_DETAILEDCHANGES_REALLOCATION _TABLE REALLOCATION BETWEEN DISBURSEMENT CATEGORIES Financing % Current Allocation Actuals + Committed Proposed Allocation (Type Total) Current Proposed IBRD-86200-001 | Currency: USD iLap Category Sequence No: 1 Current Expenditure Category: EEP Part 1 289,890,000.00 180,390,000.00 277,890,000.00 100.00 100.00 iLap Category Sequence No: 2 Current Expenditure Category: GD,NonCS,CS,Trng,IOC Pt2(a) 9,360,000.00 5,080,767.00 16,360,000.00 100.00 100.00 iLap Category Sequence No: 3 Current Expenditure Category: GD,NONCS,CS,Trng,IOC Pt2(b) 0.00 0.00 5,000,000.00 100 Total 299,250,000.00 185,470,767.00 299,250,000.00 OPS_DETAILEDCHANGES_SORT_TABLE SYSTEMATIC OPERATIONS RISK-RATING TOOL (SORT) Risk Category Rating at Approval Current Rating Political and Governance Substantial Substantial Macroeconomic Substantial Substantial Sector Strategies and Policies Moderate Moderate Technical Design of Project or Program Moderate Moderate Institutional Capacity for Implementation and Moderate Substantial Sustainability The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Fiduciary Moderate Moderate Environment and Social Low Moderate Stakeholders Moderate Moderate Other Substantial Substantial Overall Moderate Moderate . The World Bank Pakistan: Third Punjab Education Sector Project (P154524) . Results framework COUNTRY: Pakistan Pakistan: Third Punjab Education Sector Project Project Development Objectives(s) The project development objective is to support Punjab province to improve school participation, completion, and teaching-learning practices with a particular focus on low-performing districts. Project Development Objective Indicators by Objectives/ Outcomes RESULT_FRAME_TBL_PDO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 To improve school participation Participation Rate (Percentage) 75.80 75.80 75.80 77.00 77.00 79.00 Participation rate, boys (6- 85.40 85.40 85.40 86.00 86.00 87.00 10 years) (Percentage) Participation rate, girls (6-10 77.80 77.80 77.80 79.00 79.00 80.00 years) (Percentage) Participation rate, boys (11- 75.40 75.40 75.40 77.00 77.00 79.00 15 years) (Percentage) Participation rate, girls (11- 64.60 64.60 64.60 66.00 66.00 68.00 15 years) (Percentage) Participation rate, poor- performing districts 68.50 68.50 68.50 70.00 70.00 73.00 (Percentage) To improve school completion Completion rate, grade 5 67.00 68.00 70.00 (Percentage) The World Bank Pakistan: Third Punjab Education Sector Project (P154524) RESULT_FRAME_TBL_PDO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 Completion rate, grade 5, 66.00 66.00 66.00 67.00 67.00 69.00 girls (Percentage) Completion rate, Grade 5, 69.00 70.00 70.00 70.00 70.00 71.00 boys (Percentage) To improve teaching-learning practices Quality score of primary teaching-learning practices 2.53 2.53 2.53 2.53 2.53 2.65 (Number) Level of School Readiness 0.00 0.00 0.00 0.00 0.00 6.00 (Percentage) PDO Table SPACE Intermediate Results Indicators by Components RESULT_FRAME_TBL_IO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 Component 1: Improved access, quality and education system management (Action: This Component has been Revised) Number of additional children aged 6-16 years to whom a voucher is provided to pay low- 0.00 0.00 10,000.00 130,000.00 90,000.00 150,000.00 cost private school tuition fees (Number) Rationale: Action: This indicator has been This is being revised downwards given the expected negative effect of COVID-19 related school closures on low-cost private sector schools. Revised The World Bank Pakistan: Third Punjab Education Sector Project (P154524) RESULT_FRAME_TBL_IO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 Number of additional boys aged 6-16 years to whom a voucher is provided to pay 0.00 0.00 5,000.00 65,000.00 45,000.00 75,000.00 low-cost private school tuition fees (Number) Rationale: Action: This indicator has This is being revised downwards given the expected negative effect of COVID-19 related school closures on low-cost private sector schools. been Revised Number of additional girls aged 6-16 years to whom a voucher is provided to pay 0.00 0.00 5,000.00 65,000.00 45,000.00 75,000.00 low-cost private school tuition fees (Number) Rationale: Action: This indicator has This is being revised downwards given the expected negative effect of COVID-19 related school closures on low-cost private sector schools. been Revised Number of additional schools covered by PPP initiatives supported by PEF under a 0.00 225.00 450.00 675.00 700.00 750.00 quality assurance system (Number) Rationale: Action: This indicator has been This is being revised downwards given the expected negative effect of COVID-19 related school closures on low-cost private sector schools. Revised Number of additional children enrolled in PPP initiatives 0.00 180,000.00 360,000.00 540,000.00 720,000.00 900,000.00 supported by PEF under a The World Bank Pakistan: Third Punjab Education Sector Project (P154524) RESULT_FRAME_TBL_IO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 quality assurance system (Number) Number of additional boys enrolled in PPP initiatives supported by PEF under a 0.00 90,000.00 180,000.00 270,000.00 360,000.00 450,000.00 quality assurance system (Number) Number of additional girls enrolled in PPP initiatives supported by PEF under a 0.00 90,000.00 180,000.00 270,000.00 360,000.00 450,000.00 quality assurance system (Number) Number of children aged 3-5 years enrolled in an ECE 0.00 0.00 30,000.00 75,000.00 100,000.00 210,000.00 classroom that meets quality standards (Number) Action: This indicator has been Revised Number of boys aged 3-5 years enrolled in an ECE 0.00 0.00 5,000.00 37,500.00 50,000.00 105,000.00 classroom that meets quality standards (Number) Action: This indicator has been Revised Number of girls aged 3-5 years enrolled in an ECE 0.00 0.00 15,000.00 37,500.00 50,000.00 105,000.00 classroom that meets quality standards (Number) The World Bank Pakistan: Third Punjab Education Sector Project (P154524) RESULT_FRAME_TBL_IO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 Action: This indicator has been Revised Percentage of new teachers recruited based on merit, for all vacant posts reallocated to 100.00 100.00 100.00 100.00 100.00 100.00 schools as per recruitment policy (Percentage) Number of districts implementing the 0.00 0.00 0.00 0.00 6.00 12.00 strengthened field-based CPD (Number) School-based assessment of Grade 5 PEC has developed an continues and one Institutional additional grade is Strengthening Plan, has implemented in all 36 hired staff in vacant Districts, PEC has PEC instruments do not positions in the revised developed an use equated items and HR plan, has Strengthened student assessment framework PEC reuslts from previous measure higher-order implemented school assessment system is being that can be used to year are analyzed and PBC 7 cognitive skills, and based assessment of implemented across the develop future disseminated in results are not Grade 5 in 36 districts, province (Text) assessments., has actionable form disseminated in based on an Item Bank, implemented a sample- actionable form and has piloted a based assessment in sample-based Grade 5, representative assessment instrument at the district level and in Grade 5 classrooms. results have been disseminated in actionable format, and The World Bank Pakistan: Third Punjab Education Sector Project (P154524) RESULT_FRAME_TBL_IO Indicator Name PBC Baseline Intermediate Targets End Target 1 2 3 4 has developed a strategy for formative assessments. Action: This indicator has been Revised Number of School Council members reached through 80,000.00 80,000.00 96,000.00 128,000.00 212,000.00 212,000.00 citizen engagement initiative(s) (Number) Non-salary budget execution 64.00 64.00 64.00 66.00 66.00 69.00 rate (Percentage) Component 2: Capacity Building, Project Management, Monitoring, and Evaluation Number of EDOs-Education that analyze and act on revised district education report card 0.00 3.00 12.00 36.00 36.00 36.00 generated from integrated database (Number) IO Table SPACE The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Performance-Based Conditions Matrix DLI IN00816855 ACTION DLI 1: Private school vouchers Strengthening program design to expand coverage of tuition-replacement vouchers to PBC 1 children from disadvantaged households Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Outcome No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula • Vouchers to attend private schools provided to 322,679 children from disadvantaged households • The program has undergone rapid expansion, Baseline and present design features need to be revisited to ensure more effective beneficiary selection and monitoring Revised EVS system in place; and PEF initiates 2016-17 8,590,000.00 pilot for EVS 10,000 Eligible Children received vouchers to 2017-18 attend private schools; and PEF’s Board of 8,590,000.00 Directors approved the Revised System for EVS. 130,000 Eligible Children received vouchers to 2018-19 8,590,000.00 attend private schools. 270,000 Eligible Children received vouchers to 2019-20 3,220,000.00 attend private schools. 420,000 Eligible Children received vouchers to 2020-21 3,220,000.00 attend private schools. Action: This PBC has been Revised. See below. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00829333 ACTION DLI 1: Private school vouchers Strengthening program design to expand coverage of tuition-replacement vouchers to PBC 1 children from disadvantaged households Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Outcome No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula • Vouchers to attend private schools provided to 322,679 children from disadvantaged households • The program has undergone rapid expansion, Baseline and present design features need to be revisited to ensure more effective beneficiary selection and monitoring Revised EVS system in place; and PEF initiates 2016-17 8,590,000.00 pilot for EVS 10,000 Eligible Children received vouchers to 2017-18 attend private schools; and PEF’s Board of 8,590,000.00 Directors approved the Revised System for EVS. 130,000 Eligible Children received vouchers to 2018-19 8,590,000.00 attend private schools. 90,000 Eligible Children received vouchers to 2019-20 3,220,000.00 attend private schools. 150,000 Eligible Children received vouchers to 2020-21 3,220,000.00 attend private schools. Rationale: Targets for this DLI are being revised downwards, given the negative effects of COVID-19 related school closures on private schools, particularly in the poorest areas where voucher-schools operate. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00816856 ACTION PBC 2 DLI 2. Public-private partnerships in education Leveraging the private sector to support schools to increase enrollment Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula Currently 1.3 million children are studying in PEF partner schools through the NSP and FAS. Baseline Capacity to enroll additional children through PPPs remains 180,000 children are enrolled through Public- Private Partnerships under PEF approved 2016-17 8,590,000.00 programs that have a Strengthened Quality Assurance System. 360,000 children are enrolled through Public- Private Partnerships under PEF approved 2017-18 8,590,000.00 programs that have a Strengthened Quality Assurance System. 540,000 children are enrolled through Public- Private Partnerships under PEF approved 2018-19 8,590,000.00 programs that have a Strengthened Quality Assurance System. 720,000 children are enrolled through Public Private Partnerships under PEF approved 2019-20 3,220,000.00 programs that have a Strengthened Quality Assurance System. 900,000 children are enrolled through Public Private Partnerships under PEF approved 2020-21 3,220,000.00 programs that have a Strengthened Quality Assurance System. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00816857 ACTION DLI 3. Stipends for secondary school girls Stipends for secondary school girls to increase secondary school PBC 3 participation/retention Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output No Text 32,210,000.00 53.34 Period Value Allocated Amount (USD) Formula Stipends are offered to girls enrolled in secondary grades in 16 districts under the original program. Baseline The stipend amount and conditions have remained unchanged since program inception. SED has strengthened its original program and is 2016-17 8,590,000.00 implementing it in 16 Districts. SED continues to implement the strengthened 2017-18 8,590,000.00 program in 16 Districts SED continues to implement the strengthened 2018-19 8,590,000.00 program in 16 Districts SED continues to implement the strengthened 2019-20 3,220,000.00 program in 16 Districts SED continues to implement the strengthened 2020-21 3,220,000.00 program in 16 Districts Action: This PBC has been Revised. See below. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00837670 ACTION DLI 3. Stipends for secondary school girls Stipends for secondary school girls to increase secondary school PBC 3 participation/retention Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output Yes Text 32,210,000.00 53.34 Period Value Allocated Amount (USD) Formula Stipends are offered to girls enrolled in secondary grades in 16 districts under the original program. Baseline The stipend amount and conditions have remained unchanged since program inception. SED has strengthened its original program and is 2016-17 8,590,000.00 implementing it in 16 Districts. SED continues to implement the strengthened 2017-18 8,590,000.00 program in 16 Districts 2018-19 0.00 (i) SED has adopted a strategy to simplify and strengthen the implementation of the stipend program and (ii) SED has disbursed stipends to (i) $3m (ii) $0.1m per district (iii) 2019-20 6,200,000.00 continuously registered students in 16 districts. $0.1m per district (iii) SED has disbursed stipends to newly registered students in 16 districts. (i) SED has registered new students through school-based enrolments and issuance of payment cards, and (ii) SED has disbursed stipends to (i)$2.43m (ii) $0.2m per district (iii) 2020-21 8,830,000.00 continuously registered students in 16 districts. $0.2m per district (iii) SED has disbursed stipends to newly registered students in 16 districts, with 80% of The World Bank Pakistan: Third Punjab Education Sector Project (P154524) first payments occurring within 1 month of registration. DLI IN00816858 ACTION PBC 4 DLI 4: Early childhood education Improving quality and expanding access to early childhood education Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Outcome No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula ECE is currently being implemented at a small Baseline scale SED has started implementation of its 2016-17 recruitment policy for Merit-Based Recruitment 8,590,000.00 of new teachers and reallocation of posts SED continues to implement its recruitment policy for Merit-Based Recruitment of new teachers and reallocation of posts. Third-party validation of the 2017-18 8,590,000.00 SED’s recruitment policy for Merit Based Recruitment of new teachers and reallocation of posts completed SED continues to implement its recruitment policy 2018-19 for Merit-Based Recruitment of new teachers and 8,590,000.00 reallocation of posts. SED continues to implement its recruitment policy 2019-20 for Merit-Based Recruitment of new teachers and 3,220,000.00 reallocation of posts. SED continues to implement its recruitment policy 2020-21 for Merit-Based Recruitment of new teachers and 3,220,000.00 reallocation of posts Action: This PBC has been Revised. See below. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00827207 ACTION PBC 4 DLI 4: Early childhood education Improving quality and expanding access to early childhood education Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Outcome No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula ECE is currently being implemented at a small Baseline scale SED has approved the ECE Policy Framework, 2016-17 which includes Quality Standards for ECE 8,590,000.00 classrooms. 1,000 schools have classrooms that meet the 2017-18 Quality Standards prescribed by the ECE Policy 8,590,000.00 Framework. 2,500 schools have classrooms that meet the Quality Standards prescribed by the ECE Policy 2018-19 Framework; and 50 schools have started 8,590,000.00 implementation of District health/ nutrition officers pilot. 3,800 schools have classrooms that meet the 2019-20 Quality Standards prescribed by the ECE Policy 3,220,000.00 Framework. 7,000 schools have classrooms that meet the 2020-21 Quality Standards prescribed by the ECE Policy 3,220,000.00 Framework. Rationale: Target for year 4 is being revised downwards given COVID-19 related school closures. Verification protocol modified to allow for online delivery of training during COVID-19 related school closures. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00816859 ACTION DLI 5: Human Resources Management Strengthening HR processes through continuous merit-based recruitment and PBC 5 rationalization of teaching posts Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Process No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula Merit-based recruitment of new teachers for all Baseline vacant posts reallocated to schools based on existing recruitment policy SED has started implementation of its 2016-17 recruitment policy for Merit-Based Recruitment 8,590,000.00 of new teachers and reallocation of posts. SED continues to implement its recruitment policy for Merit-Based Recruitment of new teachers and reallocation of posts. Third-party validation of the 2017-18 8,590,000.00 SED’s recruitment policy for Merit Based Recruitment of new teachers and reallocation of posts completed. SED continues to implement its recruitment policy 2018-19 for Merit-Based Recruitment of new teachers and 8,590,000.00 reallocation of posts. SED continues to implement its recruitment policy 2019-20 for Merit-Based Recruitment of new teachers and 3,220,000.00 reallocation of posts. SED continues to implement its recruitment policy 2020-21 for Merit-Based Recruitment of new teachers and 3,220,000.00 reallocation of posts. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00816860 ACTION PBC 6 DLI 6. Quality in the primary classroom Strengthening field- based CPD for improved teacher performance Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Outcome No Text 32,210,000.00 0.00 Period Value Allocated Amount (USD) Formula Field-based system of CPD has mixed operational Baseline capacity and performance, and poor design match with multigrade and large class teaching. 2016-17 0.00 2017-18 0.00 Innovative support package is designed; AEOs task description is revised and AEOs start 2018-19 8,590,000.00 conducting classroom observations through android app. Training of Primary School Teachers (as per revamped CPD design) conducted in 06 Districts Innovative support package is developed, 2019-20 11,810,000.00 validated and pilot initiated in 100 schools; QAED has trained AEOs (or equivalent) on classroom observation and feedback provision. Training of Primary School Teachers (as per revamped CPD design) conducted in 12 Districts. 2020-21 QAED has incorporated successful elements of 11,810,000.00 innovative support package into the regular CPD program; Action: This PBC has been Revised. See below. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00829332 ACTION PBC 6 DLI 6. Quality in the primary classroom Strengthening field- based CPD for improved teacher performance Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Outcome No Text 32,210,000.00 0.00 Period Value Allocated Amount (USD) Formula Field-based system of CPD has mixed operational Baseline capacity and performance, and poor design match with multigrade and large class teaching. 2016-17 0.00 2017-18 0.00 Innovative support package is designed; AEOs task description is revised and AEOs start 2018-19 8,590,000.00 conducting classroom observations through android app. Training of Primary School Teachers (as per revamped CPD design) conducted in 06 Districts Innovative support package is developed, 2019-20 11,810,000.00 validated and pilot initiated in 100 schools; QAED has trained AEOs (or equivalent) on classroom observation and feedback provision. Training of Primary School Teachers (as per revamped CPD design) conducted in 12 Districts. 2020-21 QAED has incorporated successful elements of 11,810,000.00 innovative support package into the regular CPD program; Rationale: Verification protocol modified to allow for online delivery of teacher training during COVID-19 related school closures. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00816861 ACTION PBC 7 DLI 7. Student Assessment PEC and its instruments strengthened within a revised policy framework Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Intermediate Outcome No Text 32,210,000.00 0.00 Period Value Allocated Amount (USD) Formula No assessment policy framework; outdated PEC Baseline ISP that has been partially implemented and is in need of revision. PEC has developed the its assessment policy framework; and The new PEC Institutional 2016-17 8,590,000.00 Strengthening Plan has been approved by the commission overseeing PEC. 80% of ISP targets for 2017-18 are met; and 2017-18 strengthened Grade 5 + 8 PEC instruments are 8,590,000.00 piloted in at least one subject 80% of ISP targets for 2018-19 are met; and strengthened Grade 5 + 8 PEC instruments are 2018-19 8,590,000.00 administered throughout the entire Punjab school system PEC has analyzed and reported Grade 5+8 PEC 2019-20 results from the previous year of Project 3,220,000.00 implementation in Actionable Form. PEC has analyzed and reported Grade 5 + 8 PEC 2020-21 results for the previous year of Project 3,220,000.00 implementation in Actionable Form. Action: This PBC has been Revised. See below. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00827208 ACTION PBC 7 DLI 7. Student Assessment PEC and its instruments strengthened within a revised policy framework Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Intermediate Outcome Yes Text 20,210,000.00 0.00 Period Value Allocated Amount (USD) Formula No assessment policy framework; outdated PEC Baseline ISP that has been partially implemented and is in need of revision. 2016-17 0.00 2017-18 0.00 2018-19 0.00 PEC has: (i) developed an Institutional Strengthening Plan; (ii)hired staff in vacant positions in the revised Human Resources plan; $2m for (i); $5m for(ii); $2m for (iii); 2019-20 (iii) has implemented school-based assessment of 10,000,000.00 and $1m for (iv). Grade 5 in 36 districts based on a ‘Test Item Bank’; and (iv) has piloted a sample-based assessment instrument in Grade 5 classrooms. PEC has: (i) continued school-based assessment of Grade 5 and has implemented one additional grade in all 36 Districts; (ii) developed an assessment framework that can be used to $2m for (i); $2m for (ii); $3,21m 2020-21 10,210,000.00 develop future assessments; (iii) implemented a for(iii); and $3m for (iv) sample-based assessment in Grade 5, representative at the district level and has disseminated its results in actionable format; and The World Bank Pakistan: Third Punjab Education Sector Project (P154524) (iv) developed a strategy for formative student assessments. Rationale: This is being revised in light of the new Assessment Policy Framework of the province. DLI IN00816862 ACTION PBC 8 DLI 8. School specific NSB Setting and executing school budgets in line with school resource needs Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula School-specific NSBs for FY2015/16 prepared in accordance with agreed funding formula, and Baseline submitted for inclusion in FY2016/17 district budgets in 36 districts for all schools, including high/high secondary. SED has prepared School-Specific Non-Salary Budgets for FY2016/17 in accordance with agreed funding formula, and submitted for inclusion in FY2017/18 District budgets in 36 Districts for all schools, including high/high secondary; and 2016-17 Punjab’s Finance Department has dispersed 8,590,000.00 School Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution; and SCs reconstituted in required elementary/primary schools and constituted in all high schools SED has prepared School-Specific Non-Salary 2017-18 Budgets for FY2017/18 in accordance with agreed 8,590,000.00 funding formula, and submitted for inclusion in The World Bank Pakistan: Third Punjab Education Sector Project (P154524) FY2018/19 District budgets in 36 Districts for all schools, including high/high secondary; and Punjab’s Finance Department has dispersed School Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution. SED has prepared School-Specific Non-Salary Budgets for FY2018/19 in accordance with agreed funding formula, and submitted for inclusion in FY2019/20 District budgets in 36 Districts for all schools, including high/high secondary; and 2018-19 8,590,000.00 Punjab’s Finance Department has dispersed School-Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution; and TPV of Year 1 and Year 2 of this DLI completed. SED has prepared School-Specific Non-Salary Budgets for FY2019/20 in accordance with agreed funding formula, and submitted for inclusion in FY2020/21 District budgets in 36 District for all 2019-20 schools, including high/high secondary; and 3,220,000.00 Punjab’s Finance Department has dispersed School-Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution. SED has prepared School-Specific Non-Salary Budgets for FY2020/21 in accordance with agreed funding formula, and submitted for inclusion in 2020-21 FY2020/21 District budgets in 36 Districts for all 3,220,000.00 schools, including high/high secondary; and Punjab’s Finance Department has dispersed School-Specific Non-Salary Budgets bi-annually to The World Bank Pakistan: Third Punjab Education Sector Project (P154524) schools with establishment of Necessary Support Structure for execution. Action: This PBC has been Revised. See below. DLI IN00837604 ACTION PBC 8 DLI 8. School specific NSB Setting and executing school budgets in line with school resource needs Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula School-specific NSBs for FY2015/16 prepared in accordance with agreed funding formula, and Baseline submitted for inclusion in FY2016/17 district budgets in 36 districts for all schools, including high/high secondary. SED has prepared School-Specific Non-Salary Budgets for FY2016/17 in accordance with agreed funding formula, and submitted for inclusion in FY2017/18 District budgets in 36 Districts for all schools, including high/high secondary; and 2016-17 Punjab’s Finance Department has dispersed 8,590,000.00 School Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution; and SCs reconstituted in required elementary/primary schools and constituted in all high schools SED has prepared School-Specific Non-Salary Budgets for FY2017/18 in accordance with agreed 2017-18 funding formula, and submitted for inclusion in 8,590,000.00 FY2018/19 District budgets in 36 Districts for all schools, including high/high secondary; and The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Punjab’s Finance Department has dispersed School Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution. SED has prepared School-Specific Non-Salary Budgets for FY2018/19 in accordance with agreed funding formula, and submitted for inclusion in FY2019/20 District budgets in 36 Districts for all schools, including high/high secondary; and 2018-19 8,590,000.00 Punjab’s Finance Department has dispersed School-Specific Non-Salary Budgets bi-annually to schools with establishment of Necessary Support Structure for execution; and TPV of Year 1 and Year 2 of this DLI completed. SED has prepared School-Specific Non-Salary Budgets for FY2019/20 in accordance with agreed funding formula, and submitted for inclusion in FY2020/21 District budgets in 36 District for all 2019-20 schools, including high/high secondary; and 3,220,000.00 Punjab’s Finance Department has dispersed School-Specific Non-Salary Budgets to schools with establishment of Necessary Support Structure for execution. SED has prepared School-Specific Non-Salary Budgets for FY2020/21 in accordance withagreed funding formula, and submitted for inclusion in FY2020/21 District budgets in 36 Districts for all 2020-21 schools, including high/high secondary; 3,220,000.00 andPunjab’s Finance Department has dispersed School-Specific Non-Salary Budgets to schools with establishment of Necessary Support Structure for execution. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI IN00816863 ACTION DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based PBC 9 decision-making Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Intermediate Outcome No Text 32,212,000.00 80.00 Period Value Allocated Amount (USD) Formula Last private school census was in 2010-11. Various education sector data are not integrated, Baseline utilization of data remains low and restricted to source departments. SED has conducted a private school census; and PMIU has prepared and delivered on a semi- 2016-17 annual basis District performance report cards for 8,590,000.00 Year 1 following agreed format and contents, to District Education Administrations. PMIU has integrated Education sector data (from PEC, PMIU, DSD and PEF); and PMIU provided access and orientation to the integrated database to education departments and District education 2017-18 officials in 3 Districts; PMIU has prepared and 8,590,000.00 delivered on a semiannual basis District performance report cards for Year 2 following agreed format and contents, to District Education Administrations PMIU has integrated Education sector data (from PEC, PMIU,DSD, and PEF); and PMIU has provided access and orientation to the integrated database 2018-19 8,590,000.00 to education departments and District education officials in 12 Districts; PMIU has prepared and delivered on a semi-annual basis District The World Bank Pakistan: Third Punjab Education Sector Project (P154524) performance report cards for Year 3 following agreed format and contents, to District Education Administrations. PMIU has integrated Education sector data (from PEC, PMIU,DSD, and PEF) ; and PMIU has provided access and orientationto the integrated database to education departments and District 2019-20 education officials in 36 Districts; PMIU has 3,222,000.00 prepared and delivered on a semi-annual basis District performance report cards for Year 4 following agreed format and contents,to District Education Administrations PMIU has integrated Education sector data (from PEC, PMIU, DSD, and PEF) ; and PMIU has provided access and orientation to the integrated database to education departments and District 2020-21 education officials in 36 Districts; PMIU has 3,220,000.00 prepared and delivered on a semiannual basis District performance report cards for Year 5 following agreed format and contents, to District Education Administrations Action: This PBC has been Revised. See below. DLI IN00847245 ACTION DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based PBC 9 decision-making Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Intermediate Outcome No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Last private school census was in 2010-11. Various education sector data are not integrated, Baseline utilization of data remains low and restricted to source departments. SED has conducted a private school census; and PMIU has prepared and delivered on a semi- 2016-17 annual basis District performance report cards for 8,590,000.00 Year 1 following agreed format and contents, to District Education Administrations. PMIU has integrated Education sector data (from PEC, PMIU, DSD and PEF); and PMIU provided access and orientation to the integrated database to education departments and District education 2017-18 officials in 3 Districts; PMIU has prepared and 8,590,000.00 delivered on a semiannual basis District performance report cards for Year 2 following agreed format and contents, to District Education Administrations PMIU has integrated Education sector data (from PEC, PMIU,DSD, and PEF); and PMIU has provided access and orientation to the integrated database to education departments and District education 2018-19 officials in 12 Districts; PMIU has prepared and 8,590,000.00 delivered on a semi-annual basis District performance report cards for Year 3 following agreed format and contents, to District Education Administrations. PMIU has integrated Education sector data (from PEC, PMIU,DSD, and PEF) ; and PMIU has provided 2019-20 access and orientationto the integrated database 3,220,000.00 to education departments and District education officials in 36 Districts; PMIU has prepared and The World Bank Pakistan: Third Punjab Education Sector Project (P154524) delivered on a semi-annual basis District performance report cards for Year 4 following agreed format and contents,to District Education Administrations PMIU has integrated Education sector data (from PEC, PMIU, DSD, and PEF) ; and PMIU has provided access and orientation to the integrated database to education departments and District 2020-21 education officials in 36 Districts; PMIU has 3,220,000.00 prepared and delivered on a semiannual basis District performance report cards for Year 5 following agreed format and contents, to District Education Administrations DLI IN00847252 ACTION DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based PBC 9 decision-making Type of PBC Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Intermediate Outcome No Text 32,210,000.00 80.01 Period Value Allocated Amount (USD) Formula Last private school census was in 2010-11. Various education sector data are not integrated, Baseline utilization of data remains low and restricted to source departments. SED has conducted a private school census; and PMIU has prepared and delivered on a semi- 2016-17 annual basis District performance report cards for 8,590,000.00 Year 1 following agreed format and contents, to District Education Administrations. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) PMIU has integrated Education sector data (from PEC, PMIU, DSD and PEF); and PMIU provided access and orientation to the integrated database to education departments and District education 2017-18 officials in 3 Districts; PMIU has prepared and 8,590,000.00 delivered on a semiannual basis District performance report cards for Year 2 following agreed format and contents, to District Education Administrations PMIU has integrated Education sector data (from PEC, PMIU,DSD, and PEF); and PMIU has provided access and orientation to the integrated database to education departments and District education 2018-19 officials in 12 Districts; PMIU has prepared and 8,590,000.00 delivered on a semi-annual basis District performance report cards for Year 3 following agreed format and contents, to District Education Administrations. PMIU has integrated Education sector data (from PEC, PMIU,DSD, and PEF) ; and PMIU has provided access and orientationto the integrated database to education departments and District education 2019-20 officials in 36 Districts; PMIU has prepared and 3,220,000.00 delivered on a semi-annual basis District performance report cards for Year 4 following agreed format and contents,to District Education Administrations PMIU has integrated Education sector data (from PEC, PMIU, DSD, and PEF) ; and PMIU has provided access and orientation to the integrated 2020-21 3,220,000.00 database to education departments and District education officials in 36 Districts; PMIU has prepared and delivered on a semiannual basis The World Bank Pakistan: Third Punjab Education Sector Project (P154524) District performance report cards for Year 5 following agreed format and contents, to District Education Administrations Verification Protocol Table: Performance-Based Conditions DLI_TBL_VERIFICATION DLI 1: Private school vouchers Strengthening program design to expand coverage of tuition-replacement vouchers to PBC 1 children from disadvantaged households Definitions All targets are cumulative and are in addition to the number of children attending the EVS schools as captured in the baseline. In the LPDs and included in the targets for DLIs 1 and 2 (under the EVS and PPP Programs), the cumulative number of children who were previously out of school will be not less than 150,000 by year 5 Pilot initiated is defined as vouchers distributed to households under the revised system Description The revised system includes revised beneficiary targeting and validation system, and improved monitoring system includes quarterly monitoring of partner schools “Eligible Children” refers to those children who would be able to participate in the EVS as defined by the PEF Board of Directors’ criteria for eligibility. PEF Data source/ Agency PMIU Verification Entity Evidence (a) Database of registered voucher recipients (with unique identifiers) (b) database of partner schools (with unique identifiers) (c) expenditures under the vouchers program, in agreed format Procedure QAT and monitoring database of schools and beneficiaries with unique identifiers Approval by the PEF’s board of directors will be evidenced with official board minutes. Evidence provided by the PEF to the PMIU The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI_TBL_VERIFICATION DLI 1: Private school vouchers Strengthening program design to expand coverage of tuition-replacement vouchers to PBC 1 children from disadvantaged households Definitions All targets are cumulative and are in addition to the number of children attending the EVS schools as captured in the baseline. In the LPDs and included in the targets for DLIs 1 and 2 (under the EVS and PPP Programs), the cumulative number of children who were previously out of school will be not less than 150,000 by year 5 Pilot initiated is defined as vouchers distributed to households under the revised system Description The revised system includes revised beneficiary targeting and validation system, and improved monitoring system includes quarterly monitoring of partner schools “Eligible Children” refers to those children who would be able to participate in the EVS as defined by the PEF Board of Directors’ criteria for eligibility. PEF Data source/ Agency PMIU Verification Entity Evidence (a) Database of registered voucher recipients (with unique identifiers) (b) database of partner schools (with unique identifiers) (c) expenditures under the vouchers program, in agreed format Procedure QAT and monitoring database of schools and beneficiaries with unique identifiers Approval by the PEF’s board of directors will be evidenced with official board minutes. Evidence provided by the PEF to the PMIU DLI_TBL_VERIFICATION PBC 2 DLI 2. Public-private partnerships in education Leveraging the private sector to support schools to increase enrollment Definitions All targets are cumulative, and are over and above the 1.3 million baseline. In the LPDs and included in the targets for DLIs 1 and 2 (under the EVS and PPP programs), the cumulative number of children who were previously out of Description school will be not less than 150,000 by year 5. PEF-approved programs to include the FAS, NSP, and any newly developed program including the Public School Support Program that is approved by the PEF’s Board and is acceptable to the Bank. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) PPPs will be between the PEF and the private sector including private school owners, NGOs, civil society organizations, and educational institutions. Strengthened quality assurance system includes (but is not necessarily limited to) CPD support to teachers; improved QATs; and enhanced monitoring of partner schools to include quarterly monitoring. Minimum performance standards are those that are contractually agreed to between the PEF and the partner school, and are acceptable to the Bank. TPV, PEF Data source/ Agency Database of beneficiary students, database of partner schools, periodic monitoring reports, TPV reports, and QAT results. Verification Entity Approval of a program by the PEF will be evidenced by official minutes of the PEF Board meetings. Evidence provided by the Procedure PEF to the PMIU DLI_TBL_VERIFICATION DLI 3. Stipends for secondary school girls Stipends for secondary school girls to increase secondary school PBC 3 participation/retention Definitions Strengthened program includes additional repetition condition (whereby a student becomes ineligible during a repeated grade), biannual stipend payments, and more efficient payment mechanisms. Description Ongoing Stipend Program includes the 16 districts where girls enrolled in secondary school have been receiving stipends since 2004. PMIU and PSPA Administrative Records Data source/ Agency PMIU Verification Entity Database of beneficiaries in agreed format Biannual program implementation status report with beneficiary identification, confirmation, and disbursement data, in Procedure agreed format The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI_TBL_VERIFICATION DLI 3. Stipends for secondary school girls Stipends for secondary school girls to increase secondary school PBC 3 participation/retention Definitions Strengthened program includes additional repetition condition (whereby a student becomes ineligible during a repeated grade), biannual stipend payments, and more efficient payment mechanisms. Ongoing Stipend Program includes the 16 districts where girls enrolled in secondary school have been receiving stipends since 2004. Strategy to simplify and strengthen the implementation means that SED will carry out registration and issuance of payment cards at the school, using the School Information System. Description The strategy to simplify the system of registration and disbursements will cover (i) how the school system will manage registrations, collection of payment information and verification of attendance, (ii) payment mechanisms, including delivery mechanism of Khidmat cards (or equivalent payment mechanism, e.g. mobile payments), (iii) data sharing between schools, SED and PSPA, (iv) payment regularity. Continuously enrolled means that students have already been enrolled and registered into the program (e.g. as having been enrolled and found eligible at a lower grade level). Newly enrolled means that students are enrolled into the program for the first time. PMIU and PSPA Administrative Records Data source/ Agency PMIU Verification Entity Database of beneficiaries in agreed format Biannual program implementation status report with beneficiary identification, confirmation, and disbursement data, in Procedure agreed format DLI_TBL_VERIFICATION PBC 4 DLI 4: Early childhood education Improving quality and expanding access to early childhood education Definitions All targets are cumulative Description ECE Policy Framework includes institutional unit and budget planning. An ECE teacher is defined as a primary schoolteacher who has received the DSD ECE teacher training. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) An ECE caregiver is defined as an individual recruited with revised Terms of Reference (ToR) and who has received the DSD ECE caregiver training. ‘Revised’ ToRs mean that the ToRs have been updated and reviewed by the DSD, SED, and PMIU after project effectiveness. ECE Quality Standards for a Classroom and its School Staffing. One ECE teacher and one ECE caregiver Training. The following persons have received in-service training on ECE through the QAED: ECE teacher, ECE caregiver, head teacher and 2 School Management Council members, of whom one must be a woman Content. ECE curriculum and ECE activity guide in use Materials. ECE toolkit Monitoring for improvement. AEOs (or equivalent) mandate revised to include ECE classrooms. ECE classrooms are monitored once a month by the AEOs(or equivalent) who have received ECE training and provide feedback for improvement to ECE teacher and ECE caregivers. Parental outreach. Parents have received parent activity guide and follow-up; quarterly parent meetings held at schools. Evidence to be provided by the PMIU with QAED inputs. The ECE curriculum and activity guide are judged to be in use (or not) by the AEO (or equivalent) during the on-site support visit. Pilot. District health/nutrition officers receive training in early childhood development to provide information on health and nutrition to ECE classes and identify malnourished children to refer to district health centers. Random sample of reports from the AEOs on classrooms meeting quality standards. Approved ECE Policy Framework with quality standards signed by relevant authority (Secretary Schools Education Department) Data source/ Agency Database of schools with ECE classrooms that meet quality standards, in an agreed format TPV report in an agreed format PMIU Verification Entity AEOs (or equivalent) observe the classrooms, and report back to the SED/PMIU about their observations These data are Procedure aggregated, analysed and validated by the PMIU. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI_TBL_VERIFICATION PBC 4 DLI 4: Early childhood education Improving quality and expanding access to early childhood education Definitions All targets are cumulative ECE Policy Framework includes institutional unit and budget planning. An ECE teacher is defined as a primary schoolteacher who has received the DSD ECE teacher training. An ECE caregiver is defined as an individual recruited with revised Terms of Reference (ToR) and who has received the DSD ECE caregiver training. ‘Revised’ ToRs mean that the ToRs have been updated and reviewed by the DSD, SED, and PMIU after project effectiveness. ECE Quality Standards for a Classroom and its School Staffing. One ECE teacher and one ECE caregiver Training. The following persons have received in-service training on ECE through the QAED: ECE teacher, ECE caregiver, head teacher and 2 School Management Council members, of whom one must be a woman. If necessary, this training is provided through digital means. Description Content. ECE curriculum and ECE activity guide in use Materials. ECE toolkit Monitoring for improvement. AEOs (or equivalent) mandate revised to include ECE classrooms. ECE classrooms are monitored once a month by the AEOs(or equivalent) who have received ECE training and provide feedback for improvement to ECE teacher and ECE caregivers. Parental outreach. Parents have received parent activity guide and follow-up; quarterly parent meetings held at schools. Evidence to be provided by the PMIU with QAED inputs. The ECE curriculum and activity guide are judged to be in use (or not) by the AEO (or equivalent) during the on-site support visit. Pilot. District health/nutrition officers receive training in early childhood development to provide information on health and nutrition to ECE classes and identify malnourished children to refer to district health centers. Data source/ Agency Random sample of reports from the AEOs on classrooms meeting quality standards. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Approved ECE Policy Framework with quality standards signed by relevant authority (Secretary Schools Education Department) Database of schools with ECE classrooms that meet quality standards, in an agreed format TPV report in an agreed format PMIU Verification Entity AEOs (or equivalent) observe the classrooms, and report back to the SED/PMIU about their observations These data are Procedure aggregated, analysed and validated by the PMIU. DLI_TBL_VERIFICATION DLI 5: Human Resources Management Strengthening HR processes through continuous merit-based recruitment and PBC 5 rationalization of teaching posts Merit-based recruitment means hiring of 100 percent newly recruited teachers under initial recruitment quota through competitive tests carried out by a third party as under PESRP II. Vacant posts will be identified by district officials based on the recruitment policy. Initial recruitment quota is identified as vacant posts, which will be filled by hiring of new teachers and not by promotions or transfers of existing teachers. Description TPV conducted in 2017–18, 2018-19 and 2019-20 will review implementation of recruitment policy with particular focus on merit-based recruitment and reallocation of teaching posts. The TPV review of test-based recruitment will identify potential improvements in test content, design, administration, and use of results. Review of recruitment and reallocation policy will identify the ratio of success in implementation and propose changes to address challenges. Approved recruitment policy, teacher-specific test results, and placement information in agreed format. In 2017–18, the Data source/ Agency SED will submit a revised recruitment and reallocation mechanism acceptable to the Bank. TPVs in year 2, 3 and 4. Verification Entity NTS will administer tests for teachers and share the results with the SED. PMIU will submit test data to the Bank after each Procedure year where recruitment is complete. Actual recruitment and transfer data are shared by district level CEOs and DMOs. These are then aggregated, analysed and validated by the PMIU. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) DLI_TBL_VERIFICATION PBC 6 DLI 6. Quality in the primary classroom Strengthening field- based CPD for improved teacher performance The new CPD approach taken by QAED strengthens the existing CPD system for primary teachers, and focuses on improving teaching practices, while also improving literacy, numeracy, and large class (incl. if relevant, multi-grade) teaching. o This includes a teacher support package on basic literacy and numeracy covering Grades 1-3, curriculum sequencing of learning steps for Grades 1-3 literacy and numeracy, with learning, assessment and supplementary learning activities for each step. o This also includes a focus on strengthened pedagogic practice for teachers, use of formative assessments, and in-service training for teachers and head-teachers or principals, aligned to the broad agenda of government and stakeholders. This also includes adequate instructional resources including teacher guides, learning and assessment activity materials for each step, individual child progress monitoring cards, student workbooks, notebooks, supplementary reading books, and literacy and numeracy materials; The main focus of the DLI is the development and piloting of an innovative support package focusing on teacher pedagogic practice, which includes the use of videos in order to show good practice and evaluate practice, and is aimed to improve teaching quality in the classroom in areas such as supportive learning environment, setting Description positive behavioral expectations, providing feedback, checking for understanding (formative assessment), lesson facilitation, and critical thinking. The approach also includes modules (including an app) to support AEOs (or equivalent), headteachers, CPD experts and teachers on teacher observation and feedback provision with the aim of providing data-driven, actionable and constructive feedback to teachers, linked to standards for teaching. A revised task description for AEOs (or equivalent) will be developed in order to refocus the system on professional development and support, rather than control, while allowing more time for classroom observation, and the development of a professional mentoring relationship between the AEO and the schools. AEOs and headteachers will also be trained and certified on how to do classroom observation and how to provide feedback. The innovative package will be validated, which means that the innovative package has been reviewed by relevant stakeholders, has been piloted and evaluated, ideally in the setting of a randomized controlled trial that measures its effect on classroom practices and learning outcomes. The successful elements of the innovative support package pilot will be identified by QAED and stakeholders, and will be selected for scale up in the new mainstream CPD system. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Evidence: 1. Innovative support package published on QAED’s website; AEO training materials and certification results published on QAED website; Pilot report; evidence provided by QAED for training of primary school teachers; PMIU (AEO data on classroom observations, and MEA verification of pilot exercise). Evidence to be provided by the PMIU with QAED inputs Data source/ Agency PMIU MEA monitoring system and SED's AEO system. Verification Entity School inspectors (MEAs) visit schools regularly to check whether actions are being implemented. School mentors (AEOs) Procedure will provide classroom observations and feedback to teachers. DLI_TBL_VERIFICATION PBC 6 DLI 6. Quality in the primary classroom Strengthening field- based CPD for improved teacher performance The new CPD approach taken by QAED strengthens the existing CPD system for primary teachers, and focuses on improving teaching practices, while also improving literacy, numeracy, and large class (incl. if relevant, multi-grade) teaching. o This includes a teacher support package on basic literacy and numeracy covering Grades 1-3, curriculum sequencing of learning steps for Grades 1-3 literacy and numeracy, with learning, assessment and supplementary learning activities for each step. o This also includes a focus on strengthened pedagogic practice for teachers, use of formative assessments, and in-service training for teachers and head-teachers or principals, aligned to the broad agenda of Description government and stakeholders. This also includes adequate instructional resources including teacher guides, learning and assessment activity materials for each step, individual child progress monitoring cards, student workbooks, notebooks, supplementary reading books, and literacy and numeracy materials; The main focus of the DLI is the development and piloting of an innovative support package focusing on teacher pedagogic practice, which includes the use of videos in order to show good practice and evaluate practice, and is aimed to improve teaching quality in the classroom in areas such as supportive learning environment, setting positive behavioral expectations, providing feedback, checking for understanding (formative assessment), lesson facilitation, and critical thinking. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) The approach also includes modules (including an app) to support AEOs (or equivalent), headteachers, CPD experts and teachers on teacher observation and feedback provision with the aim of providing data-driven, actionable and constructive feedback to teachers, linked to standards for teaching. A revised task description for AEOs (or equivalent) will be developed in order to refocus the system on professional development and support, rather than control, while allowing more time for classroom observation, and the development of a professional mentoring relationship between the AEO and the schools. AEOs and headteachers will also be trained and certified on how to do classroom observation and how to provide feedback. The innovative package will be validated, which means that the innovative package has been reviewed by relevant stakeholders, has been piloted and evaluated, ideally in the setting of a randomized controlled trial that measures its effect on classroom practices and learning outcomes. The successful elements of the innovative support package pilot will be identified by QAED and stakeholders, and will be selected for scale up in the new mainstream CPD system. Necessary trainings may be provided through digital means as a result of school closures during the COVID-19 pandemic period. Evidence: Innovative support package published on QAED’s website; AEO training materials and certification results published on QAED website; Pilot report; evidence provided by QAED for training of primary school teachers; PMIU (AEO or equivalent data on classroom observations, and MEA or equivalent verification of pilot exercise). Evidence to be provided by the PMIU with QAED inputs Data source/ Agency PMIU MEA monitoring system and SED's AEO system. Verification Entity School inspectors (MEAs) visit schools regularly to check whether actions are being implemented. School mentors (AEOs) Procedure will provide classroom observations and feedback to teachers. DLI_TBL_VERIFICATION PBC 7 DLI 7. Student Assessment PEC and its instruments strengthened within a revised policy framework Description Definitions, Evidence, and Protocols The World Bank Pakistan: Third Punjab Education Sector Project (P154524) The assessment policy framework will be developed based upon a review of extant policy, and the roles, mandates and relative strengths and weaknesses of PEC and other institutions involved in assessment. It will be approved by the Commission overseeing PEC. The ISP will be based upon a functional review of PEC that examines PEC’s mission within the context of the new assessment policy framework, and will have schedules covering at least the following areas of institutional strengthening: (i) clarification of PEC’s mission; (ii) update of PEC functions, activities and operating procedures; (iii) staffing levels and profiles, and recruitment and training needs; (iv) equipment procurement; (v) budgetary requirements, and (vi) capacity building to enhance item/test quality and scoring, and to analyze, report and use data. The reporting of data in actionable form means that the data are analyzed, tailored and disseminated to relevant stakeholders (teachers/trainers, curriculum and textbook developers, and decision makers) in a form that is useful to them in deciding what actions can be taken to improve the quality of education. This will require doing an upfront focus group with each stakeholder group to get a sense of their data needs. It also will require holding a dissemination workshop with each stakeholder group once the report has been prepared to review the data and actionable recommendations with them. PEC Data source/ Agency PMIU Verification Entity PMIU will verify PEC data. Procedure DLI_TBL_VERIFICATION PBC 7 DLI 7. Student Assessment PEC and its instruments strengthened within a revised policy framework The ISP will be based upon a functional review of PEC that examines PEC’s mission within the context of the new assessment policy framework, and will have schedules covering at least the following areas of institutional strengthening: (i) clarification of PEC’s mission; (ii) update of PEC functions, activities and operating procedures; (iii) staffing levels and profiles, and recruitment and training needs; (iv) equipment procurement; (v) budgetary Description requirements, and (vi) capacity building to enhance item/test quality and scoring, and to analyze, report and use data. An assessment framework is a document that describes the subject-specific content and thinking skills that students need in the classroom. It includes a review of textbooks, the official curriculum, and relevant academic literature. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) It framework will be mapped to individual SLOs that are the core of the curriculum and textbook design. The assessment framework will be designed with the input from subject specialists, stakeholders (PCTB, QAED, researchers, teachers and parents) and will be formally adopted by the Comission. Hiring means that PEC has filled the vacancies identified in the HR plan. Hirings will be made through a competitive, merit-based process based on service rules, and publicly advertized TORs. The school-based assessment is primarily a summative assessment of core subjects (including, but not limited to Math, Urdu, English and Science), which is led by schools and teachers. The school-based assessment also contains elements of formative assessment, such as feedback to the students, teachers and parents. Piloted means that a field implementation has been carried out and lessons have been documented in a report. PEC provides different test items in the form of an item bank with a test format, which are at similar levels of difficulty and discrimination. The results of school-based assessments are primarily reported to children, teachers and parents. The sample-based assessment is a diagnostic tool that surveys and assesses students from a random sample of schools. This sample is drawn from all public schools offering the respective grades in the province. The objective of the assessment is to diagnose students proficiency in SLOs, including basic literacy and numeracy. The assessment will include basic and more advanced test items from early grades onwards. The results of this assessment are publicly communicated and discussed by policy-makers and the community. Formative assessments are used by teachers to continuously monitor student performance through the use of formal and informal techniques. The results of these assessments are always for ongoing student learning and growth support, not performance reporting. The strategy for formative assessments will include (1) a definition of the goals and different methods of formative assessment, (2) a stocktake of existing practices of formative assessments, including the role of formative assessment in existing teacher training and professional development, (3) identified actions for PEC and other concerned departments to support formative assessment, including needs for material development, (4) budgetary needs, and (5) a timeline for implementation. The reporting of data in actionable form means that the data are analyzed, tailored and disseminated to relevant stakeholders (teachers/trainers, curriculum and textbook developers, and decision makers) in a form that is useful to them in deciding what actions can be taken to improve the quality of education. For instance, data will be communicated in a written report, policy-briefs, and infographics that can be shared on social media. Communication with parents will use tables and visualizations that average (including illiterate) parents can understand. PEC Data source/ Agency The World Bank Pakistan: Third Punjab Education Sector Project (P154524) PMIU Verification Entity PMIU will verify PEC data. Procedure DLI_TBL_VERIFICATION PBC 8 DLI 8. School specific NSB Setting and executing school budgets in line with school resource needs Definitions and Evidence ‘Necessary support structure’ for execution of the NSB component entails formulation of a steering committee with representation from all stakeholders and the required capacity-building program to engage/mobilize SCs and school administrations. The required capacity-building program for school will be a comprehensive mobilization strategy agreed by all stakeholders. It will also include necessary material aid to SCs, such as SC guidelines. The first year activities will be focused on establishing protocols and strategies, which will be implemented in following years. For high and higher secondary schools, Project to Improve Financial Reporting and Auditing (PIFRA) system will be used to identify disbursed money against Drawing & Disbursing Officer (DDO) codes of respective schools in the first 2 Description years of the program, while the SCs are being formulated in the schools. In the third year of the program, the project will work to ensure that disbursement of the NSB will be through SCs in high or higher secondary schools, based on consultations and subject to agreement with the FD of Punjab Province and the Accountant General’s Office. SCs will be reconstituted in primary and elementary schools, which were not part of the capacity-building program during PESRP II. Simultaneously, SC will be formalized in high or higher secondary schools with required guidelines and materials disseminated. PMIU/PIFRA Data source/ Agency Third Party Verification Entity The TPV to be carried out in the third year will be against the ToRs as agreed by all stakeholders. The TPV will seek to review the impact) of the NSB component along with the capacity-building program, analyzing the efficacy of the in-place capacity- Procedure building program. Verification protocol. Verification of disbursements of funds to schools will be sought from certificates submitted by the EDO (or equivalent) office for release of cheques to all primary and elementary schools. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) For reconstitution and constitution of SCs, certificates will be sought from district EDO (or equivalent) offices highlighting the detail of SCs formulated according to policy. DLI_TBL_VERIFICATION PBC 8 DLI 8. School specific NSB Setting and executing school budgets in line with school resource needs Definitions and Evidence ‘Necessary support structure’ for execution of the NSB component entails formulation of a steering committee with representation from all stakeholders and the required capacity-building program to engage/mobilize SCs and school administrations. The required capacity-building program for school will be a comprehensive mobilization strategy agreed by all stakeholders. It will also include necessary material aid to SCs, such as SC guidelines. The first year activities will be focused on establishing protocols and strategies, which will be implemented in following years. For high and higher secondary schools, Project to Improve Financial Reporting and Auditing (PIFRA) system will be used to identify disbursed money against Drawing & Disbursing Officer (DDO) codes of respective schools in the first 2 Description years of the program, while the SCs are being formulated in the schools. In the third year of the program, the project will work to ensure that disbursement of the NSB will be through SCs in high or higher secondary schools, based on consultations and subject to agreement with the FD of Punjab Province and the Accountant General’s Office. SCs will be reconstituted in primary and elementary schools, which were not part of the capacity-building program during PESRP II. Simultaneously, SC will be formalized in high or higher secondary schools with required guidelines and materials disseminated. PMIU/PIFRA Data source/ Agency Third Party Verification Entity The TPV to be carried out in the third year will be against the ToRs as agreed by all stakeholders. The TPV will seek to review the impact) of the NSB component along with the capacity-building program, analyzing the efficacy of the in-place capacity- Procedure building program. Verification protocol. Verification of disbursements of funds to schools will be sought from certificates submitted by the EDO (or equivalent) office for release of cheques to all primary and elementary schools. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) For reconstitution and constitution of SCs, certificates will be sought from district EDO (or equivalent) offices highlighting the detail of SCs formulated according to policy. DLI_TBL_VERIFICATION DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based PBC 9 decision-making Definitions Integrated education sector database will include a web-based integrated database at the school level consisting of ASC, MEA data, PEC, QAED, PEF, in agreed format Access and orientation to the integrated education sector dashboard will involve sharing integrated database with source departments and district education officials, and providing training on utilizing the database, and on data Description utilization for improving education outcomes Departments include the SED, PEC, QAED, PMIU, and PEF Indicators in the report cards should include student achievement data from PEC results, teacher and student absence and student-teacher ratios at the primary level. Additional school level indicators can be included if in agreement with the Bank Various data source, including school census, monitoring data, PEC results, QAED teacher training data, PEF administrative Data source/ Agency record. PMIU and PITB to aggregate and validate the data. Verification Entity Private school census school-wise database with GPS coordinates Integrated education database in agreed format Procedure District level lists with signatures of relevant officials indicating receipt of cards by district education administrations, in agreed format DLI_TBL_VERIFICATION DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based PBC 9 decision-making Definitions Description Integrated education sector database will include a web-based integrated database at the school level consisting of ASC, MEA data, PEC, QAED, PEF, in agreed format The World Bank Pakistan: Third Punjab Education Sector Project (P154524) Access and orientation to the integrated education sector dashboard will involve sharing integrated database with source departments and district education officials, and providing training on utilizing the database, and on data utilization for improving education outcomes Departments include the SED, PEC, QAED, PMIU, and PEF Indicators in the report cards should include student achievement data from PEC results, teacher and student absence and student-teacher ratios at the primary level. Additional school level indicators can be included if in agreement with the Bank Various data source, including school census, monitoring data, PEC results, QAED teacher training data, PEF administrative Data source/ Agency record. PMIU and PITB to aggregate and validate the data. Verification Entity Private school census school-wise database with GPS coordinates Integrated education database in agreed format Procedure District level lists with signatures of relevant officials indicating receipt of cards by district education administrations, in agreed format DLI_TBL_VERIFICATION DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based PBC 9 decision-making Definitions Integrated education sector database will include a web-based integrated database at the school level consisting of ASC, MEA data, PEC, QAED, PEF, in agreed format Access and orientation to the integrated education sector dashboard will involve sharing integrated database with source departments and district education officials, and providing training on utilizing the database, and on data Description utilization for improving education outcomes Departments include the SED, PEC, QAED, PMIU, and PEF Indicators in the report cards should include student achievement data from PEC results, teacher and student absence and student-teacher ratios at the primary level. Additional school level indicators can be included if in agreement with the Bank Various data source, including school census, monitoring data, PEC results, QAED teacher training data, PEF administrative Data source/ Agency record. The World Bank Pakistan: Third Punjab Education Sector Project (P154524) PMIU and PITB to aggregate and validate the data. Verification Entity Private school census school-wise database with GPS coordinates Integrated education database in agreed format Procedure District level lists with signatures of relevant officials indicating receipt of cards by district education administrations, in agreed format The World Bank Pakistan: Third Punjab Education Sector Project (P154524)