Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) STP- Quality Education for All Project (P146877) AFRICA | Sao Tome and Principe | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 8 | ARCHIVED on 29-Dec-2017 | ISR30920 | Implementing Agencies: Democratic Republic of Sao Tome and Principe, AFAP Key Dates Key Project Dates Bank Approval Date:20-Dec-2013 Effectiveness Date:19-May-2014 Planned Mid Term Review Date:02-May-2016 Actual Mid-Term Review Date:02-May-2016 Original Closing Date:30-Jun-2017 Revised Closing Date:28-Jun-2019 Project Development Objectives Project Development Objective (from Project Appraisal Document) The Development Objective is to improve the system of in-service teacher training and to strengthen themanagement of human resources in the education sector in São Tomé and Príncipe. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Component 1. Improving the System of In-Service Teacher Training in Primary Education:(Cost $4.20 M) Component 2: Strengthening Management of Human Resources in the Education Sector:(Cost $1.30 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Satisfactory  Moderately Satisfactory Overall Implementation Progress (IP)  Moderately Satisfactory  Moderately Unsatisfactory Overall Risk Rating  Moderate  Moderate Implementation Status and Key Decisions 12/29/2017 Page 1 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) A restructuring for the Sao Tome and Principe Quality Education for All Project was approved on May 16, 2017. This restructuring included both an extension of two years and a revised implementation schedule. These revisions to the project were instrumental to ensure sufficient time to achieve the PDO in full and reach all project targets. While this restructuring had placed the project back on track, unfortunately due to continued procurement delays, the Project has recently been downgraded to “Moderately Unsatisfactory.” The main objectives of the Project are to improve 1) the quality of in-service teacher training and 2) the management of human resources. The current rating is primarily due to delays in recruiting the two firms for the teacher certification processes and the distance learning in-service teacher training program which has significant implications in being able to reach the main objectives of the project. A detailed summary of progress achieved and challenges under each component is described below. Component 1: Improving the System of In-Service Teacher Training in Primary Education • Teacher Training Program: In early 2017, the first phase of the in-service teacher training program, a 150-hours of training in basic Portuguese and Mathematics were successfully delivered by ISEC to 558 primary and preschool teachers in all 7 districts. The next phase of the training program is to begin the 450-hour rigorous distance learning program that will count towards teacher certification. However, this training has been stalled due to continued delays in recruiting the institution to deliver the distance learning training program. However, the international expert to help design the IT requirements of the distance learning program at the various training centers and facilities completed his mission in November 2017 and a full list of requirements has been agreed upon with ISEC. Another activity that has been delayed is the recruitment of the firm to finalize the teacher certification process. While the Teacher Standards and Qualifications Framework were finalized in late February 2017, the recruitment of the firm to develop the accompanying certification processes has yet to be finalized. • ISEC/EFOPE Study: To allow the Project to address some serious concerns with the quality of training offered by ISEC, an in-depth study was commissioned by the Project to identify specific actions needed to improve quality. This report was finalized in September and its recommendations discussed in detail with representatives from ISEC, the Ministry, the Teachers Union, and donor partners during a workshop in late September 2017. Follow up discussions with the Bank are ongoing to determine specific activities, if any, that can be financed through the current project and what might be included through future financing in the sector. • Pre-School Curriculum/Training: In partnership with UNICEF, the Project has supported the development of a new curriculum for 4 and 5-year- olds. Groups of in-service preschool teachers traveled to Brazil to receive training on the new curriculum and a pilot of this new curriculum began in 2015. Based on the success of this first phase, this new curriculum is being scaled-up further. Additional training for pre-service preschool teachers was organized by the Project in July/August 2017 to ensure that teachers graduating this coming year will also be prepared to teach this new curriculum. • Learning Assessments: A new unit responsible for carrying out learning assessments within the Ministry has been successfully established. In 2015, this new unit received training and testing instruments were developed; in 2016, this unit conducted its first national assessment in Portuguese and Mathematics in grades 2, 4, and 6 (Avaliação Aferida de Larga-Escala no Ensino Basico – AALEB); in 2017, based on the expertise developed, another national assessment for grades 9 and 12 was conducted. A comprehensive dissemination plan was launched in early 2017 to share the results of the first AALEB in all 7 districts. The final technical report from the first AALEB was completed in September 2017. • Impact Evaluation: The design of the impact evaluation for the Project was finalized in mid-2017. The intervention to be piloted includes a training program for School Directors, the creation of School Improvement Plans together with the community, and various mechanisms for sharing assessment results. While progress has been made, this activity has also faced delays due to issues procuring display cases at the treatment schools. Component 2: Strengthening the Management of Human Resources • Education Management Information System (EMIS): The new EMIS has been established and initial data from all schools have been collected and entered into this new system. Over the past year, the Ministry has been conducting phased hands-on, individualized training for School Directors on how to collect the data and enter it into the system. All schools with electricity (approximately 66 out of 88 primary schools) have been resourced with a computer and an internet connection. Two issues that have been hampering the continued success of this activity have been 1) frequent changes of School Directors; and 2) unreliable Internet connections and inability to access the system at the school level. To address complaints regarding the quality of the internet services provided to schools, the Project has negotiated a new contract revised terms with the local internet provider that allows the Ministry greater control in internet access at the schools while also significantly reducing costs and ensuring greater sustainability. • Inspection System: New inspection tools were developed under the Project and more than 300 inspection visits have taken place using these new tools. Additionally, a University in Portugal has been identified to deliver additional training at a Masters level in school inspection and quality assurance mechanisms in STP. A total of seven inspectors have been nominated to participate in this semi-presence course that will take place in Sao Tome and at a distance. Risks 12/29/2017 Page 2 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance  --  Moderate  Moderate Macroeconomic  --  Moderate  Moderate Sector Strategies and Policies  --  Low  Low Technical Design of Project or Program  --  Low  Low Institutional Capacity for Implementation and Sustainability  --  Substantial  Substantial Fiduciary  --  Moderate  Moderate Environment and Social  --  Low  Low Stakeholders  --  Moderate  Moderate Other  --  --  -- Overall  --  Moderate  Moderate Results Project Development Objective Indicators PHINDPDOTBL  Direct project beneficiaries (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 1,888.00 1,888.00 2,500.00 Date 20-May-2014 28-Apr-2017 28-Apr-2017 28-Jun-2019 PHINDPDOTBL  Female beneficiaries (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 50.00 50.00 50.00 PHINDPDOTBL  Teachers recruited or trained (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target 12/29/2017 Page 3 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) Value 0.00 372.00 372.00 515.00 Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 Comments This includes the total number of primary school teachers that participated in the first phase of the in-service training program. Due to delays with the second phase, no additional teachers have been reached by the project at the time of this ISR. PHINDPDOTBL  Competency based training framework developed (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 20-Dec-2013 28-Apr-2017 06-Oct-2017 28-Jun-2019 PHINDPDOTBL  Student learning assessment system established (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 20-Dec-2013 28-Apr-2017 06-Oct-2017 28-Jun-2019 PHINDPDOTBL  Daily working hours by teachers (Hours, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 3.50 4.50 4.50 4.50 Date 20-Dec-2013 28-Apr-2017 06-Oct-2017 28-Jun-2019 Overall Comments Three out of the five PDO indicators have been achieved - the development of a competency-based teacher training framework, the establishment of the student assessment system, and the change in teacher working hours. Those remaining are the number of Project Beneficiaries in addition to the number of teachers trained. An updated figure on project beneficiaries broken down by subgroups and gender is needed. It is not clear if some beneficiaries are being double counted. This will be clarified in the next ISR with a detailed description of all 12/29/2017 Page 4 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) Project beneficiaries. The percentage of female beneficiaries will also be confirmed. It appears that the percentage is greater than 50% but a stronger evidence base is required in order to modify this target. Further progress in the number of teachers trained has yet to be achieved due to delays in implementing the distance learning program. It is also expected that these same 372 teachers will need to participate in the second phase of the training program as well in order to count towards the indicator target. Intermediate Results Indicators PHINDIRITBL  Assessment of critical competency needs of teachers finalized (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N Y Y Y Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 PHINDIRITBL  Training plans for in-service teacher training developed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N Y Y Y Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 PHINDIRITBL  Certification process for pre-primary and primary school teachers developed and approved (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 Comments While the Teacher Standards and Qualifications Frameworks have been developed, the accompanying certification processes have yet to be established and approved due to delays recruiting the firm to assist with this activity. 12/29/2017 Page 5 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) PHINDIRITBL  At least two student learning assessments conducted for grades 2, 4 and 6 (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 Comments The first learning assessment was successfully completed. The second is only expected in early 2019 since it will measure the improvements in learning outcomes associated with the impact evaluation. PHINDIRITBL  Percentage of primary education schools that benefit from 4 annual school-level supervision and mentoring program offered to teachers in every primary school (cumulative) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 100.00 Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 PHINDIRITBL  Education management information system in place and functional. (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N Y Y Y Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 PHINDIRITBL  Training of pre-school teachers (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 212.00 212.00 175.00 Date 20-May-2014 21-Oct-2016 06-Oct-2017 28-Jun-2019 12/29/2017 Page 6 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) PHINDIRITBL  Training of trainers (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 20-May-2014 28-Apr-2017 06-Oct-2017 28-Jun-2019 Overall Comments Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P146877 IDA-H9030 Closed USD 0.90 0.90 0.00 0.84 0.00 94% P146877 IDA-H9770 Effective USD 3.50 3.50 0.00 0.91 2.21 26% P146877 TF-16391 Closed USD 1.10 1.10 0.00 1.10 0.00 100% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P146877 IDA-H9030 Closed 20-Dec-2013 06-Feb-2014 19-May-2014 30-Jun-2017 30-Jun-2017 P146877 IDA-H9770 Effective 27-Jun-2014 23-Sep-2014 16-Dec-2014 30-Jun-2017 28-Jun-2019 P146877 TF-16391 Closed 06-Feb-2014 06-Feb-2014 19-May-2014 30-Jun-2017 30-Jun-2017 Cumulative Disbursements 12/29/2017 Page 7 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report STP- Quality Education for All Project (P146877) Restructuring History Level 2 Approved on 16-May-2017 Related Project(s) P150828-STP Quality Education for All - AF 12/29/2017 Page 8 of 8 Public Disclosure Copy