The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) AFRICA WEST | Sierra Leone | Social Sustainability and Inclusion Global Practice | Recipient Executed Activities | Investment Project Financing | FY 2019 | Seq No: 2 | ARCHIVED on 30-Mar-2022 | ISR48628 | Implementing Agencies: Oxfam in Sierra Leone, Oxfam in Sierra Leone Key Dates Key Project Dates Bank Approval Date: 28-Aug-2018 Effectiveness Date: 18-Apr-2019 Original Closing Date: 31-Aug-2021 Revised Closing Date: 31-Mar-2022 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The project's development objective is to empower citizens through social accountability interventions, to improve the utilization of post-Ebola recovery funds in the health and the education sectors in targeted districts of the member country. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Satisfactory Implementation Status and Key Decisions The grant experienced almost 3 years initial delays, brought by change of implementing partner and associated financial due diligence, as well as restructuring to respond to the COVID-19 pandemic. Despite these delays, the project has made good progress implementing planned activities. The team successfully implemented project restructuring in August 2021 to move the closure date from 31st August 2021 to 31st March 2022 to coincide with Oxfam’s phasing out of Sierra Leone. Implementation performance is rated satisfactory and progress towards achieving the Project Development Objectives (PDO) is also rated Satisfactory. The progress has been recognized by country stakeholders as exemplary with the uptake of recommendations by Parliament and by the education and health facilities at district level. A summary of the implementation progress component-wise is provided in the following paragraphs. Component 1 - Development and sharing of an annual SDI The project finalized the Service Delivery Index (SDI) in January 2021. To promote ownership at the political level, the SDI adopted the constituency as a unit of measure, ensuring that members of parliament found meaning in the findings. The themes of the SDI reflected government priorities in the Medium-Term National Development Framework. The Project Team also adopted 14 indicators (8 in education, 6 in health) and government Management Information System. For example, the tool reflected the MBSSE, School Census; Exam Results for National Primary and Secondary Education; MoHS Human Resource data; SARA and the District Health Information System. The final SDI tool was shared with representatives from Oxfam, the World Bank, and the two ministries, and their feedback was incorporated in the final version. To this end, the Minsters of Health and Basic and Secondary Education wrote the forward section and endorsed the report. The project team launched the SDI in parliament in March 2021 and discussion was moderated by the Clerk of Parliament, with representatives from the 2 political parties, leader of Government Business, Deputy Leader of the APC (main opposition), The previous World Bank Country Manager, Gayle Martin was in attendance, and highlighted the alignment of the World Bank CPF on the themes of the SDI. Following the launch, the IGR implemented an array of dissemination activities. This targeted national and international organization including media outlets, universities, and CSO forums. The data generated by the SDI data has been utilized 3/30/2022 Page 1 of 7 The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) by GoSL agencies and development partners – e.g. the USAID, and EU programme planning unit. Copies of the report were also printed and disseminated amongst national CSOs. The second SDI report was conducted in December 2021 and due to be launched in early April 2022. Component 2 - State-citizen interface on service and develop community-based structures for Social Accountability State citizen interfaces have been created at national and district level. For example, at national level the Project’s social accountability strategy and its operationalization moved beyond consultations with the MPs to work directly with the health and education parliamentary committees. As part of the process of adopting the findings, parliament representatives and IGR established a working team to jointly validate SDI results on the ground. Based on this exercise, parliamentarians submitted a compendium of the SDI report to parliament for debate. This has heightened interest and commitment to explore concrete recommendations and policies to address the issues of inequity and nonperformance highlighted in the report. For a CSO to influence high level power structures with the mandate and authority to influence policies on service delivery is a novelty in Sierra Leone. Through the GPSA, the World Bank is creating a field for learning for state institutions and citizens and the partnership is helping Sierra Leone deepen democratic accountability and make service delivery effective. The Project Team selected 4 districts (Moyamba in the south, Tonkolili and Falaba in the north, and Karene in the northwest) and 14 constituencies for in-depth follow-up action, monitoring and collaboration with service providers through partner CBOs. These were the worst performing districts at the district level with respect to health and education service delivery from the SDI. Stakeholders in these districts have however shown high receptivity to the findings. The Project Team has worked jointly with local CBOs, Community Facilitators and citizen monitoring groups to understand challenges in the selected districts including the capacity of service user groups (health facility and school management committees), to find strategies for improvement. The project team has oriented local CBOs on the SDI results and on indicators that should be followed up to effect change. In these selected districts, the Project Team has monitored the implementation of health and education service improvement plans for the duration of the project. Community ownership of local service delivery facilities was deemed critical for localized CE to improve services in the very remote and underserved areas the project is covering. Community Facilitators were recruited by the project, and they have conducted training, coaching and mentoring of 500 community SMC and FMC members drawn from 42 pilot facilities in the four districts. The Project supplied cash books and logbooks to the pilot facility have been trained to develop facility improvement plans and managing expenses accountably. The existence of the cash books and logbooks and the capacity improvement of project pilot marks a noticeable difference between GPSA and non-GPSA supported communities. There are requests by local authorities in the district for the project to go beyond the 4 targeted areas and the Project Team is exploring openings to raise funds from new sources to replicate and sustain the project successes. The project has adopted ICT to facilitate state – citizen interface between grassroots communities and Members of Parliament. To aid with monitoring and tracking work within communities, computer monitors have been installed in parliament and within the local councils in the target districts. This has enabled MPs to view citizen feedback in real time, an administrative feature that will be deepened as collaboration continues beyond the project between Parliament and CSOs. To strengthen the state – citizen interface, IGR has created the National Platform for Social Accountability (NPSA). IGR will collaborate with likeminded NGOs and local CSOs under this umbrella to provide a hub for sustained social accountability work in Sierra Leone, beyond the project time frame. Component 3- Sharing knowledge and lessons learned and project management The project recruited an external evaluator to guide the learning and evaluation activities of the project before the project ends. The M&E consultant localized the Theory of Action and updated the Results framework to ensure that it reflects the reality of what the project is able to measure with evidence within the implementation time frame. The M&E consultant has prepared a draft end-line evaluation to support the program in documentation and learning processes. This piece of work will also feed into the project ICR. The project has also produced a web-based platform which is currently being used by IGR and its community facilitators to track health and education services in pilot facilities. This modern ICT tool will embed the feedback and build capacity of service providers to respond to citizen complaints. Effort will be made to build on this platform if the project secures new sources of funding. M&E and Results Framework The mission reviewed the M&E functions in the project and found that the project successfully implemented activities under all the components of the project. All two PDO and intermediate level indicators have been met. The MEL evaluation will further substantiate the quality of achievement by close of project. The first SDI was successfully implemented, and field work for final SDI drafted completed. State – Citizen interfaces have been developed and planned activities under the learning and monitoring are well underway. IGR will however carry learning events beyond the project duration. GPSA has introduced a new M&E framework across the projects in its portfolio, to strengthen the learning and ‘thought leadership’ component of the GPSA’s mandate. To this end, the GPSA has formalized its Theory of Action and updated its Results Framework with new indicators that are applicable across the portfolio. GPSA projects are to localize the GPSA’s Theory of Action and Results Framework to make sense at the project level. For the GPSA project in Sierra Leone, this ‘localization’ process took place in December 2021 due to significant project delays. The Results Framework has been updated and cleared by the GPSA and Social PM so that the project gets assessed on the indicators that have been agreed through this ‘localization’ process. Safeguards The Grant Agreement (GA) of the project did not require the triggering of safeguard-related activities. Additionally, the project was approved before the new ESF became effective and there have been no changes to necessitate triggering of the safeguards policies. 3/30/2022 Page 2 of 7 The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) Procurement Procurement Performance under the project remains Satisfactory and the procurement risk is Low. The two major procurement activities include hiring an M&E expert to prepare a project evaluation report and hiring an ICT consultant have since been completed. The team was advised that since the project is closing on March 31, 2022, all activities should be completed and reports approved by the project team on, or before then to be eligible for payment under the project. Financial Management The Financial Management (FM) Performance rated overall as satisfactory while the FM risk rating remains moderate. The existing financial management procedures and systems continue to meet the minimum Bank requirements for financial management. The Total disbursement as at close of business on Thursday 24th March 2022 was USD 684,000.00 which is 100.0% of the total project IDA financing. The interim financial report (IFR) for the quarter ended June 30, 2021, and the audit report for the year ended 31st December 2020 have been submitted to the Ban and filed. The IFR for the quarter ended September 30, 2021, reports have also been submitted to the Bank. The IFR for the quarter ending 31st March 2022 is due for submission on the 15th May 2022 and if payments are made beyond March to suppliers for activities completed during the project period, the financial reporting for these payments should be made 45 days after the final payment. Risks Overall Risk Rating Risk Category Rating at Approval Previous Rating Current Rating Overall Moderate Moderate Moderate 5. Results Project Development Objective Indicators IN01050557 ►Number of hospital and health care facilities that have improved their capacity to provide essential health care services in target districts (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 14.00 10.00 Date 31-Jan-2017 29-Apr-2020 29-Apr-2020 31-Mar-2022 IN01050559 ►Level of improvement in education services in target districts (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 60.00 60.00 Date 16-Jul-2018 29-Apr-2020 29-Apr-2020 31-Mar-2022 Intermediate Results Indicators 3/30/2022 Page 3 of 7 The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) IN01050558 ►Oxfam, IGR and CSO partners demonstrate improved capacity to engage meaningfully and collaboratively with MoHS/relevant public sector partners in health sector policymaking and implementation and serv (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 15.00 15.00 Date 16-Jul-2018 29-Apr-2020 29-Apr-2020 31-Mar-2022 IN01050560 ►Oxfam, IGR and its CSO partners demonstrate improved capacity to engage meaningfully and collaboratively with MBSSE/public sector partners and BSSE Committee in Parliament in education sector policyma (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 20.00 20.00 Date 16-Jul-2018 29-Apr-2020 29-Apr-2020 31-Mar-2022 IN01050561 ►Oxfam/IGR’s compact stakeholders demonstrate improved capacity to engage meaningfully and collaboratively with relevant public sector institutions in health sector policy making, implementation and se (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 40.00 40.00 Date 16-Jul-2018 29-Apr-2020 29-Apr-2020 31-Mar-2022 IN01105691 ►Oxfam/IGR's compact stakeholders demonstrate improved capacity to engage meaningfully and collaboratively with relevant public sector institutions in education sector policy making, implementation an (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 70.00 50.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01117026 ►Percentage of the targeted proximate causes of health sector service delivery failure with corrective measures implemented by health sector actors to which the project’s collaborative social accountab (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 40.00 50.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01117027 ►Percentage of the targeted proximate causes of education sector service delivery failure with corrective measures implemented by education sector actors to which the project’s collaborative social acc (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 60.00 60.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 3/30/2022 Page 4 of 7 The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) IN01117028 ►Percentage of targeted hospital sites in which compact stakeholders (FMCs, citizen-monitoring groups/CSOs/CBOs, MoHS officials, DHMT and other service groups) engage in collaborative social accountabi (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 60.00 50.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01117029 ►Percentage of targeted school sites in which compact stakeholders (SMCs, citizen-monitoring groups/CSOs/CBOs, Ministry of Education (MBSSE) officials and service groups) engage in collaborative social (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 50.00 40.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01117030 ►Percentage of health sector multi-stakeholder compacts that effectively used collaborative social accountability processes to target the proximate causes of failures for health service delivery (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- -- 40.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01116963 ►Percentage of education sector multi-stakeholder compacts that effectively used collaborative social accountability processes to target the proximate causes of failures for education service delivery (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 60.00 50.00 Date 16-Jul-2018 -- 29-Jul-2020 31-Mar-2022 IN01116964 ►Percentage of priority stakeholders who apply lessons from or elements of the project’s collaborative social accountability process beyond the PDOs (outside the grant scope) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 20.00 15.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01116965 ►Percentage of education stakeholders who apply elements of collaborative social accountability processes in additional localities beyond Falaba, Tonkolili, Moyamba and Karene (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 20.00 20.00 Date 16-Apr-2018 -- 29-Jul-2020 31-Mar-2022 3/30/2022 Page 5 of 7 The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) IN01117037 ►Percentage of grant partner-led compacts with involvement from at least 3 fit-for-purpose stakeholder groups that discuss routinely (every 3 months) the evidence gathered from monitoring exercises on (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 20.00 20.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 IN01117039 ►Number of six-monthly reflection sessions between IGR/Oxfam and GoSL where lessons learned about health sector collaborative social accountability processes during the grant led to a change in the pro (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 3.00 3.00 Date 16-Apr-2018 -- 29-Apr-2020 31-Mar-2022 IN01117040 ►Number of six-monthly reflection sessions between IGR/Oxfam and GoSL where lessons learned about education sector collaborative social accountability processes during the grant led to a change in the (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 5.00 5.00 Date 16-Jul-2018 -- 29-Apr-2020 31-Mar-2022 Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P162166 TF-A8495 Effective USD 0.68 0.68 0.00 0.68 0.00 100% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P162166 TF-A8495 Effective 28-Aug-2018 18-Apr-2019 18-Apr-2019 31-Aug-2021 31-Mar-2022 Cumulative Disbursements 3/30/2022 Page 6 of 7 The World Bank Implementation Status & Results Report Monitoring Post Ebola Recovery Funds: A Focus on Service Delivery (P162166) Restructuring History Level 2 Approved on 24-Aug-2021 Related Project(s) There are no related projects. 3/30/2022 Page 7 of 7