Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) LATIN AMERICA AND CARIBBEAN | Brazil | Macroeconomics, Trade and Investment Global Practice | IBRD/IDA | Investment Project Financing | FY 2013 | Seq No: 9 | ARCHIVED on 09-Jun-2018 | ISR32081 | Implementing Agencies: Municipality of Rio de Janeiro, Municipal Secretariat of Finance Key Dates Key Project Dates Bank Approval Date:14-Jun-2013 Effectiveness Date:23-Oct-2014 Planned Mid Term Review Date:15-Jun-2015 Actual Mid-Term Review Date:15-Jun-2015 Original Closing Date:30-Apr-2018 Revised Closing Date:30-Jun-2018 Project Development Objectives Project Development Objective (from Project Appraisal Document) The proposed Project Development Objective is to support institutional capacity strengthening in the Municipality of Rio de Janeiroto enhance public services delivery, including in health, education and environmental management. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Improving Fiscal Management:(Cost $3.95 M) Innovating in Service Provision:(Cost $22.07 M) Strengthening Social Governance and Monitoring and Evaluation:(Cost $3.85 M) Innovating in Environmental Management Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Moderately Unsatisfactory  Moderately Unsatisfactory Overall Implementation Progress (IP)  Moderately Unsatisfactory  Moderately Unsatisfactory Overall Risk Rating  Moderate  Moderate 6/9/2018 Page 1 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) Implementation Status and Key Decisions This ISR summarizes the findings of supervision missions carried out during March 2018. The draft Aide Memoire with detailed mission findings and agreements are attached. Project Implementation: Procurement processes for all consulting activities were finalized and signed. Implementation is ongoing and within schedule. There are minor procurement processes related to the acquisition of equipment still ongoing. The Bank continues in close contact with the client. Restructuring: project restructuring was approved by end 2017, with the restructuring of activities, partial cancelation of funds (12.5% or US$2 million) and a project closure date extended to June 30th, 2018. Results Framework: After a late start in most project activities, the team was finally able to track project indicators, which are reflected in this ISR. Still, given that many activities will be concluded only by project closure, the expectation is that results will take longer to materialize and may not be captured by the final project evaluation (ICR). This is a direct effect of late start for implementation of consultancy activities in education and slow progress in social governance and fiscal management. Nonetheless, the expectation is that concrete results will be achieved in the medium term. Ratings: Project implementation has accelerated in the last few months and the risks to the timely implementation of activities is moderate given that all consultancy contracts were signed and implementation is within schedule for most activities. As such, 3 out of the 4 components (Fiscal Management, Service Provision and Social Governance & Monitoring and Evaluation) were rated as moderately satisfactory while 1 component (Innovating in Environmental Management), that will not deliver any activity, was rated as highly unsatisfactory. Because of this, overall implementation progress and the progress toward the achievement of the PDO were rated as moderately unsatisfactory. 6/9/2018 Page 2 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance  --  Moderate  Moderate Macroeconomic  --  Moderate  Moderate Sector Strategies and Policies  --  Moderate  Moderate Technical Design of Project or Program  --  Substantial  Substantial Institutional Capacity for Implementation and Sustainability  --  High  High Fiduciary  --  Low  Low Environment and Social  --  Low  Low Stakeholders  --  Low  Low Other  --  --  -- Overall  --  Moderate  Moderate Results Project Development Objective Indicators PHINDPDOTBL  Indicator Two: Improvement in education results index of Rio municipal students (IDEB) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Initial Grades: Initial Grades: 5.4; Initial Grades: 5.3; Initial Grades: 5.6; Final 6.0; Value Final Grades: 4.4 Final Grades: 4.4 Grades: 4.3 Final Grades: 5.0 Date 31-Dec-2012 31-Dec-2013 31-Dec-2015 31-Dec-2018 Comments This indicator was redefined by the restructuring paper of Dec 2017. The discontinuation o ProvaRio led to the replacement of the old indicator (the IDERIO) by IDEB. IDEB is released every two years, with the latest data available for 2015. Data for 2017 should be released in the following months. PHINDPDOTBL  Indicator Four: Number of ongoing impact evaluation implemented (Number, Custom) 6/9/2018 Page 3 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 3.00 1.00 3.00 Date 31-Dec-2012 13-Aug-2017 30-Mar-2018 31-Dec-2018 Comments There was a mistake in the previous ISR. Although there are 3 impact evaluations under implementation, only one was concluded. The expectation is that all three will be concluded until project closure PHINDPDOTBL  Indicator Five: Coverage of the GEE emission monitoring system (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 60.00 Date 31-Dec-2012 29-May-2015 30-Mar-2018 31-Dec-2018 Comments The indicator will not be achieved because no activity will be implemented under the component 4. PHINDPDOTBL  Indicator One: Average time of solution of tributary processes related to the IPTU (Days, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 129.20 135.90 156.13 109.82 Date 31-Dec-2014 31-Dec-2015 31-Dec-2017 31-Dec-2018 Comments The indicator worsened due to factors not related to the supported activity "Digitalização do IPTU". The municipality updated info on property size through images taken by airplanes in 2017. When the new IPTU charges were issued, contestation was significant, leading to the increase in the average time of solution. More info is available on the aide memoire of March 2018. 6/9/2018 Page 4 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) PHINDPDOTBL  Indicator Three: Number of page views on Armazem de Dados portal (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 22,331.00 9,000.00 Date 31-Dec-2014 31-Dec-2016 31-Mar-2018 31-Dec-2018 Overall Comments For a description of the indicators and how to measure them, please, read the Aide Memoire of the mission. Intermediate Results Indicators PHINDIRITBL  Intermediary indicator 2.1: percentage of schools that used the results of their bimonthly tests to plan their educational activities (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 90.00 Date 31-Dec-2014 31-Dec-2015 30-Mar-2018 31-Dec-2018 Comments Not available. The indicator aimed at a group of schools named "Escolas em Foco", which no longer officially exists. SME started to work out a solution to identify such schools and assess the indicator. Therefore, the expectation is that it will be possible to measure it by the ICR stage. PHINDIRITBL  Intermediary indicator 2.2: percentage of teachers with continuing education by the Paulo Freire school (Amount(USD), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 49.00 57.00 57.00 80.00 Date 31-Dec-2014 31-Dec-2015 30-Mar-2018 31-Dec-2018 6/9/2018 Page 5 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) PHINDIRITBL  Intermediary indicator 3.1: number of users registered in the Portal RCI - Community Integrated Network (Social Organizations and Firms/Entrepreneurs) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 24.00 200.00 Date 31-Dec-2014 31-Dec-2015 30-Mar-2018 31-Dec-2018 Comments There were 68 users in the test phase, which will now conclude their subscription. PHINDIRITBL  Intermediary indicator 3.2: number of users registered in the Portal RCI - Community Integrated Network (Individuals/Citizens) (Amount(USD), Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 8.00 1,500.00 Date 31-Dec-2014 31-Dec-2015 30-Mar-2018 31-Dec-2018 Comments Government is currently focused on social organizations/entrepreneurs. The next stage will include a campaign to mobilize individual user. PHINDIRITBL  Intermediary indicator 3.3: number of active users of Armazem de Dados portal (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 6,001.00 5,500.00 Date 31-Dec-2014 31-Dec-2015 30-Mar-2018 31-Dec-2018 6/9/2018 Page 6 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) PHINDIRITBL  Intermediary indicator 3.4: Number of Impact Evaluation concept notes produced and published by IPP (including intervention and agreed design) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 4.00 6.00 Date 31-Dec-2014 31-Dec-2015 30-Mar-2018 31-Dec-2018 Overall Comments For a description of the indicators and how to measure them, please, read the Aide Memoire of the mission. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P127245 IBRD-82710 Effective USD 16.20 14.18 2.03 10.13 4.04 71% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P127245 IBRD-82710 Effective 14-Jun-2013 26-Aug-2014 23-Oct-2014 30-Apr-2018 30-Jun-2018 Cumulative Disbursements 6/9/2018 Page 7 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Rio de Janeiro Strengthening Public Sector Management Technical Assistance Project (P127245) Restructuring History Level 2 Approved on 21-Dec-2017 Related Project(s) There are no related projects. 6/9/2018 Page 8 of 8 Public Disclosure Copy