Document of The World Bank FOR OFFICIAL USE ONLY Report No: ICR00006495 IMPLEMENTATION COMPLETION AND RESULTS REPORT [IBRD-48730; TF-58040; and IBRD-85970] ON A LOAN IN THE AMOUNT OF EURO 50 MILLION (US$68.1 MILLION EQUIVALENT) AND A GLOBAL ENVIRONMENTAL FACILITY GRANT IN THE AMOUNT OF US$5.5 MILLION AND A LOAN IN THE AMOUNT OF EURO 48 MILLION (US$52.39 MILLION EQUIVALENT) TO THE REPUBLIC OF ROMANIA FOR AN INTEGRATED NUTRIENT POLLUTION CONTROL PROJECT June 20, 2024 Environment, Natural Resources & The Blue Economy Global Practice Europe And Central Asia Region CURRENCY EQUIVALENTS (Exchange Rate Effective May 31, 2024) Currency Unit = EUR EUR 0.93 = US$ 1.00 EUR 1.00 = US$ 1.09 FISCAL YEAR January 1 - December 31 Regional Vice President: Antonella Bassani Country Director: Marina Wes Regional Director: Sameh Naguib Wahba Tadros Practice Manager: Sanjay Srivastava Task Team Leader(s): Alexandru Cosmin Buteica ICR Main Contributor: Yelena Yakovleva, Sanne Agnete Tikjoeb ABBREVIATIONS AND ACRONYMS ANAR National Administration for Romanian Waters APCP Agricultural Pollution Control Project AF Additional Financing BSEP Black Sea Environment Program CGAP Code of Good Agricultural Practices CPS Country Partnership Strategy CPF Country Partnership Framework EMP Environmental Management Plan EU European Union EPA Environmental Protection Agency GEF Global Environment Facility IBRD International Bank for Reconstruction and Development IFR Interim Financial Report INPCP Integrated Nutrient Pollution Control ISR Implementation Status Report IRR Internal Rate of Return MARD Ministry of Agriculture and Rural Development MESD Ministry of Environment and Sustainable Development MEWF Ministry of Environment, Waters and Forests MPH Ministry of Public Health MTR Mid-Term Review ND Nitrates Directive NGO Non-governmental organization NPV Net Present Value NRRP National Resilience and Recovery Plan NVZ Nitrate Vulnerable Zone PAD Project Appraisal Document PDO Project Development Objective PMU Project Management Unit RON Romanian Lei SIL Specific Investment Loan TDS Training & Demonstration Site RON Romanian Lei TABLE OF CONTENTS DATA SHEET .......................................................................................................................... 1 I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES ....................................................... 7 A. CONTEXT AT APPRAISAL .........................................................................................................7 B. SIGNIFICANT CHANGES DURING IMPLEMENTATION (IF APPLICABLE) ..................................... 12 II. OUTCOME .................................................................................................................... 17 A. RELEVANCE OF PDOs ............................................................................................................ 17 B. ACHIEVEMENT OF PDOs (EFFICACY) ...................................................................................... 18 C. EFFICIENCY ........................................................................................................................... 22 D. JUSTIFICATION OF OVERALL OUTCOME RATING .................................................................... 24 E. OTHER OUTCOMES AND IMPACTS ......................................................................................... 24 III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME ................................ 26 A. KEY FACTORS DURING PREPARATION ................................................................................... 26 B. KEY FACTORS DURING IMPLEMENTATION ............................................................................. 28 IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME .. 30 A. QUALITY OF MONITORING AND EVALUATION (M&E) ............................................................ 30 B. ENVIRONMENTAL, SOCIAL, AND FIDUCIARY COMPLIANCE ..................................................... 32 C. BANK PERFORMANCE ........................................................................................................... 33 D. RISK TO DEVELOPMENT OUTCOME ....................................................................................... 35 V. LESSONS AND RECOMMENDATIONS ............................................................................. 36 ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS ........................................................... 38 ANNEX 2. BANK LENDING AND IMPLEMENTATION SUPPORT/SUPERVISION ......................... 58 ANNEX 3. PROJECT COST BY COMPONENT ........................................................................... 60 ANNEX 4. EFFICIENCY ANALYSIS ........................................................................................... 63 ANNEX 5.A. BORROWER, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS 67 ANNEX 5.B. SUMMARY OF FINAL BENEFICIARY SURVEY ....................................................... 68 ANNEX 6. RESTRUCTURING PROCESSES, 2007-2023.............................................................. 69 ANNEX 7. RF ACHIEVEMENTS AND EVOLUTION VIA RESTRUCTURINGS, 2007-2023 ............... 72 ANNEX 8. REALLOCATION OF LOAN AND GRANT PROCEEDS DETAILS ................................... 83 ANNEX 9. LIST OF SUPPORTING DOCUMENTS ...................................................................... 85 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) DATA SHEET BASIC INFORMATION Product Information Project ID Project Name GEF Romania Integrated Nutrient Pollution Control P093775 Project Country Financing Instrument Romania Investment Project Financing Original EA Category Revised EA Category Partial Assessment (B) Partial Assessment (B) Related Projects Relationship Project Approval Product Line Supplement P099528-GEF Romania 30-Oct-2007 Global Environment Project Integrated Nutrient Pollution Control Project Additional Financing P155594-Integrated 28-Mar-2016 IBRD/IDA Nutrient Pollution Control Project - Additional Financing Organizations Borrower Implementing Agency Ministry of Finance Ministry of Environment, Waters and Forests Page 1 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Project Development Objective (PDO) Original PDO To support the Government of Romania to meet the EU Nitrates Directive requirements by (a) reducing nutrient discharges to water bodies, (b) promoting behavioral change at the commune level, and (c) strengthening institutional and regulatory capacity. Revised PDO The development objective of the project is to support the Government of Romania towards meeting EU Nitrate Directive requirementsat a national scale. FINANCING Original Amount (US$) Revised Amount (US$) Actual Disbursed (US$) World Bank Financing P093775 IBRD-48730 68,100,000 65,838,015 60,303,061 P093775 IBRD-85970 52,390,000 52,390,000 53,069,754 P099528 TF-58040 5,500,000 5,466,882 5,466,882 Total 125,990,000 123,694,897 118,839,697 Non-World Bank Financing 0 0 0 Total 0 0 0 Total Project Cost 125,990,000 123,694,897 118,839,697 KEY DATES Project Approval Effectiveness MTR Review Original Closing Actual Closing P093775 30-Oct-2007 08-Dec-2008 31-Mar-2011 31-Dec-2013 31-Dec-2023 Page 2 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) RESTRUCTURING AND/OR ADDITIONAL FINANCING Date(s) Amount Disbursed (US$M) Key Revisions 13-Jul-2012 14.55 Change in Results Framework Reallocation between Disbursement Categories Other Change(s) 05-Aug-2013 30.11 Change in Loan Closing Date(s) 08-Sep-2015 46.21 Change in Loan Closing Date(s) Reallocation between Disbursement Categories 28-Mar-2016 48.88 Additional Financing Change in Project Development Objectives Change in Results Framework Change in Components and Cost Change in Loan Closing Date(s) Change in Financing Plan Reallocation between Disbursement Categories Change in Disbursements Arrangements Change in Legal Covenants Change in Implementation Schedule 03-Nov-2016 53.70 Reallocation between Disbursement Categories 15-Oct-2019 69.75 Change in Safeguard Policies Triggered 22-Oct-2021 90.47 Change in Loan Closing Date(s) 20-Mar-2023 108.17 Change in Loan Closing Date(s) KEY RATINGS Outcome Bank Performance M&E Quality Satisfactory Satisfactory Substantial RATINGS OF PROJECT PERFORMANCE IN ISRs Actual No. Date ISR Archived DO Rating IP Rating Disbursements (US$M) 01 07-Mar-2008 Satisfactory Satisfactory 0 02 09-Nov-2008 Satisfactory Satisfactory 0 03 12-Apr-2009 Satisfactory Satisfactory 0 04 04-Dec-2009 Moderately Satisfactory Moderately Unsatisfactory 1.35 Page 3 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) 05 29-Apr-2010 Moderately Satisfactory Moderately Satisfactory 2.00 06 27-Mar-2011 Moderately Satisfactory Moderately Unsatisfactory 4.25 07 25-Mar-2012 Moderately Satisfactory Moderately Satisfactory 9.82 08 26-Dec-2012 Moderately Satisfactory Satisfactory 23.82 Moderately 09 18-Jun-2013 Moderately Satisfactory 26.71 Unsatisfactory 10 29-Oct-2013 Moderately Satisfactory Moderately Satisfactory 31.02 11 23-Jun-2014 Moderately Satisfactory Moderately Satisfactory 37.35 12 18-Dec-2014 Moderately Satisfactory Moderately Satisfactory 40.12 Moderately 13 23-Jun-2015 Moderately Satisfactory 45.94 Unsatisfactory 14 30-Oct-2015 Moderately Satisfactory Moderately Satisfactory 46.58 15 17-May-2016 Moderately Satisfactory Moderately Satisfactory 49.01 16 13-Dec-2016 Moderately Satisfactory Moderately Satisfactory 53.70 17 20-Jun-2017 Satisfactory Moderately Satisfactory 56.70 18 21-Nov-2017 Moderately Satisfactory Moderately Unsatisfactory 60.50 19 11-Jun-2018 Moderately Satisfactory Moderately Satisfactory 61.66 20 13-Dec-2018 Moderately Satisfactory Satisfactory 66.24 21 29-Apr-2019 Moderately Satisfactory Satisfactory 67.58 22 02-Dec-2019 Moderately Satisfactory Satisfactory 70.76 23 10-Jun-2020 Moderately Satisfactory Moderately Satisfactory 75.87 24 17-Dec-2020 Moderately Satisfactory Moderately Satisfactory 81.18 25 23-Jun-2021 Moderately Satisfactory Moderately Satisfactory 88.30 26 19-Jan-2022 Satisfactory Satisfactory 92.57 27 26-Jul-2022 Satisfactory Satisfactory 101.37 28 09-Feb-2023 Satisfactory Satisfactory 107.56 29 29-Jun-2023 Satisfactory Satisfactory 109.40 30 19-Dec-2023 Satisfactory Satisfactory 111.79 Page 4 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) SECTORS AND THEMES Sectors Major Sector/Sector (%) Agriculture, Fishing and Forestry 18 Other Agriculture, Fishing and Forestry 18 Public Administration 20 Other Public Administration 20 Water, Sanitation and Waste Management 62 Sanitation 35 Waste Management 27 Themes Major Theme/ Theme (Level 2)/ Theme (Level 3) (%) Private Sector Development 100 Jobs 100 Urban and Rural Development 26 Rural Development 26 Rural Infrastructure and service delivery 13 Land Administration and Management 13 Page 5 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Environment and Natural Resource Management 73 Environmental Health and Pollution Management 24 Air quality management 8 Water Pollution 8 Soil Pollution 8 Environmental policies and institutions 25 Water Resource Management 24 Water Institutions, Policies and Reform 24 ADM STAFF Role At Approval At ICR Regional Vice President: Shigeo Katsu Antonella Bassani Country Director: Anand K. Seth Marina Wes Director: Paula Caballero Sameh Naguib Wahba Tadros Practice Manager: Juergen Voegele Sanjay Srivastava Task Team Leader(s): Karin Shepardson Alexandru Cosmin Buteica ICR Contributing Author: Yelena Yakovleva Page 6 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES A. CONTEXT AT APPRAISAL Context, Sectoral Issues, and Rationale for Bank and GEF Involvement 1. At the time of INPCP appraisal, Romanian agriculture was dominated by individual and household farms, with around four million agricultural holdings, varying from less than 1 ha to 2,000 ha1, and with poor livestock management and lack of knowledge of environmental impact. Households in the Nitrate Vulnerable Zones (NVZs) had on average 2.2 hectares of arable land and livestock (one or two cows, pigs, chickens, and/or sheep), housed close to family dwellings, without adequate animal waste storage. Practices for animal manure collection, handling, and storage varied depending on local traditions. However, at the time of Project preparation the vast majority of households did not have mechanisms in place to prevent direct seepage of effluent into soil, surface and ground waters. Many small and medium- sized farms typically did not integrate environmental protection into their on-farm practices as they often lacked awareness of alternatives to meet the Nitrates Directive. 2. The water and wastewater service provision in Romania was also low compared to other European countries, while, historically, rural water supply and sanitation had been low government priorities. At the time of appraisal, of the 10 million people living in rural areas, 33 percent were estimated to have access to a piped water system, although fewer were presumed to benefit from such service, as many systems did not function properly due to poor maintenance and/or lack of funds. Many rural areas were dependent on septic tanks or cesspits at best (usually poorly built and maintained). Additionally, the Black Sea Environmental Program (BSEP) studies in 2007 revealed that 58 percent of the nitrogen and 66 percent of the phosphorous flowing in dissolved form into the Black Sea came from the Danube River Basin, while Romania had the largest land drainage area of the 13 countries comprising the Danube Basin (29 percent) and the largest population share (27 percent). Thus, even regionally, actions to stem nutrient pollution flow into the Danube and the Black Sea were seen as critically important in Romania. 3. The combination of underdeveloped sanitation, poor livestock management, and a large number of small farms with poor agricultural practices resulted in negative effects on infant health through significant nitrate and microbial contamination of shallow groundwater — the main source of potable water in rural areas. The effects of this were observed in high concentrations of nitrates, an indicator of general pollution and contamination affecting both environment and public health, notably through reported incidences of acute infantile methaemoglobinaemia—blue baby disease. 4. At the same time, Romania had progressively begun investing in improved environment infrastructure with the support of European Union (EU) pre-accession funds and wanted to expand coverage of these investments into the next decade and beyond with continued substantial support from the Structural and Cohesion Funds. At the time of appraisal, Romania’s accession to the European Union on January 1, 2007 represented both a remarkable achievement and an immense challenge, notably in the area of EU- mandated environmental compliance. Romania closed negotiations on the environment chapter of the Acquis Communautaire in November 2004, with detailed time-based agreements for adoption and implementation of regulations by accession and specified implementation periods for costly and difficult 1 Some 45% were smaller than 1 hectare, and about 80% of all farms qualified as subsistence holdings. Page 7 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) areas. Compliance with the environment acquis at the time of Project preparation was estimated at a net present value (NPV) of Euro 17 billion over a period of 11 years—the highest for any accession country. Agreements with the EU for improved water management included addressing nitrate pollution from agricultural sources. 5. In this context, there was a strong rationale for the Bank’s engagement to support the government’s priority of reducing nitrates and the correspondent implementation of the EU Nitrates Directive . The Bank had considerable experience with projects related to reduction and management of nutrient pollution from agriculture in Poland and the Black Sea region, as well as in East Asia, and played an important role in promoting exchange of best practices across countries through the Danube-Black Sea Strategic Partnership Program. The GEF-funded Agricultural Pollution Control Project (APCP) represented the World Bank and GEF’s earliest efforts to mainstream environment and nutrient reduction considerations into agriculture and served as a pilot for Romania and many other countries in the two Basins that replicated similar interventions. 6. Romania’s committed efforts towards EU accession and the recognition of the links between sustainable agriculture and the environment provided an excellent window of opportunity for the Bank and GEF to assist the country in undertaking a nutrient reduction program as part of its EU mandated Water Framework Directive, Nitrates Directive and agro-environment program. The project was the first GEF supported up-scaling effort, stemming from an earlier nutrient pollution reduction pilot. GEF involvement was, therefore, considered to focus on ensuring that countries, in the wider region and internationally, continued to learn from Romania’s efforts to scale up to the national level with significant state funds; and in order to promote integration of other investments such as wastewater treatment, sanitation, and biogas with earlier tested actions. 7. In 2008, INPCP covered 86 communes with direct investments only in the areas declared as nitrate vulnerable zones (NVZ) by the Government of Romania (GOR). Since almost the entire Romanian territory lies in the Danube River Basin2, in 2013, at the recommendation of the European Commission, Romania accepted that the entire national territory comply with the provisions of the Action Program for the waters’ protection against pollution with nitrates from agricultural sources. This decision to bring the entire territory of the country in compliance with the Water Framework Directive and Nitrate Directive posed challenges to the Ministry of Environment, Waters and Forests (MEWF) and Ministry of Agriculture and Rural Development (MARD). The Government considered that the Bank’s continued assistance to build national level capacity to address these challenges was critical and would complement and facilitate the use of other resources. 8. To help rural areas comply with the EU Nitrate Directive requirements, Romania needed further investments as well as the strengthening of related policies, regulations, administrative structures, services and competencies at the national, regional and local levels in the country. Starting in 2015, the farmers applying for direct payments from European funds and from the national budget, as well as those seeking European funds through certain payment schemes from the 2014-2020 PNDR had to comply with 20 norms related to cross-compliance (eco-conditionality), according to the Ministry of Agriculture 2 Black Sea Environmental Program (BSEP) studies revealed that 58 percent of the nitrogen and 66 percent of the phosphorous flowing in dissolved form into the Black Sea come from the Danube River Basin. Romania has the largest land drainage area of the 13 countries comprising the Danube Basin (29 percent) and the largest population share (27 percent). Page 8 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) requirements3. There was a critical need to provide farming communities with the necessary knowledge and tools to comply with the EU Water Framework and Nitrates Directives, and to improve Agency for Payment and Intervention in Agriculture (APIA) inspectors’ capacity for proper implementation. Similarly, even though there was a large program for sewage and wastewater treatment investments, the needs of the country were far beyond what is possible to finance from combined EU and GOR funding sources. 9. In 2016 (at the time of Additional Financing (AF) for INPCP), Romania was gradually transitioning from small scale household farming towards medium and large operations. At the same time, 92 percent of these farm holdings were less than 5 hectares, and the majority were subsistence holdings. Out of the total number of farms, 68 percent were mixed farms with crops and livestock. Despite the slow but constant increase in the number of medium-sized farms, the large majority of farms kept a few animals (most common animals are cows, pigs, sheep, goats, chicken) sheltered in the immediate vicinity of family dwellings, without adequate storage facilities for animal waste collection. This type of inappropriate agricultural practice leads to pollution of ground water with nitrates and bacteria and the spreading of unpleasant odors and flies, leading to the pollution of the groundwater, posing threats to the health status of the householders that use it as drinking water. While there was an overall downward trend of reduction in nutrient load discharge to water bodies, longer-term programmatic engagement was needed for sustained results. For instance, in 2009, percentage of monitoring points across NVZs covered by the INPCP that exceed the maximum value of nitrates in groundwater4 was recorded at 25.21 percent, while the percentage value across the same areas with historically intensive agricultural practices started to decrease, reaching 22.02 percent in 20155, yet still at a slow pace. 10. At the time of AF, the INPCP remained the main support vehicle for the implementation of the EU Nitrate Directive for small households and farms in Romania. GOR has therefore requested continued World Bank assistance in meeting this challenge to scale up the ongoing activities of the INPCP covering all the agroclimatic regions in the country. The AF was closely related to the ongoing activities at that time; therefore, splitting those into two projects was not justifiable given technical complexities and higher transaction costs involved. Theory of Change (Results Chain) 11. The INPCP and its AF were approved before presentation of a Theory of Change in the PAD became mandatory, and consequently, the PAD and the AF Project Paper did not contain any diagrammatic representation. Below, Figure 1 presents a Theory of Change (TOC) implicit in the project description and results framework in the original PAD. The key changes to the INPCP over time are discussed further in Section B, (Annex 1 presents the final Results Framework (RF) after restructuring). The ToC is built around the PDO, which is visible at the outcome level, and underpinned by an integrated approach to address nutrient pollution. Seven activities with nine related outputs were identified under the project, all leading to the long-term outcome of improving water quality, agricultural productivity and human health while strengthening Romania’s institutional and regulatory capacity for meeting EU requirements. 3 Order no. 352/636/54/2015 for the approval of cross compliance rules in the schemes and support measures for farmers in Romania. 4 Government Decision (GD) 53/2009 (on the approval of the National Plan for the protection of underground waters against pollution and degradation) that transpose European Directive 2006/118/EC defines the max value of nitrates in groundwater/ quality standard of 50 mg/l set. 5 Data from ANAR as reported by the PMU in Implementation Progress Reports Page 9 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Figure 1. Theory of Change Project Development Objectives (PDOs) 12. The Project Development Objective (PDO) at appraisal6 was to reduce nutrient discharges into water bodies and to promote behavior change through strengthened institutional and regulatory capacity and demonstrated commune-based actions and, hence, support the Government of Romania to meet the EU requirements in the field of water protection. While the Loan Agreement had a slightly different formulation of the PDO, in the essence both were the same, and the 2016 AF and restructuring was an opportunity to address this and further streamline the INPCP's PDO. 6 Loan Agreement dated December 28, 2007. PAD PDO was to support the Government of Romania to meet the EU Nitrates Directive requirements by (a) reducing nutrient discharges to water bodies, (b) promoting behavioral change at the commune level, and (c) strengthening institutional and regulatory capacity. Page 10 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) 13. The Global Environment Objective (GEO) was to reduce over the long term, the discharge of nutrients (nitrogen and phosphorous) into water bodies leading to the Danube and Black Sea through integrated land and water management. Key Expected Outcomes and Outcome Indicators 14. As originally approved, the abovementioned three PDO outcomes and their respective indicators were: (i) ‘to reduce nutrient discharges into water bodies’ was to be measured by “At least 80 percent of targeted NVZs show 10 percent reduction in nutrient discharge to water bodies”; (ii) ‘to promote behavior change’ was to be measured by “Around 50 percent of the population in the project area adopting preventative and remedial measures to reduce nutrient discharges”; and (iii) ‘support the Government of Romania to meet the EU requirements in the field of water protection’ was to be measured by “Improved inter-governmental coordination and capacity to assess, monitor and report on progress with implementation of the EU Nitrates Directive” and “Favorable EU assessment of Romania’s progress towards meeting EU Nitrates Directive”. 15. The GEO objective ‘to reduce over the long term, the discharge of nutrients (nitrogen and phosphorous) into water bodies leading to the Danube and Black Sea’ was to be measured by “Increased awareness of linkages between local actions and impact on Black Sea and Danube River water quality”. Components 16. The INPCP project was designed with the following four components at appraisal: 17. Component 1: Commune-based Investments in Nitrate Vulnerable Zones (NVZs) (IBRD EUR 39.4m and GEF US$2.1m; AF: EUR 35m). This component was designed to support a menu of investments focusing on the NVZs’ designated 91 communes in ten river basins. In the first eighteen months, the project was designed to support the creation of eleven Training and Dissemination Sites (TDSs)7. Selection of the counties was performed on the basis of the location of the maximum number of NVZs, proximity of the county to the River Basin headquarters, and willingness of the County Council to participate. Subsequent project investments were planned to be rolled out to another 80 NVZs/communes in the 23 remaining counties. The menu of eligible investments from which communes were intended to prepare sub-project investment programs included activities as follows: (1.1) communal storage and handling systems to promote better management of livestock and household waste, (1.2) planting of buffer strips and pastures’ rehabilitation to protect against nutrient discharges, (1.3) water and sanitation activities to rehabilitate or extend small-scale sewage collection and treatment at two to three sites, (1.4) promotion of the Code of Good Agricultural Practices to encourage farmers to adopt good nutrient management practices including crop rotation, manure management, soil testing, and organic farming, which farmers are would be obliged to apply in the NVZs, through a training and on-farm demonstration program, and (1.5) feasibility studies for improving water and wastewater services, with the aim of leveraging external (EU) financing for investments. GEF funds were to test and demonstrate the feasibility of biogas/energy co-generation of manure/organic household waste through anaerobic digestion in one pilot commune. 7Target counties are: Arges county (Arges-Vedea River Basin), Buzau (Buzau-Ialomita River Basin), Valcea county (Olt River Basin), Lasi county (Prut-Barlad River Basin), Bacau and Neamet counties (Siret river basin), Cluj county (Somes-Tisa river basin), Timis county (Banat River Basin), Bihor county (Crisuri River Basin), Mures county (Mures river basin) and Dolj county (Jiu river basin). Page 11 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) 18. Component 2: Support for Institutional Strengthening and Capacity Building (IBRD EUR 3.9m and GEF US$2.7m; AF: EUR 5.5m). This component was focused on building capacity within the Ministry of Environment and Sustainable Development (MESD)8 and their National Administration for Romanian Waters (ANAR), as well as other national, regional, and county agencies involved in implementing the Nitrates Directive (i.e., Public Health, Agriculture, etc.). Specifically: (2.1) technical assistance to bring Romanian legislation in line with EU Nitrates Directive regulations and selected measures under the Water Framework Directives to clarify implementation and coordination responsibilities across agencies, (2.2) capacity building for ANAR (subordinated to the MESD) as the designated lead for inter-agency working groups at the river basin and county levels for the Nitrates Directive, including 50 new monitoring wells, funds to repair additional wells, auto-labs, other small equipment, and training facilities, to respond to the new and increased monitoring responsibilities upon EU accession, and (2.3) a comprehensive training program for staff of relevant national, regional and county level agencies that are members of the Nitrates Working Groups focused on M&E and EU reporting requirements. 19. Component 3: Public Awareness and Replication Strategy (IBRD EUR 2.5m and GEF US$0.2m; AF: EUR 3.5m). This component was designed to support a broad public information campaign of the project’s activities and benefits at the local, river basin, national and regional levels to achieve replication of project interventions in other similar areas within Romania (NVZ-designated communes in non-focus counties) as well as other Black Sea riparian countries and EU candidate countries. In particular, this component was designed to promote improved rural sanitation in the NVZs, and implementation of good agricultural practices, such as composting, conservation tillage, crop rotation, etc. 20. Component 4: Project Management (IBRD EUR 4.2m and GEF US$0.5m; AF: EUR 4m). This component was to support the Project Management Unit (PMU) located within the Ministry of Environment and Sustainable Development (MESD) with its day-to-day management of the project. The Water Basin Authority in each of the ten river basins planned to dedicate one or two staff to supervise and coordinate project implementation activities at the commune level. 21. The total cost of the project at Appraisal was EUR 50m IBRD loan (US$68.1m equivalent) and US$5.5m GEF grant. This increased to EUR 98m IBRD loan (US$120.49m equivalent) and US$5.5m GEF grant or US$125.99m, total with the 2016 AF, while the actual cost at Project Closing was US$118.84 million or 99.56 percent (see Annex 3 for the cost tables). The INPCP original loan (4873-RO) closed after the grace period (September 30, 2017) with a final balance EUR 1.92m (out of total EUR 50m) that had not been used at the closing date, primarily due to cost savings, and the GEF Grant (TF058040-RO) closed with almost 100 percent execution of grant amount. B. SIGNIFICANT CHANGES DURING IMPLEMENTATION (IF APPLICABLE) Revised PDOs and Outcome Targets 22. With the approval of AF on March 28, 2016, the INPCP PDO was streamlined and geographically broadened beyond the focus on NVZs, as follows: ‘The development objective of the project is to support the Government of Romania towards meeting EU Nitrate Directive requirements at a national scale9’. The original PDO was revised with the AF to improve its outcome focus and reflect the broader geographic 8 Currently Ministry of Environment, Waters and Forests (MEWF) 9 Loan Agreement 8597-RO dated April 14, 2016 Page 12 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) coverage of the project. The original PDO elements related to (a) reducing nutrient discharges to water bodies, (b) promoting behavioral change at the commune level, and (c) strengthening institutional and regulatory capacity, continued to be implicitly part of the revised PDO and measured by relevant PDO and intermediate level indicators throughout the life of the project. 23. With the 2016 AF, the Results Framework was adjusted to reflect the increase in scale and revise the end targets for some of the indicators, as well as rationalize the number of indicators, focusing on those of direct relevance to the PDO. Two PDO level indicators remained unchanged (OI1 and OI2), two PDO level indicators were revised, including the end targets (OI3 and OI4), and one additional PDO level indicator was formally introduced (OI5). OI4 ‘At least 80% of targeted NVZs show 10% reduction in nutrient load discharge to water bodies’ was revised to OI4 ‘Downward trend of nitrates concentration in waters: at least 70% of targeted project areas show 10% reduction in nitrates discharge to water bodies’ to reflect the change of scale, moving from just NVZs to the whole country geographically, while the reduction of 10 percent in nutrient load discharged remained the same irrespective of expanded geographical target areas. OI3 target was increased from 50 percent to 75 percent given the ambition and scale of the AF. 24. The GEO indicator continued to be featured in ISRs until the GEF grant closure in May 201710. At Project Closing, the PDO comprised one expected outcome and five respective revised PDO Indicators. Table 1. PDO Objective, PDO Indicators and Targets at Project Closing At Project Closure, December 2023 PDO Outcome PDO Indicators End Targets To support the OI1: Improved inter-governmental coordination and capacity to assess, monitor and Improvements Government of report on progress with implementation of the EU Nitrates Directive acknowledged Romania towards meeting EU OI2: Favorable EU assessment of Romania’s progress towards meeting EU Nitrates Progress Nitrate Directive Directive acknowledged requirements at a national scale OI3: Percentage of population in the project area adopting preventative and 75% remedial measures to reduce nutrient discharges (index measures various rural waste management and good agricultural practices)- revised OI4: Downward trend of nitrates concentration in waters: at least 70% of targeted 70% project areas show 10% reduction in nitrates discharge to water bodies – revised OI 5: Nutrient load reduction (Nitrogen(N)) achieved under the project (Tones/year) 600 tons/year - new Revised Components 25. At Project completion, the four INPCP components remained largely the same as at appraisal, with a broader scope and re-organization of some activities between components as follows (see Annex 3 for details on the evolution of project components and costs): 26. Component 1 was renamed as ‘Investments in Local Communities for Reducing Nutrient Pollution’ with the 2016 AF to reflect the shift from NVZs to the countrywide scope, adjusting also the component’s 10 As GEF grant was fully committed (over 96 percent in December 2016) by the AF, the GEO indicator was not part of the AF. It was assessed during Interim INPCP ICR (Report No: ICR00003554, dated January 30, 2016) and included in ISRs until Seq.19 (June 2018) with the last reported date of October 2017. Page 13 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) costs. The component didn’t have any sub-components, however, included several activities, which remained throughout project implementation, such as (1.1) Communal Storage and Handling systems to promote better management of livestock and household waste; (1.2) Planting of Buffer Strips and Pastures’ Rehabilitation; and (1.3) Water & Sanitation. The 2012 Restructuring dropped one activity (1.5) on feasibility studies for construction of community wastewater management systems to be used for applications for EU funding given lack of demand and availability of EU funds specifically for this purpose. With the 2016 AF, activity (1.4) ‘Promotion of Code of Good Agricultural Practices’ was moved under Component 2 as sub-component (2.1) ‘Developing knowledge and training activities (through providers), as well as support for on-farm demonstrations, to improve adoption and compliance by farmers with the Code of Good Agricultural Practices’. This shift was to consolidate capacity building activities under Component 2 and focus Component 1 on community level physical investments only. 27. Component 2 was renamed as ‘Institutional Strengthening and Capacity Building’ with the 2016 AF, introducing also a sub-component (2.1), as above, and adjusting the component’s costs. The overall scope remained the same, with an emphasis on capacity building by providing the necessary equipment and the training sessions for staff with responsibilities for water quality monitoring and reporting on the EU Nitrate Directive implementation. Also, this component provided knowledge and training to farmers through facilitator and on-farm demonstrations with the support of farmer organizations. The latter covered activities (2.1) to set-up and develop Knowledge Transfer Networks (KTNs) to improve the adoption and compliance by farmers of the Code of Good Agricultural Practices, including through the establishment of helpdesk. 28. Component 3 was renamed ‘Public Awareness and Information Support’ with the 2016 AF, adjusting the component’s costs. The scope remained largely the same throughout the project implementation, with additional focus of the AF on promoting replication of the activities under the Project in other counties as well as in other Black Sea riparian countries and EU candidate countries. 29. Component 4 on Project Management remained the same in scope throughout project implementation but with adjustments in the component’s costs and an intermediate indicator that was introduced at 2016 AF entitled ‘Number of surveys conducted that collect feedback and report back the results to the communities’. Other Changes 30. The INPCP had eight restructurings. The overall changes to the Project were introduced in the 2012 (Level 2), 2013 (Level 2), 2015 (Level 2) formal restructurings and the 2016 AF (Level 1), followed by four more restructurings: 2016 (Level 2); 2019 (Level 2); 2021 (Level 2); 2023 (Level 2). Details are in Annex 6. 31. Other revisions made to INPCP include the following: (i) reallocations between components and disbursement categories, including changes in disbursement estimates (two reallocations before the AF and one reallocation during the AF); (ii) triggering Operational Policy/Bank Procedure (OP/BP) 4.04 with the 2019 Restructuring; and (iii) changes in the implementation schedule associated with five extensions of the Project Closing Date, from December 31, 2013 to November 30, 2015, to May 31, 2017, then to March 31, 2022 with the 2016 AF, and to June 30, 2023, and to December 31, 2023. Finally, changes were Page 14 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) made to the Legal Covenants with the 2016 AF. There were no changes to the implementation arrangements. Rationale for Changes and Their Implication on the Original Theory of Change 32. The 2012 Restructuring was undertaken to improve project implementation performance by focusing on core activities that would ensure that the PDO and GEO are met by the closing date. The Restructuring streamlined project activities to strengthen the original design and address the needs for implementation capacity improvement. Under Component 1, community wastewater investments were expanded from 2-3 as originally envisaged to 9 villages, in order to accelerate the pace of investments in nutrient management in communities in NVZs. While the number of communal waste platforms was reduced due to the lack of appropriate sites and difficulties in obtaining construction permits, support to community household farms for building on-farm individual animal waste platforms was reoriented, from an expensive concrete-based platform design to a plastic-based cheaper and equally efficient alternative, thus allowing more farmers to benefit from the project. The activity involving feasibility studies for construction of community wastewater management systems to be used for applications for EU funding was cancelled, because of lack of demand and availability of EU funds specifically for this purpose. The PMU was strengthened through additional staffing to augment its technical and monitoring capacity with expertise in agriculture, safeguards, public awareness, and legal affairs. The Results Framework was slightly amended and the adjustments in project activities also required reallocation between components. Overall, the changes were necessary to account for initial implementation delays and more recent progress. 33. The 2013 Restructuring extended the Closing Date by 23 months, to November 30, 2015. This first extension was needed because the project has had a substantially reduced 2013 budget allocation due to budget scarcity at the government level, making it impossible to complete all project activities and achieve its development objectives. 34. The 2015 Restructuring involved a second extension of project closing date by 18 months to May 31, 2017, and reallocation of the loan and GEF grant proceeds among Project components. The extension was needed to fully achieve the Project’s Development and Global objectives, and in parallel, to prepare the AF to scale-up the original Project at the national level with direct support of the fully staffed Project Management Unit (PMU). The need for reallocation of grant proceeds was necessary to cover additional technical assistance needs, particularly to expand the successful public awareness campaigns and information dissemination efforts, and the additional project management costs due to extension. 35. The 2016 AF and Restructuring was to scale-up ongoing investments and provide comprehensive knowledge and Technical Assistance (TA) to farmers and relevant institutions. Project restructuring was processed concurrently with the AF to revise the Results Framework (RF), including the PDO to improve its outcome focus, and introduced changes in the project components. The RF was revised to reflect the change in scale and the end target values and dates for some of the indicators, as well as rationalize the number of indicators, focusing on those of direct relevance to the PDO. Since the AF extended the life of the project beyond 10 years, an interim ICR11 was prepared. The interim ICR outcome rating was 11 Report No: ICR00003554, dated January 30, 2016 Page 15 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Moderately Satisfactory as the project was still undergoing implementation (Relevance: Substantial; Efficacy: Substantial; Efficiency Rating: Modest). 36. An additional Restructuring was needed in 2016 to reallocate the amounts for both the original loan and GEF to allow the Project to fully use the remaining funds due to savings achieved and enable completion of additional activities before the closing date. For the original loan, there have been savings under Components 3 and 4 which were used for additional expenditures under Components 1 and 2. Under the GEF grant, the small amounts that remained in Components 1 and 3 were used for strengthening the institutional capacity of the PMU. 37. The 2019 Restructuring involved triggering of a new safeguard policy – OP 4.04: Natural Habitats. At the time of AF appraisal, there was no evidence to suggest that the Natural Habitats policy would be triggered for the investments envisioned under the Project. However, following a new safeguards analysis and considering the environmental conditions and specific measures included in the permits issued by the local environmental protection authorities for each new investment (platforms for animal waste management) selected to be financed under the AF, it was concluded that 8 out of 89 new investments have the proposed location in protected areas (Natura 2000 sites) established in Romania, and hence OP 4.04 required to be triggered. 38. Both 2021 and 2023 Restructurings involved Closing Date extension. The 2021 restructuring extended the AF by 15 months to June 30, 2023, to ensure all project activities are fully implemented in a satisfactory manner, allowing, in particular, to complete the remaining communal manure platforms and composting stations, and the activities delayed due to the COVID-19 outbreak. The 2023 Restructuring was to extend the Closing Date by six months to December 31, 2023, to ensure that the loan is fully disbursed while contributing to a smooth transition to its follow-on operation (Romania Rural Pollution Prevention and Reduction Project, RAPID – P179786) and its readiness for implementation. Cumulatively, the INPCP (original loan and AF) was extended by 62 months, and the project age at the time of completion was 16 years and two months. 39. The Theory of Change (implicit) has benefitted from the adjustments to the PDO and the Results Framework. There were, however, no major changes to the RF or substantial changes to the project design that influenced the overall TOC. The original PDO was revised with the AF to improve its outcome focus and reflect the broader geographic coverage of the project. The Results Framework was adjusted with the AF to reflect the change of scale and revise the end targets for some of the indicators, as well as rationalize the number of indicators, focusing on those of direct relevance to the PDO. 40. Although INPCP was restructured eight times, and the AF involved revision of the PDO and of some of the outcome targets, a split rating is not applied to assess the outcome rating, because the AF has expanded the project’s scope and ambition. INPCP will be assessed on the basis of the revised outcomes and outcome targets. Page 16 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) II. OUTCOME A. RELEVANCE OF PDOs Rating: High Assessment of Relevance of PDOs and Rating 41. At project closing, the INPCP remained highly relevant to Romania's strategic development priorities and is fully aligned with the latest CPF for the period FY19–FY2312. The project contributes to the overarching goal of the CPF: improving public service delivery by strengthening national and local institutional and regulatory capacity as it relates to monitoring rural nutrient pollution. The CPF focuses on building better public institutions through three focus areas and the project underpins two of them. First, focus area 1 ‘Ensure Equal Opportunities for All’, by improving knowledge transfer and preventing and reducing rural pollution that are of particular importance for the poor and vulnerable. Second, focus area 3 ‘Build Resilience to Shocks’, through support to farmers for improving good farming and nutrient management practices, contributing to both climate mitigation and adaptation. As such, the project supports EU’s joint Nationally Determined Contributions and Romania's Integrated National Energy and Climate Change Plan 2021–2030. 42. The INPCP remained one of the main sources of funds in meeting Romania’s obligations related to the EU Water Framework Directive since the beginning and throughout its lifetime. Thus, the Bank’s support under INPCP was consistent with the Bank’s 2004 Romania Country Economic Memorandum that identified the key challenges of the environment acquis, including strengthening institutional, administrative, and operational capacity for implementation of the environment acquis; and accelerating the capacity of the private sector (and other non-government parties) to meet EU Environment standards in line with improving market competitiveness. The AF was fully consistent with the WBG’s FY14-17 Country Partnership Strategy (CPS) for Romania, contributing to its strategic pillars on (i) creating a 21st century government (by strengthening institutional and regulatory capacity towards meeting the EU Water Framework Directive and EU Nitrates Directive requirements); (ii) growth and jobs creation (by the construction and operational maintenance of platforms); and (iii) social inclusion (by reducing nutrient pollution in Romania’s water bodies in the project area and promotion of behavioral change at the community level). Finally, the project is consistent with the priorities of the new CPF FY24-28 currently under preparation. This CPF will focus on contributing to Romania's convergence with EU peers, through "improved human capital outcomes, enhanced environment for more and better jobs, increased resilience and accelerated green transition, while enhancing institutions to serve all people and businesses as a cross-cutting theme", and INPCP delivers important outcomes to support these objectives. 43. The project has also remained highly relevant and aligned with the World Bank's evolving corporate priorities. The project supports the WBG's recent Green Resilient and Inclusive Development agenda and is fully consistent with the WBG's Climate Change Action Plan 2021–2025, which supports transformational integrated landscape management, pollution reduction, and CSA across the entire agriculture and food value chains through technological interventions and sustainable land management. The project is aligned with the Bank’s Evolution Roadmap and its mission of ending extreme poverty and boosting prosperity on a livable planet through enhanced environment for increased resilience. 12 Report # 126154, discussed by the Board on June 19, 2018 Page 17 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Furthermore, the project is aligned with the Global Crisis Response Framework Paper (GCRF), which outlines the WBG response to the ongoing crises: by focusing on better management of livestock waste and of inorganic fertilizer use, the project aligns with Pillar 1: Responding to Food Insecurity and Pillar 3: Strengthening Resilience (sustainable food systems) of the GCRF paper. In addition, the project also contributes to Pillar 4: Strengthening Policies, Institutions, and Investments for Rebuilding Better (through the targeted institutional strengthening and capacity-building activities). B. ACHIEVEMENT OF PDOs (EFFICACY) 44. This section assesses the Efficacy of the project in achieving INPCP’s PDO outcomes at Project Closing, which is ‘to support the Government of Romania towards meeting EU Nitrate Directive requirements at a national scale’. The data for assessing the outcomes is drawn from INPCP's M&E system, including the post-monitoring work by the PMU. INPCP’s efficacy is assessed and informed by the information and data that are reflected in the Borrower's Implementation Completion and Results Report, in the Bank's 30 Implementation Supervision Reports (ISRs), findings of the 2016 Interim ICR, as well as information gathered during the ICR mission conducted in November 2023. Assessment of Achievement of Each Objective/Outcome Rating: Substantial 45. The Efficacy of INPCP is rated Substantial given achievement of its development objective (DO) and as supported by results of respective outcomes (IOs) and intermediate level indicators (IRIs). The PDO statement includes one objective, which was stated clearly and supported by a comprehensive set of appropriate qualitative and quantitative outcome indicators and IRIs that built on the parent project experience. Detailed information on achievement of outcome indicators and IRIs is presented in Annex 1. Primary outcome indicators: IO1 ‘Improved inter-governmental coordination and capacity to assess, monitor and report on progress with implementation of the EU Nitrates Directive’ (Target: Improvements Acknowledged) was achieved and IO2 ‘Favorable EU assessment of Romania's progress towards meeting EU Nitrates Directive’ (Target: Progress Acknowledged)’ was achieved. 46. The institutional strengthening has been a key focus of the INPCP since its approval in 2007. The Commission or the Inter-Ministerial Committee was established by GD 964/2000 to ensure effective implementation of the Action Plan on the protection of waters against nitrate pollution from agricultural sources. This committee consists of specialists from the Ministry of Environment, Water, and Forest, Ministry of Agriculture and Food, and Ministry of Health. Additionally, a Support Group, which includes representatives from the National Company "Romanian Waters" (ANAR), basin committees, and specialized institutes and units under the coordination of the relevant ministries, has been formed. With the technical assistance provided by the project, the Inter-Ministerial Committee remains fully functional, with regular meetings organized on a yearly basis. In the April 2023 meeting, the PMU delivered a presentation on the activities implemented and the results achieved under the Project. 47. The Project has successfully strengthened institutions involved in the implementation of the EU Nitrates Directive in Romania, ensuring effective coordination and collaboration among relevant ministries and agencies. The Project Management Unit (PMU) actively participated in technical discussions and played an important role in developing the updated version of the Code of Good Agricultural Practices for the Page 18 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Protection of Water against Pollution with Nitrates from Agricultural Sources. Importantly, the scientific ground of the revisions was ensured through the INPCP and involved a research institute, Research Institute for Soil Science and Agrochemistry (ICPA), including extensive consultations with academia, farmers' organizations, and relevant institutions (ANAR, APIA, AFIR, Environmental Guard, ANPM, etc.). In particular, the Project facilitated and built strong institutional links between the MEWF and the Ministry of Agriculture. The Inter-Ministerial Nitrates Commission remains an important tool of inter-institutional cooperation and coordination with clear objectives and sound results on the improvement of the Code of Good Agricultural Practices in Romania. Importantly, amendments to the Code of Good Agricultural Practices created the appropriate conditions for ensuring compliance with current EU standards and regulations for water protection against pollution with nitrates from agricultural sources. The project was instrumental in drafting amendments to the Code with a focus on revisions that address the current needs of farmers, with an emphasis on the efficiency of the use of fertilizers, revising action programs, and heralding behavioral changes among Romanian farmers through comprehensive capacity building activities and outreach. 48. The latest report on Romania’s implementation of the EU Nitrate Directive 91/676/EEC for the period 2016-201913 received a positive outcome by the European Commission. The achievements of INPCP were highlighted by the European Commission as a major investment project targeting the reduction of water pollution with nutrients. The Project not only involved important physical interventions but also focused on information dissemination, awareness raising, education, training, and support provided to farmers and all stakeholders interested in protecting waters against pollution with nitrates from agriculture. The report did not receive any negative comments, which is a testament that Romania's efforts in implementing the Nitrate Directive were recognized and acknowledged. The 2012-2015 Report was submitted to the European Commission on July 8, 2016. Except the 8-day submission delay, the Report did not mention problems and there were neither infringement cases nor EU Pilot investigation opened for Romania, including to date. Overall, the reports prepared by Romania on the Nitrate Directive implementation for the last four reporting periods (2004-2007; 2008-2011; 2012-2015; 2016-2019) were submitted on time and were accepted by the DG Environment of the EU Commission. The next report for the period of 2020-2023 is being prepared and due for submission in June 2024. It is acknowledged that the country still has specific hotspots with pollution level that exceeds the quality standard of 50 mg/l set (underground water) through GD no. 53/2009. At the same time, the percentage of monitoring points above the threshold decreased substantially throughout the project’s implementation period, from 25.21 percent in 2009 to 11.43 percent in 2022, across the same areas with historically intensive agricultural practices14. 49. Importantly, INPCP supported the Romanian Government to become an important actor in promoting nutrients sustainable policies at EU and Global levels. Through active participation at numerous events and undertaking a leadership role, INPCP’s efforts led to the establishment of a Working Group on Nitrogen, managed by UNEP with representatives from almost 80 Member States. The Working Group is 13 The report was submitted to the European Commission in June 2020. Council Directive 91/676/EEC (the Nitrates Directive) aims to reduce water pollution caused by nitrates from agricultural sources and to prevent such pollution through a number of steps to be fulfilled by Member States. As an EU member state, Romania is obliged to comply with the EU Nitrates Directive and the preparation and implementation by the local authoritie s of the “Action programs for water protection against pollution caused by nitrates from agricultural sources” has become mandatory throughout the entire territory of Romania. 14 The Romanian Plain and areas of the Moldova Plain and the Western Plain Page 19 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) focused on improving nitrogen management by promoting an Action Plan for Sustainable Nitrogen Management, involving countries globally. Romania was also invited by UNEP to designate a focal point and to submit its candidacy for co-chairing the UNEP Working Group on Sustainable Nitrogen Management. In April 2023, Romania, through the INPCP, in partnership with UNEP, organized the third meeting of the UNEP Working Group, proposing for the first time a template for national action plans on reducing reactive nitrogen losses, at the Global level. Cross-cutting outcome indicator: OI3 ‘Percentage of population in the project area adopting preventative and remedial measures to reduce nutrient discharges (index measures various rural waste management and good agricultural practices’ (Target: revised with 2016 AF from 50 percent to 75 percent; Actual value: 76.5 percent) was 102 percent achieved. 50. INPCP played an important role to promote behavior changes with regards to prevention and reduction of pollution from the agriculture and adoption of sustainable land management practices. The progress was measured with the Beneficiaries’ Survey Reports carried out at the start of the AF (2018), mid-point (2020), and at project closing (2023), using the same methodology and covering about 3,750 households across 100 communes in the project area. At the mid-term evaluation in 2020, the results indicated that 69 percent of the population in the project area had adopted at least one of the practices recommended by the Code of Good Agricultural Practice. These practices served as preventive and remedial measures to reduce nutrient discharges. The final survey, completed in October 2023, indicated that approximately 76.5 percent of households in the communes with investments in the project area had adopted preventive and remedial measures to reduce nutrient discharges. This increase in the adoption of preventative and remedial measures can be attributed to a combination of investments at the commune level and individual farmstead level, along with a successful communication and outreach strategy at the national, local, and individual farm levels. 51. INPCP remained the most important support for the farmers in Romania to meet the conditions as required by the Common Agriculture Policy, while being a model of good practices in this sector at regional and global levels. Under Component 1, the project supported 202 communes that are currently implementing different practices and measures for nutrients reduction, with about 48,300 land users adopting sustainable land management practices. As result, the percentage of cropped area in the project communes under relevant nutrient reduction measures reached 75.8 percent in 2023, compared to the baseline of 9 percent in 2009. This was complemented with capacity building activities such as targeted trainings and other events organized within Knowledge Transfer Networks (KTNs) for farmers, representatives of local administrations and other interested parties with a focus on agricultural legislation, environmental compliance requirements, available funding sources, penalties associated with non-compliance, analysis of the actions undertaken by the Member States for the sustainable management of nitrogen and on the development of a model action plan to reduce pollution with nitrogen compounds. INPCP continued to be highly efficient in assisting the Government of Romania in meeting its obligations as a member of the EU by strengthening the country’s capacity at central and local levels for meeting EU requirements. The approval of RAPID project in 2023 that adopts INPCP’s institutional arrangements, further attests to the project’s continuing high relevance to enhanced environment and climate action in line with EU requirements. Supporting outcome indicators: OI4 ‘Downward trend of nitrates concentration in waters: at least 70 Page 20 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) percent of targeted project areas show 10 percent reduction in nitrates discharge to water bodies’ (Target: 70 percent; Actual value: 70.1 percent) was 100 percent achieved and OI5 ‘Nutrient load reduction (Nitrogen(N)) achieved under the project’ (Target: 600 tons/year; Actual value: 698.68 tons/year) was 116 percent achieved. 52. Physical investments and new habits in improved manure management that were promoted by the project, led to nutrient loading in waterways being reduced or avoided. Local residents are able to see firsthand how their actions impact the health of local waterways and water quality. In particular, as a result of the investments constructed under the project (174 communal platforms) and used by communes, rural populations in the targeted investment areas are able to access the infrastructure for improved manure management and proper sewerage systems. The majority of the small farm holders were not adopting environmentally friendly agricultural practices and thus significantly contributed to non-point nutrient pollution. This leads to the pollution of the groundwater, posing threats to the health status of the householders that use it as drinking water. With over 369 discussion groups, supported by around 243 champion farmers and 76 communal platforms hosting demonstrations for manure management good practices, as well as with approximately 1,600 trained farmers, INPCP helped provide farming communities with the necessary knowledge and tools to comply with the EU Water Framework and Nitrates Directives. As a result of the Project, the nutrients load reduction (N) due to the platform’s operation stands at 671.18 tons and due to the sewerage systems operation – at 25.50 tons15. In time of the AF (2016), this value was 311.23 tons, less than half of the current result achieved by the Project. This indicator was measured on a yearly basis, with 174 manure platforms completed (versus 150 manure platforms planned) and related equipment handed over to the beneficiary communes. 53. Improvements in equipment and comprehensive training and capacity building efforts made an important contribution to improving MEWF and ANAR capacity for monitoring, control, and reporting within the framework of the EU Nitrate Directive. Overall, in Romania, the total number of groundwater monitoring stations in 2011 was 1809 (representing a density of 7.50 per 1000 km2), which increased to 1935 in 2023 as a result of project interventions (a density of 8.12 per 1000km2). The INPCP supported the extension of the network with 63 new piezometers in the original loan, and 13 more under the AF, including 50 rehabilitated piezometers in the existing network since 2019. To monitor OI4 progress, the initial monitoring network of ANAR included 124 piezometers in 2009 (to cover NVZs) and expanded up to 175 monitoring wells and 115 sections on rivers and lakes since 2019 (to cover whole country). The monitoring data for the year 2022 was provided by ANAR in May 2023, based on which the indicator was calculated to compare it with the baseline in CY2009. This allows for a comprehensive assessment16 of the changes in water quality over time. According to the monitoring data provided by ANAR, 70.1 percent of the monitored wells showed nitrates (NO3) concentrations with at least a 10 percent lower value compared to the baseline measurements taken in 2009. The physical infrastructure was supported by a strong and comprehensive training programs organized by the project for staff within relevant agencies 15 The calculation for the nutrients load reduction (N) due to the platform's operation is determined by multiplying the volume of wastewater treated by the difference between the inflow and outflow concentrations of nutrients. The monitoring data were collected through the communication with the local authorities (across 129 localities) and recorded by the PMU in the Implementation Progress Reports. The latest data sets are recorded for 2022. 16 Under the management of ANAR, there are 11 Water Basin Directorates (WBDs) that collect and process information on surface and ground water quality from the WMSs in their basin. Ultimately, the information collected from the 11 WBDs is integrated by ANAR and consolidated by the PMU, serving as a basis for the report on nutrient pollution. Since 2019, the monitoring network includes 175 monitoring wells and 115 sections on rivers and lakes. Page 21 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) and members of Nitrates Working Groups, empowering them with the knowledge and skills necessary for directive compliance. See Annex 1 for further details. GEO on ‘Increased awareness of linkages between local actions and impact on Black Sea and Danube River water quality’ was partially achieved at GEF Grant Closure in 2017. 54. With the GEF grant approaching its closure and full disbursement, the GEO indicator was not included in the 2016 AF but was tracked until the GEF grant closure in May 201717. The progress was updated based on the Final Survey completed in November 2016 with the actual value of 23.5 percent, equivalent to 78.3 percent of the end target of 30 percent. Overall, the data from 2008, 2012, 2014 and 2016 surveys presented that the population was more aware about the polluting effects of improper agricultural practices on the local environment but less informed about the polluting effects of improper agricultural practices on the nationwide environment, as on the Danube River and the Black Sea. However, in the particular case of the Danube River and the Black Sea, some increase in the awareness has been observed, from 16 percent in 2008 to 21 percent in 2012, and 23.5 percent in 2016. Furthermore, while it didn’t specifically mention the GEO indicator, the End of Project Survey dated October 2023 highlighted that the awareness of the polluting effects of improper waste and manure management has significantly increased by more than 10 percent compared to 2018 in all types of localities, regardless of the source of pollution considered. Justification of Overall Efficacy Rating 55. Given that INPCP has achieved its development objective, met or exceeded all five PDO indicators and almost achieved its GEO indicator as well as considering the project’s substantial contribution to the institutional strengthening and successful leverage of EU funds for farms modernization under the National Rural Development Program in Romania18, and as the project achieved or exceeded 14 of the 15 IRIs, the Efficacy of INPCP is rated as Substantial. C. EFFICIENCY Assessment of Efficiency and Rating Rating: Modest Aspects of Design and Implementation 56. The simple and robust project design, closely aligned with the priorities identified in the CPS at preparation and CPF at time of the AF, was consistent with international best practices and incorporated lessons learned from similar nutrient management projects. The solid quality at entry helped carry the project through multiple phases and added to overall efficiency. Under the helmet of the MEWF, the project gained significance in leading Romania on the path to compliance with the EU Nitrates Directive. The close collaboration between the MEWF and farmer’s organizations and agricultural extension services has greatly contributed to bringing the MEWF and the MARD closer together and increased institutional efficiency. Bank supervision was fairly consistent despite several changes in task team leadership, with the presence of a local TTL/co-TTL during the AF period. A comparison of actual 17Last time reported end target value in October 2017. 18Investments from the National Recovery and Resilience Plan -the instrument of the Next Generation Europe funds- on communal platforms, composting, and biogas plants of over EUR 250 million for farmers in Romania. Page 22 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) cost by component to appraisal estimates indicates a reasonable level of efficiency when considering the additional financing and the additional expected outputs and outcomes as well as the actual overachievement of most targets of results indicators at project closing (see Annex 4 for further details). 57. Time overruns heavily affected project implementation, but on balance resulted in overall improved efficiency. There were significant time overruns, as the project closing date for the original and AF project was extended by a combined 62 months. Components were financed at 171 percent of the original appraised estimate as the AF accounted for a 71 percent increase of funds. The country context at the time of approval was characterized by high levels of inefficiency at the government level. Both the parent project and AF were affected by effectiveness and implementation delays, with many activities lagging behind schedule, and a compounding effect of inefficiencies due to the financial crisis and the global pandemic. The decision to proceed with an AF combined with a restructuring, rather than prepare a new project was made because the development outcomes of the original and additional project were identical, and implementation built on the previous project. It was also a way to keep the PMU intact and prevent a significant loss of capacity. The PMU eventually grew to become a department in the MEWF and forms part of the technical expertise at the highest level of government. It may also be noted that realized project outcomes in 2024 are more significant than they would have been had the project closed in 2016, as the project overperformed on several key indicators and leveraged an additional US$63 million in World Bank financing through the follow-on RAPID project and US$250 million from EU sources under the NRRP. 58. Despite a significant level of implementation inefficiency, the time overrun resulted in net efficiency gains as the project was able to meet all targets and successfully demonstrate the viability of the approach, leveraging significant additional investments in communal manure platforms. Economic Analysis 59. Various unit cost analyses show that the project compares well with appraisal estimates and similar projects. First, at the time of appraisal, the average value (base cost) of the package of investments per commune was estimated at approximately US$445,000. At project closing, the realized average package of investments to 202 participating communes, based on actual expenditures under Component 1 of US$94 million, is US$465,000. Second, in the PAD, it is estimated that each communal platform for composting manure would cost EUR260,000 (or US$350,000 equivalent at the time of appraisal). At project end, the actual average cost for each platform is assessed by the Project Team to be RON1 million (or US$220,000 equivalent at the time of project closing). 60. At appraisal, an analysis examining the cost effectiveness of nutrient reduction interventions was carried out with estimated CE ratios varying between 10 USD/kg and 40 USD/kg. A cost effectiveness analysis at project closing shows that the expected cost per kg of nutrient discharge reduced range from US$6-12 for a single platform and US$20-39 against the total cost of all physical investments financed by Component 1. These results compare favorably to both the appraisal estimate of between 10 USD/kg and 40 USD/kg as well as to figures from similar projects in Moldova, Poland, and the US (Table 2). Page 23 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Table 2. Cost effectiveness (US$ / Kg) D. JUSTIFICATION OF OVERALL OUTCOME RATING 61. As mentioned in paragraph 39, the team has assessed INPCP against the more ambitious revised outcomes and outcome targets. Given the relevance rating of the INPCP as High, the efficacy rating as Substantial, and the efficiency rating as Modest, INPCP's overall outcome is rated as Moderately Satisfactory. Table 3. INPCP’s Overall Rating Relevance of PDO Efficacy Efficiency Overall Rating Moderately High Substantial Modest Satisfactory 62. The team has considered the application of split evaluation, especially since the 2016 AF and restructuring involved revision of the PDO and of some of the outcome targets; but has determined that the AF and revisions it has involved do not trigger split rating as the scope and ambition of the project have rather expanded. The original PDO was revised to improve its outcome focus and reflect the broader geographic coverage of the project. The Results Framework was adjusted to reflect the increase in scale and streamline and rationalize the number of indicators, focusing on those of direct relevance to the PDO, to better measure the INPCP’s achievement. Applying split evaluation would not have had an impact on outcome rating, as illustrated in the table below. Table 4. Split evaluation of the INPCP’s overall outcome rating Original targets without Revised targets with restructuring/AF restructuring/ AF Relevance of PDO Substantial High Efficacy (PDO) Substantial Substantial Efficiency Modest Outcome rating Moderately Satisfactory Moderately Satisfactory Numerical value of the outcome 4 4 ratings Disbursement USD 48.88M USD 69.96 million Share of disbursement 41.13% 58.87% Final outcome rating 4*0.41% + 4*0.59% = 1.64 + 2.36 = 4 or Moderately Satisfactory E. OTHER OUTCOMES AND IMPACTS 63. INPCP played a crucial role for unlocking Romania's potential to utilize funds allocated by the Resilience and Recovery Fund (EUR 255 million) for additional environmental benefits. At the end of 2020, Romania received a consistent financial allocation from the Resilience and Recovery Fund (as part of the measures Page 24 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) tackling the economic problems caused by the COVID-19 pandemic). INPCP was requested to participate at the preparation of the National Resilience and Recovery Plan (NRRP) component for new communal manure platforms, modernization of the existent platforms, composting and biogas plants. In 2022, INPCP supported development of an IT system for project management to NRRP administrative unit from MEWF, which became an important tool to manage NRRP funds. Gender 64. The gender tagging was not a requirement at Approval nor at AF, however, gender inclusion aspects have been considered under AF (cross-cutting area). In the original loan, communications strategies were not differentiated based on gender, demographics, or minority status (notably, Roma communities). As a result, training sessions were predominantly attended by men. However, analysis of baseline and mid- term evaluation data specifically indicated that vulnerable groups in the project areas are women, people over 60 years old, and people with below average income. While knowledge, attitudes and practice are relatively homogenous between these groups and the general population, the communication campaigns were adapted for different target groups under the AF, while survey reports systematically analyzed results by gender, age, and income status for increased effectiveness of project activities. The AF included an emphasis on training female farmers on the Code of Agricultural Practices, and this was monitored as part of the results framework as a separate intermediate indicator. At Project closing, a total number of 2,827 women (43 percent) have been trained on the Code of Agricultural Practices out of 6,504 farmers that received trainings throughout the project’s implementation. Institutional Strengthening 65. The strengthening of institutional capacity is one of INCP’s most important achievements. The project was instrumental in providing Technical Assistance to the MEWF, MARD and ANAR to ensure that legislation is fully harmonized with EU regulations related to the EU Nitrates Directive and the Water Framework Directive. INPCP also provided substantial support to help with the institutional responsibilities for effective implementation of the legislation related to the Nitrates Directive. Importantly, the Project has continuously supported the Nitrates Committee by preparing a new version of the Code of Good Agricultural Practices and its subsequent revisions and updates. 66. INPCP played a crucial role in supporting the implementation of a comprehensive training program for staff from various national, regional, and county-level agencies involved in the Nitrates Directive Working Groups. A total of 700 specialists from organizations such as MEWF, MARD, ANAR, Environmental Guard, County Pedological and Agrochemistry Offices, and Environmental Protection Agency benefited from capacity building activities under the project. The focus of these trainings was to enhance their knowledge and skills necessary for complying with the directive. The INPCP also aimed to strengthen the capacity of commune staff and mayors through project interventions and education programs, including the establishment of Knowledge Transfer Networks. This approach aimed to ensure that local stakeholders are equipped with the necessary tools and knowledge to effectively address nutrient pollution issues. 67. In addition to providing capacity building activities, the INPCP supported the ANAR by constructing a training center and providing equipment. The training facilities, auto-labs and equipment were aimed to respond to the new and increased monitoring responsibilities upon EU accession. To facilitate effective monitoring, the project also extended the national underground water monitoring network (see para 53 and Annex 1 for details) and developed water quality monitoring manuals, which included maps Page 25 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) showcasing trends in nitrates concentrations. 68. In 2021, the INPCP extended its support to enhance the implementation of the National Recovery and Resilience Plan (NRRP) by developing an IT system for the NRRP project management unit under the MEWF. This IT system played a critical role in unlocking Romania's potential to utilize the allocated EU recovery and resilience funds for environmental benefits in the country. Additionally, INPCP provided capacity building and training activities to enable beneficiaries to access EU funds, covering the preparation, implementation, and management of NRRP applications. Poverty Reduction and Shared Prosperity 69. The INPCP contributed to jobs creation for the poor, particularly among vulnerable groups through opportunities for temporary job provision. The construction and operation maintenance works of the manure management platforms, wastewater treatment plants platforms, and other infrastructure investments have created several jobs and improved the income of unemployed low-skilled workforce in several of the communes. Thus, there are at least two staff employed to operate a manure platform or 346 staff to operate 174 manure platforms completed under the INPCP, as well as approximately 30 staff to operate 11 sewage systems. 70. Additionally, some communes with significant Roma communities (Albesti de Arges, Balta Alba, Gratia, Peciu Nou, Puiesti, and Buzescu) have benefited from the Project, particularly in the extension of wastewater treatment interventions under Component 1 and employment opportunities. At AF, the project has applied the Roma Sensitivity Enhancer and has carried out specific consultations with Roma communities. The consultations processes at AF preparation noted excellent feedback from those who have benefited from the project, confirming the relevance of information campaigns and stakeholders’ engagement, which was further strengthened through KTNs. Those contributed not only to raising awareness about the project interventions but educating the population on the nitrates’ level, pollution and waste management, etc. 71. There were visible improvements19 in sanitation at village level and general hygiene of the villages, contributing also to health benefits. At Approval, in many places there were significant nitrate and microbial contamination of shallow groundwater. This was an indicator of general pollution and contamination affecting both the environment and public health, notably through reported incidences of acute infantile methemoglobinemia—blue baby disease. The awareness raising and outreach targeting schoolchildren, led to better informed and more conscious parents. 104 seminars were held in schools from over 87 localities included in the project. Through these targeted communications activities (workshops, lesson programs, materials, demonstrations) many parents have also changed their water use behaviors. III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME A. KEY FACTORS DURING PREPARATION 72. The project design at appraisal in 2007 was simple with clearly structured components and sound 19 As evidenced also in the Final Beneficiary Survey completed in October 2023 Page 26 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) internal operational logic. Given the country context with low institutional capacity, the project development objectives were ambitious at the right level aiming to implement a low-tech solution to address nitrate pollution causing environmental and health hazard. While some activities proved less relevant / interesting to communes (afforestation, buffer planting, and pasture rehabilitation), the main investment activities were well sequenced and complementary to planned institutional strengthening and public awareness activities. 73. The design was based on a solid analysis of development priorities and a preliminary pilot phase and reflected important lessons learned. During the project preparation phase, the MEWF was close to completing the Agricultural Pollution Control Project (APCP), which was the earliest effort by the Bank and the Global Environment Facility (GEF) to incorporate environmental and nutrient reduction considerations into agriculture. This project served as a pilot in Călărași County not only for Romania but also for other countries in the Black Sea and Danube Basins that implemented similar interventions. The project design considered best practices in nutrient pollution reduction regionally and captured several lessons from the APCP implementation such as the need to make a major public awareness effort up-front in the project area and to adopt a more integrated environmental approach. The valuable insights that informed the INPCP design included importance of: (i) engaging local stakeholders to observe tangible results from mitigation measures to reduce nutrient discharge to ensure adoption and sustainability, (ii) raising awareness and dissemination of information to the widespread adoption of new technologies and practices, and (iii) customizing project activities to local contexts in order to achieve sustainable outcomes. 74. Early and continuous involvement of local administrations and communities in project preparation and implementation proved to be essential to ensure ownership. During preparation, support from a World Bank-supervised Dutch Grant also helped to prepare specific NVZ “action plans” (required by the Nitrates Directive to prioritize mitigation measures to be implemented in the NVZs) for a sample of the NVZ designated localities as well as provide the baseline against which nutrient reduction would be measured under the project. This helped to ensure that priority localities were selected for support early on in the implementation of the INPCP project. GEF involvement was fundamental in ensuring that other countries in the region and globally could learn from Romania's efforts and replicate them at the national level, with significant funding from the state. At that time, the Bank and GEF funding were the sole sources of investment for Romania to fulfill its obligations under the EU Nitrates Directive. 75. The overall risk rating was Moderate. Key risks included: (i) corruption that remained a serious and widespread problem as identified by the European Commission’s Romania Comprehensive Monitoring Report; (ii) risk that the project pre-financing will not be ensured appropriately; and (iii) the limited willingness or ability of elderly, who comprise a large part of rural population, to change former practices. Appropriate mitigation measures were considered at project design. 76. Overall, the project was considered to have adequate readiness, but there were areas that could have been improved or benefitted from deeper assessment. Specifically, despite adequate identification and rating of most risks, the risks associated with ongoing reforms in agriculture advisory services and permit approval processes were more significant and complex throughout the implementation period than envisaged originally at Appraisal. A more comprehensive analysis of permit requirements and an assessment of local government capacity could have been conducted during the project preparation phase. Page 27 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) B. KEY FACTORS DURING IMPLEMENTATION (i) Factors subject to the control of the government and/or implementing entities control 77. The project suffered effectiveness delays both for the original loan and AF for over a year at the beginning of each implementation period. In 2007, the delay occurred due to changes in government and the implementation of a new (unitary) policy on salaries which also led to 90 percent of the PMU staff leaving. This situation, however, characterized the entire Bank portfolio in Romania at the time. In 2016, the delay was due to the lengthy period required for ratification and the summer recess of the Parliament, followed by the preparation and campaigning for the general elections. 78. Implementation progress had a slow start with many activities lagging behind schedule and picked up only in the last several years. The procurement of several key investments faced unexpected delays towards the end of the first extended closing date. These delays were primarily caused by long and cumbersome internal approval procedures and were further exacerbated by changes in the government, austerity measures in response to the financial crisis, slow permit approvals, and changes in permit requirements throughout the lifespan of the project. These challenges were eventually overcome through the government's commitment to providing adequate budget to complete the project's components. As a result, project implementation has significantly improved yet only in 2016 as the major obstacle in obtaining internal procurement approval had been removed. Additional delays in preparing the communities’ investments at time of the AF were caused by the time period of minimum six (6) months necessary to prepare the full applications by the beneficiaries (feasibility studies, detailed design, obtaining all necessary approvals, including the MWF approval and the construction permit). Creating Knowledge Transfer Networks (KTNs) and extensive stakeholder consultations played an important role in enhancing capacity and fostering the sharing of information, experiences, and best practices among farmers and local communities. At the same time, promoting farmer participation in communal waste management and adopting the Code of Good Agricultural Practices was more challenging than anticipated, requiring a holistic approach to move from awareness to adoption of sustainable farming practices. 79. Implementation capacity has been limited at the project start; however, it was strengthened over time. The INPCP had just two PMU Directors/Coordinators as well as some permanent key technical staff (procurement and technical engineer) over the 16-year life of the project, and this continuity (in the face of 32 changes of Minister and turnover at departmental levels) overall favored project implementation. At the same time, the implementation capacity suffered from PMU staff shortages and high turnover largely due to the new policy on salaries. In the early years of implementation, the main causes of the delays and lack of the implementation performance were generated by the inefficient planning of the PMU’s internal workload, together with a slow-down of the selection process for additional staff or supporting consultants for increasing the general PMU’s implementation capacity. An additional contributing factor was insufficient efficiency on internal processing and administration of the project within the ministry. The majority of ISRs reported delays in fulfilling positions in the PMU throughout the project implementation. The PMU efficiency has shown improvement over time, and particularly during the AF. Since 2016, the PMU had most of the vacant positions successfully filled and hired additional experts in various fields to strengthen its capacity to effectively implement the project. To ensure smooth implementation of the Bank's safeguards requirements for the AF, the Bank team and the PMU made a clear decision regarding the assignment of safeguards responsibilities within the PMU, ensuring the Page 28 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) project meets the safeguards requirements and effectively addresses any environmental and social concerns associated with the project. To further enhance the PMU capacity, additional trainings were provided to the staff in various areas such as financial and accounting, procurement, monitoring and evaluation, and safeguards. Overall, the MEWF and PMU's commitment to the project remained strong and favored successful implementation of the INPCP despite institutional capacity bottlenecks and constraints. Furthermore, the PMU was able to retain over time a motivated and well-trained core team, and that is exemplary in the entire Bank portfolio in Romania. 80. Additional factors that affected the implementation progress include: (i) numerous changes in the Government and consequent delays in Government approvals; and (ii) cumbersome processes for obtaining necessary permits. The latter suggested the existence of coordination challenges between the national/central government and commune level to ensure facilitation of a more effective permit allocation process. The investment projects were required to go through a stringent government approval process delaying tendering, implementation timeline and, therefore, disbursements. Additionally, as noted in various ISRs, the risk of the delayed project prefinancing by the Borrower proved to be substantial, with lack of co-financing during the implementation period and as a result slower performance and implementation pace during the first years of INPCP implementation. (ii) Factors subject to World Bank 81. Since the project effectiveness, the Bank team undertook adequate supervision, provided overall candid reporting on implementation issues to Bank management and intensive solutions-oriented implementation support, which was instrumental for the success of the project. The Bank carried out regular implementation support missions and restructured the project on eight occasions and developed detailed action plans to respond flexibly to implementation challenges, as well as to emerging priorities. During several periods of MU performance (2009, 2011, and 2017), the Bank team intensified its direct support to INPCP and organized bi-monthly technical meetings with the PMU to assess in detail the necessary actions to improve the project implementation that were monitored closely. When the Covid- 19 pandemic made mission travel impossible, the Bank switched to a system of regular virtual meetings with the PMU and respective government agencies to support implementation. The Bank team also actively strengthened the Results Framework at AF and pursued enhanced M&E. Following mid-term review of the INPCP in 2012, some of the indicators were updated but not introduced formally through restructurings (2012 restructuring) until the AF. 82. The decision to proceed with AF instead of a follow-on operation was seen as the most appropriate instrument at that time yet substantially prolonged the project lifetime. The Government of Romania considered that the Bank’s continued assistance to build national level capacity to address the environmental challenges was critical, with the INPCP remaining the main vehicle to support the implementation of the EU Nitrate Directive for small households and farms. As the proposed additional activities at AF were closely related to the ongoing INPCP activities, the Bank considered splitting those into two projects was not justifiable due to technical complexities and higher transaction costs involved. The project design was streamlined during the AF, considering the lessons learned of the previous interventions and the original loan. For instance, under the AF, the decision to provide on-demand financial support on competitive grounds based on the beneficiary communities’ requests and eligibility versus selected NVZs in the original loan, proved to be appropriate in the context of Romania. Introduction of sub-activity (2.1) with a focus on the development of national knowledge and training activities and Page 29 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) support for on-farm demonstrations also proved to be effective in promoting adoption of good agricultural practices to reduce on farm nutrient pollution. At the same time, the decision at the AF to have the beneficiary contribution coming in the form of feasibility studies as a requirement to finance infrastructure investments in local communities turned to be inefficient and complex, requiring more efforts and additional engineering adjustments by the PIU and slowed the implementation of physical interventions. (iii) Factors outside the control of government and or implementing entities 83. The financial crisis and subsequent lack of budgetary support during that time resulted in slowdown in project implementation. Limited budgetary support led to the initially planned commune-level co- financing of activities to be dropped in the original loan. Furthermore, in response to salary freezes by the Romanian Government during that period, the project suffered shortage of PMU staff during early stages of implementation. Under these circumstances, investment projects across Romania were required to go through a stringent government approval process before tendering, putting additional pressure of the project implementation progress. 84. The COVID-19 pandemic had significant impact on the activities involving awareness raising campaign and KTNs and caused widespread supply materials disruptions and price increases. At the same time, since 2021, budgetary allocations (Government Order no. 15/2021 and EGO no. 47) for project implementation included partial compensation for price increases. The measures aimed to address the rising costs of materials and equipment by increasing the budget allocated for the project. The adjustments in budgetary allocations ranged between 10-35 percent per contract, depending on the specific circumstances and needs. 85. Despite the challenges, the Government of Romania and the PMU remained proactive and committed to the project’s objectives. The Government’s commitment was also demonstrated through its ratification of the Danube River and Black Sea Conventions, which were embedded into EU accession agreements for the Nitrate and Water Framework Directives. Reducing nutrient runoff (nitrogen and phosphorous from agriculture) into the Danube River and the Black Sea remained consistently an integral part of the country’s environmental strategy as well as the Black Sea and Danube River Basin Strategic Action Plans. IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME A. QUALITY OF MONITORING AND EVALUATION (M&E) M&E Design 86. The M&E design was considerably well developed at the project start, and both PDO-level and GEO indicators were designed as sufficiently specific, measurable, achievable, relevant, and timebound (SMART) yet with minor limitations. The M&E framework was designed to be linked, as much as possible, to the MEWF’s system for reporting on European Union (EU) funds and monitoring progress towards environmental commitments. The complementary set of PDO indicators was formally introduced with the AF and was adequate at measuring progress towards the broadened PDO. The 2016 AF also pointed to the need to strengthen the linkages between project activities and outcomes and the RF was further adjusted and fine-tuned. At the same time, while the methodology to track the progress towards the OI4 Page 30 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) on ‘Downward trend of nitrates concentration in waters’ and the OI5 on ‘Nutrient load reduction (Nitrogen(N)) achieved under the project’ was quite clear and consistent throughout the project, it is hard to fully attribute progress to the project supported investments and activities given that various external factors that could have had additional positive or negative impact. M&E Implementation 87. The PMU maintained satisfactory M&E system that was strengthened over time. The responsibility for project M&E lied with the PMU, which has developed monitoring and evaluation capacity over the life of the project. Initially, the PMU drew on the experience gained from implementing the Agricultural Pollution Control Project (APCP) to inform the design of the M&E system. The M&E system was based on both survey and administrative data sources. The PMU also refined and disseminated the methodology and results of these estimations through bi-annual progress reports. The data for the indicators that were linked to the impact of work with beneficiaries was collected using the baseline, mid-term and end-of project surveys commissioned by the PMU. The surveys on knowledge, attitudes and behavior were expanded with the AF to allow for qualitative data collection and the consolidated results of the surveys were shared with participating communities. Participating municipalities were also requested to provide summaries of public consultation, including the feedback received and the responses provided. Other PDO and IRIs were linked to the data collected by ANAR to analyze water quality and estimate nutrient concentrations in water bodies. To estimate reductions in nutrient releases in water bodies resulting from project interventions, the PMU used proxy methods. 88. The PMU introduced ex-post monitoring in 2019, with on-site visits, to provide oversight, identify any non-compliances or risks, and take corrective actions to ensure the successful implementation and sustainability of the project interventions. The PMU initiated on-the-spot monitoring on how the communal manure platforms and the sewage systems are operating (with special focus on the new introduced performance indicators for communes in 2019) and on the investments provided to ANAR. That included field visits of 72 beneficiaries’ communes and respective investments such as communal platforms, sewage systems, as well as the investments for the National Water Agency. The ex-post monitoring was led by an ex-post M&E specialist, while the operational procedures included a sampling method (random and based on risk factors), a verification list and a template for an action plan (in case performance indicators were not met). By imposing the contractual performance indicators on all beneficiaries and establishing an online reporting tool, beneficiaries were encouraged to accelerate the implementation of actions for an effective and efficient use of the investments. Based on the received data, an ex-post risk analysis of performance indicators was conducted at the PMU level. Locations with a high- risk level (indicating infrastructure deterioration, excessively low or high fill rates, decreasing contract numbers) were chosen for on-site visits by the dedicated monitoring expert from PMU. The adjustments made to the M&E design during implementation were an attempt to make it more functional and proved to be a valuable M&E tool. 89. The project conducted a comprehensive final evaluation to assess the outcomes of the project and the satisfaction of the beneficiaries. This evaluation involved field work (including ex-post monitoring) to verify the results and interviews with key project stakeholder groups and provided good understanding of the project’s outcomes and the level of satisfaction among the beneficiaries. Page 31 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) M&E Utilization 90. While M&E utilization has been slow at the project start, the M&E data and reporting have provided valuable insights in assessing the INPCP progress and guiding improvements in project implementation. Overall, the indicators that were utilized and reported in the ISRs have consistently indicated a slow rate of implementation from the beginning of the project until at least CY2012. The DOI3 on the percentage of the population in the project area adopting preventative and remedial measures to reduce nutrient discharges initially showed slow progress. During the implementation of individual farm platforms, it was discovered that excessive customization was causing delays in the installation of manure platforms, resulting in a reduced number of beneficiaries being reached. This prompted the project team and the Government to shift their focus from individual farm-level platforms to communal-level platforms in order to accelerate implementation. This lesson led to a more streamlined approach, prioritizing communal-level platforms to ensure a more efficient and effective implementation process. Furthermore, the ex-post monitoring and control (both on risk and other factors), introduced by the PMU later during the AF, have proved invaluable for targeting support to farmers not only under INPCP but will be further utilized in RAPID. Justification of Overall Rating of Quality of M&E 91. An overall rating of the quality of M&E is assessed as Substantial20. The M&E system provided overall robust and reliable information on the PDO progress and intermediate indicators, and it has proven to be sustainable. As designed, implemented, and used, the M&E system was generally sufficient to assess the achievement of the objectives and track the results chain linkages. It has also demonstrated value beyond the project, in particular its ex-post monitoring activities and action plans to improve the manure platforms performance through corrective actions. Although there were some shortcomings during the design of the RF and implementation stages, significant progress was made in building the M&E institutional capacity during the AF. The adoption of the online monitoring databases and ex-post monitoring process proved to be important tools and instruments to track the progress and also provide necessary capacity building activities to communes, including, on corrective measures for the investments provided by the project. B. ENVIRONMENTAL, SOCIAL, AND FIDUCIARY COMPLIANCE 92. The project was rated “Category B” (partial assessment) with expected significant positive environmental and social impacts. The INPCP triggered initially the same safeguard policies: OP 4.01 (Environmental assessment), and OP 7.50 (Projects on International Waterways), however, a new safeguard policy was triggered during the AF: OP 4.04: Natural Habitats. Following a new safeguards analysis and considering the environmental conditions and specific measures included in the permits issued by the local environmental protection authorities for each new investment (manure platforms), 8 out of 89 new investments have the proposed location in protected areas (Natura 2000 sites) established in Romania, and thus triggering OP 4.04. Overall, INPCP’s safeguards performance was consistently satisfactory, and the PMU’s capacity in managing environmental and social safeguards was sound. All small-scale investments/civil works (manure management reinforced concrete-made platforms at the commune level and some composting facilities) were implemented in compliance with the Bank environmental safeguards, with health & safety requirements for such type of construction activities, and with proven environmental safety. The site-specific Environmental and Social Management Plans (ESMPs) 20 M&E Quality Rating at the Interim ICR stage in 2016 for the parent INPCP was rated Substantial. Page 32 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) were prepared for each sub-project, disclosed locally and annexed to the bidding documents, works and supervision contracts. The PMU prepared and distributed guidelines for the participating communes on ESMP structure and content, impact scoping table and ESMP summary table. The PMU and the Bank’s environmental consultant developed ESMP review checklists that are applied to evaluate the quality and completeness of the site-specific ESMP prepared by local beneficiaries. There was no significant impact to environment and no social related aspect during the works execution as well as the operation phase of executed investments. 93. The Procurement risk was rated Moderate at project start and Substantial at the time of the AF considering the lengthy disbursement delays with a slow-down in procurement at the national level as well as difficulty in ensuring inter-ministerial coordination. Procurement performance was assessed as Moderately Satisfactory most of the project’s lifetime but upgraded to Satisfactory in the last two years of implementation. Although procurement faced delays in the early years of project implementation, the institutional arrangements for procurement were consistently evaluated as satisfactory, and the procedures were well-implemented according to the World Bank guidelines. The Bank team conducted prior review of contracts and regularly supervised smaller contracts subject to post review. The INPCP procurement manager maintained a fully functional filing system throughout project implementation period. The quality of procurement documents was consistently assessed as good with the necessary measures being taken to ensure compliance and effective procurement arrangements. 94. The Financial management (FM) risk was rated Moderate at project start and at the AF considering potential capacity constraints at PMU`s and beneficiaries` level and deficit targets set by the Ministry of Finance (MoF) that would limit or delay allocation of Government funds for pre-financing INPCP AF activities. Project implementation has been impacted at times by fluctuations and changes in the PMU`s financial management function, legislative and operational constraints, and insufficient and/or untimely budgetary allocations to prefinance the planned expenditures. However, these were duly addressed, and the FM performance was assessed largely Satisfactory with the FM risk remaining Moderate throughout project implementation period. There are no outstanding audit reports or interim financial reports (IFRs) and reporting compliance has consistently been satisfactory. The project has undergone full-scope FM reviews annually and which concluded that the FM arrangements are satisfactory, and the PMU had been taking necessary actions as agreed upon. Proper accounting procedures and systems and internal controls were in place during implementation. Semi-annual IFRs were sent to the Bank as per the timeline and format agreed on. The audit reports were submitted on a timely basis and issued a clean (unmodified) audit opinion, generally with no internal control issues mentioned in the management letters. Overall, the FM arrangements of the project have been satisfactory, and the necessary measures have been taken to ensure compliance and effective financial management. C. BANK PERFORMANCE Quality at Entry 95. The Bank’s performance at project preparation presented a number of strengths in the quality of project design and only minor limitations. The design was robust and technically sound, reflecting a clearly identified priority area of strategic importance for Romania. This includes addressing environmental concerns, improving public health, and enhancing the competitiveness of the agriculture and rural sectors with a focus on small farmers. In parallel, it incorporated a strong focus on facilitating compliance with the obligations of EU membership. INPCP activities were aligned with the priorities identified in the CPS Page 33 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) at preparation and CPF at time of the AF, and with critical support to ongoing efforts towards compliance with the EU Nitrates Directives. This was crucial for Romania's path towards EU accession and remained relevant throughout the project lifetime. Furthermore, compliance with the Acquis Communautaire21 had the potential to provide Romanian farmers with access to additional EU agriculture funds and, thus, a direct impact on improving their livelihoods. The design was consistent with international best practices, lessons learned from similar nutrient management projects, including the original Bank-supported pilot project in Călărași. At AF, the implementation arrangement and design have also integrated lessons learned and did not require major adjustment to components, but rather maximizing their effectiveness, and maintained same M&E arrangements. Policy, institutional and stakeholder engagement aspects were properly reflected, and safeguards and fiduciary arrangements complied with the Bank’s applicable requirements. At the same time, a more comprehensive analysis of risks related to permit requirements and local government capacity could have benefited the project. Quality of Supervision 96. The Bank’s supervision during the project implementation was proactive with robust and comprehensive implementation support. The Bank closely supervised INPCP implementation through regular implementation support missions, fiduciary reviews, Mid-Term Reviews, and maintained a productive dialogue between the PMU, MEWF, ANAR and other stakeholders. During the COVID-related travel restrictions, regular virtual visits and check-in meetings took place. Implementation issues were timely raised and reported on thoroughly in official documentation such as Aide-Memoires, ISRs, MTR reports, etc. The Bank was proactive in identifying recommendations to various implementation bottlenecks and challenges as they arose through close monitoring and support to the PMU. This included eight restructuring processes, including with a focus on helping turn around project performance, improve implementation capacity and facilitate slow disbursements at project start. Despite several changes in Task Team Leaders (seven TTLs in total), there was a strong continuity in the Bank’s core team, including procurement and FM staff and local presence of co-TTL during the AF period, which allowed quality assurance of project implementation. 97. The Bank’s implementation support was also consistently solution-oriented to strengthen the implementation pace, capacity, and progress towards development outcomes. Thus, when any limited or delayed Government funds allocation for pre-financing INPCP activities happened, the Bank ensured a close dialogue with MoF to ensure that the necessary budgetary allocations for implementing the agreed project activities are in place. During Moderately Unsatisfactory performance periods (2009, 2011, 2017), the Bank team facilitated Action Plans on a regular basis detailing the activities for the implementation progress improvement and continued to follow this approach throughout the project lifetime. Following the mid-term review in 2011, however, adjustments to the RF have not been fully reflected in the restructuring process22. Despite these M&E limitations, the Bank overall strengthened and streamlined the RF over time, with due diligence and reporting during the AF, and proactively supported costs reallocations when needed and was closely engaged with the MEWF and the PMU to ensure considerable emphasis on strengthening the implementation capacity and contributing to INPCP’s success. 21 Covers all treaties, EU legislation, international agreements, standards, court verdicts, fundamental rights, etc. that all EU member states must obey. All candidate countries must accept the full EU Acquis to become a member of the EU. 22 The 2012 Restructuring included changes in the RF, but not fully capturing changes, which appeared in ISR Seq. 08 (December 2012). Page 34 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Justification of Overall Rating of Bank Performance 98. Despite the abovementioned M&E shortcomings under parent INPCP23, the Bank's overall strong performance as well as proactive, responsive, and comprehensive implementation support played an important role in ensuring the INPCP’s success over time. The overall rating for the Bank's performance is deemed Satisfactory. D. RISK TO DEVELOPMENT OUTCOME 99. The sustainability of outcomes focusing on nitrate pollution reduction has the potential to extend far beyond the immediate lifespan of the project. But even as project outcomes enjoy exceptionally strong support through continued financing from the World Bank and the EU, certain factors pose a risk to the sustainability of achievements. Below the key risk factors and mitigating factors are considered in more detail. 100. The biggest challenge to sustaining project outcomes is ensuring continued operational use of the manure platforms. This relates to two key elements of the Borrower's capacity: to ensure the proper use of the manure platforms (commune-level) and to sustain and cultivate adoption of good agricultural practices (farm-level). Ensuring the proper use of the manure platforms, without a formal enforcement structure or assigned accountability, will require continued monitoring and reporting of operational use of the platforms against performance indicators. According to the GoR, project investments will remain under ex-post monitoring, in which municipalities will continue to report their performance indicators and will receive further guidance towards an appropriate use of the facilities and equipment. Cultivating the continued adoption of good agricultural practices among farmers is critical to sustain project outcomes. As farmers have tended to resist adoption of new agricultural management practices, there remains an on-going need to continue outreach through knowledge management networks, such as farmer organizations, to raise awareness and spread the adoption of good agricultural practices. To mitigate this risk, next-phase investments include such activities as an integral part of the projects, as described below. 101. A follow-on operation named Romania Rural Pollution Prevention and Reduction Project (RAPID, P179786), with an envelope of US$63 million, was approved on March 30, 2023, and became effective on December 13, 2023. The new project aims to strengthen the institutional capacity of selected public entities to monitor pollution from agriculture, and to transfer knowledge on agricultural pollution reduction for adoption by participating farmers. The new project supports the development outcomes of the INPCP, but also goes beyond nutrient pollution - focusing also on pesticides, ammonia, nitrous oxides, or antimicrobials - and further strengthens the GoR in meeting the requirements of the EU Nitrate Directive and broader Water Framework Directive at a national scale. 102. Additional funds from Romania's National Recovery and Resilience Plan (NRRP) financed by the EU will more than double the number of community-managed manure platforms in the country. With an allocation of €29.2 billion, or 13.1 percent of the country's 2019 gross domestic product (GDP), the NRRP's ambitious agenda of reforms and investment aims at mitigating the socio-economic effects of the COVID- 19 crisis, part of which is earmarked for accelerating the process of expanding and modernizing the waste management systems in Romania. From this envelope, a budget of RON1.13 billion (€226 million) is 23 The Interim ICR noted similar observations, with the overall Bank Performance remaining Satisfactory. Page 35 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) reserved for the implementation of integrated manure management with an emphasis on separate collection, prevention measures, reduction, reuse, and valorization in order to comply with the applicable directives and the transition to the circular economy. The call for proposals, which was launched on October 31, 2023, and was expected to remain open for two months, was met with such great interest from Romanian communes that it closed just 30 minutes after the launch – demonstrating the overwhelming interest from communes and pointing towards overall progress at a national scale. The technical specifications and requirements were informed and prepared based on the lessons learned from INPCP and the technical expertise in the PMU team. As a result, platforms under new NRRP are expected to lead to better operational performance of communal manure platforms. V. LESSONS AND RECOMMENDATIONS 103. The quality of technical designs for investments in manure management or similar agricultural practices is best ensured through standardized templates. In the case of INPCP, while the original project used a standard template to control the design and technical specifications of the manure platforms, the AF changed the approach to a customized design to fit the needs and geography of each individual commune in different regions. Proposals were evaluated based on concept notes and pre-feasibility studies, but the following technical designs were of poor quality. This added tremendous pressure on the PMU to support the communes in the preparation of technical designs, procurement documents, and to verify disbursement-linked construction. A specialist was hired in the PMU to ensure quality control and a helpdesk hotline was set up to support the communes during implementation. Recommendation: In similar investments, it is recommended to use standardized template designs, leaving the PMU in charge of the technical design and specifications. For instance, under the new NRRP, a standard template design will be utilized to construct four types of communal platforms and six types of individual platforms with standardized cost for equipment and work. The approach will enable the communes to handle design adaptation, procurement, engineering, construction, disbursement, and operation, with appropriate support from the PMU. 104. Performance indicators for communes build administrative capacity and ownership and improve operational use. From the outset, there were insufficient provisions in the project design for stimulating the beneficiaries (commune officials) to strongly engage with farmers after the platforms were built. This led to underutilized platforms operating much below capacity. To address the issue and achieve intended development outcomes, the PMU made efforts to improve the monitoring system for the investments in manure platforms and their impact. In 2019, the PMU imposed contractual performance indicators on all beneficiaries and established an online reporting tool on www.apanoastra.ro allowing the beneficiaries to periodically submit reports to the PMU, in early spring, regarding the various operational and performance indicators relevant for communal manure platforms. To complement this approach, a monitoring specialist was hired to carry out ex-post risk analysis of performance indicators, visit high-risk locations (i.e., data indicating infrastructure deterioration, excessively low or high fill rates, decreasing contract numbers), and prepare remedial action plans in case performance indicators were not met, as part of an ex-post monitoring system. Recommendation: In similar projects, it is highly recommended to integrate continued monitoring and reporting requirements against operational performance indicators - also beyond project closing - into the original project design. 105. Knowledge Transfer Networks (KTNs) are instrumental in building capacity and facilitating the exchange Page 36 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) of information, experiences, and best practices among farmers and local communities . Through knowledge transfers, the farmers would learn more about the different agricultural pollution reduction practices and their associated benefits, thus being incentivized to adopt them within their own farms. The KTNs, established on the basis of already existing research units under Academy of Agricultural Sciences (ASAS) or other relevant entities, served as platforms for fostering collaboration, sharing knowledge, and strengthening capacity, ultimately enhancing the effectiveness and sustainability of pollution prevention measures. Direct engagement with stakeholders helped tailor solutions to local contexts, addressing specific challenges and maximizing the relevance of interventions to reduce on-farm nutrient pollution. Recommendation: In similar projects, it is recommended to apply similar approaches of establishing and strengthening the knowledge transfer platforms as it could foster long-term commitment to promote sustainable and environmentally friendly agriculture specific to the farming systems and needs of their region. 106. Awareness raising and payment incentives alone are insufficient to ensure farmer’s voluntary compliance with bringing manure to platforms for proper composting. Overcoming farmer's resistance to voluntarily participate in communal management of animal waste and to adopt the Code of Good Agricultural Practices required a systemic effort to effect behavior change than first realized. The project made great strides in addressing the lack of awareness among mayors and farmers of nitrate pollution being a community issue and the opportunities for organic composting with community-level manure platforms. Payments by APIA to farmers have helped incentivize compliance, but for small holders the process can be burdensome. The experience of the project highlights that more direct involvement is needed to move from awareness to adoption as still only few small-scale household farms have embraced sustainable farming practices. While many farmers participate in events and workshops to learn about good agricultural practices, the adoption and implementation of those measures lack behind. Recommendation: In the next phase of investments, it is advised that a Social Development Specialist be integrated into the project’s team to focus on identifying the specific obstacles to the adoption of sustainable farming practices and deepen the work with KTN host farmers and farmer organizations to widen the implementation of the CGAP. 107. Through long-term engagement in the sub-sector, the project has transformed nutrient pollution management in Romania over the past two decades and made Romania a regional and global leader on the issue. From an initial pilot phase in 2001, to the approval of the first project in 2007 and the additional financing in 2016, and onto the next-phase RAPID project, nutrient pollution management has evolved from a focus on compliance with EU regulations to a more holistic approach that integrates science-based solutions, stakeholder engagement, and sustainable development principles. Ongoing efforts will be needed to continue reducing nutrient pollution and protecting the country's water resources for future generations. Recommendation: For sustained results and transformational impacts to address nutrient pollution management, a longer term and programmatic engagement is essential through a concerted program of actions and extensive stakeholder consultations. . Page 37 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS A. RESULTS INDICATORS A.1 PDO Indicators Objective/Outcome: To support the GoR towards meeting EU Nitrate Directive requirements at a national scale Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Downward trend of nitrates Text 0.00 80% 70% 70.1% concentration in waters: at least 70% of targeted project 16-Feb-2007 31-Dec-2013 31-Mar-2022 31-Dec-2023 areas show 10% reduction in nitrates discharge to water bodies Comments (achievements against targets): Target: 100% achieved This PDO level indicator was introduced since the INPCP approval in 2007. The target was revised with the AF and it is fully achieved. The original indicator ‘At least 80% of targeted NVZs show 10% reduction in nutrient load discharge to water bodies’ was revised with the AF to ‘Downward trend of nitrates concentration in waters: at least 70% of targeted project areas show 10% reduction in nitrates discharge to water bodies’. The target was revised to reflect the change of scale, moving from just NVZs to the whole country geographically (national scale), while the reduction of 10% in nutrient load discharged remained the same irrespective of expanded geographical target areas Page 38 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Since 2009, the water quality was monitored by ANAR. The initial monitoring network included 124 piezometers. Since 2019, ANAR has extended the monitoring network for groundwater, in the project area. The monitoring data for the year 2022 was provided by ANAR in May 2023 and the indicator was measured based on these data as compared with the baseline in CY2009. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Percentage of population in the Text 3% 50% 75% 76.5% project area adopting preventative and remedial 26-Feb-2009 31-Dec-2013 31-Mar-2022 31-Dec-2023 measures to reduce nutrient discharges (index measures various rural waste management and good agricultural practices) Comments (achievements against targets): Target: 102% achieved This PDO level indicator was introduced since the INPCP approval in 2007. The end target was revised with the AF and it is fully achieved. The original target was 50% by the original closing date (2013), which has been increased at the AF to 75% by the revised closing date. The baseline indicator was estimated by the Baseline Survey carried out in the parent INPCP in 2009. The Baseline Survey in the AF was carried out between May – July 2018 and calculated the index measuring various waste management and good agricultural practices. This survey was conducted with the coverage of about 3750 households across 100 communes in the project area. The indicator was updated, using the same methodology, through the Mid- Term Survey in CY2020. At that time, the results showed that 69% of population in the project area (an important increase, as compared with the baseline value), apply at least one of the practices recommended by the Code of Good Agricultural Practice, as preventive and remedial measures to reduce nutrient Page 39 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) discharges. The last update was made through the Final Survey, completed in October 2023. The results estimate that the percentage of households that have adopted preventive and remedial measure to reduce nutrient discharges has reached 76.5% in the communes with investments in the Project area. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Improved inter-governmental Text The Inter-Ministerial Improvements Improvements coordination and capacity to Committee (IC) was acknowledged - Good acknowledged - Good assess, monitor and report on established through capacity of the capacity of the progress with implementation GD 964/2000 It governmental governmental of the EU Nitrates Directive includes a technical institutions in the institutions in the Supporting Group assessment, assessment, monitoring and monitoring and reporting regarding reporting regarding the implementation of the implementation of the EU Nitrates the EU Nitrates Directive Directive 01-Feb-2008 31-Dec-2013 31-Dec-2023 Comments (achievements against targets): Target: 100%/ Fully Achieved This PDO level indicator was introduced since the INPCP approval in 2007, it didn't change with the AF and is fully achieved. The Commission or the Inter- Ministerial Committee for implementation of the Action Plan on the protection of waters against nitrate pollution from agricultural sources was established by GD 964/2000. It comprises specialists from the Ministry of Environment, Water, and Forest, Ministry of Agriculture and Food, and Ministry of Health. Besides the Commission, there is a Support Group composed of representatives of the National Company “Romanian Waters” – S.A., of the basin committees and specialized institutes and units under the authority and coordination of the Ministry of Waters, Forests and Environment Protection, of the Ministry of Agriculture and Food and of the Ministry of Health. As a result of technical assistance provided by the project to various government agencies, Page 40 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) the Inter-Ministerial Committee remains to be fully functional, the meetings of the Commission are organized regularly, with the latest meetings in CY2023 taking place in April 2023. During these meeting, the PMU actively participate in technical discussions and played an important role in developing the updated version of the Code of Good Agricultural Practices. During the April’s meeting, the PMU delivered a presentation on the activities implemented and the results achieved under the Project. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Favorable EU assessment of Text n.a. Progress Progress Romania's progress towards acknowledged acknowledged meeting EU Nitrates Directive through EU comments on Reports 01-Feb-2008 31-Dec-2013 31-Dec-2023 Comments (achievements against targets): Target: 100%/ Fully Achieved This PDO level indicator was introduced since the INPCP approval in 2007, it didn't change with the AF and is fully achieved. The Romania’s last report on the implementation of the EU Directive 91/676/EEC (Nitrate Directive) for the period 2016-2019 was submitted to the European Commission in time, in June 2020. In Chapter 7 of this report, an entire section is dedicated to the achievements of the INPCP, both the Original Loan and the INPCP AF, as a major investment project targeting the reduction of water pollution with nutrients, not only through important investments but also throughout the information, awareness, education, training and support provided to farmers and to all interested in waters protection against pollution with nitrates originating from agriculture. Previously, the 2012-2015 Report was submitted to the European Commission on July 8, 2016. The Commission's Report to the Council and the European Parliament on the implementation of the Council Directive 91/676/EEC concerning the protection of waters against pollution caused by nitrates from agricultural sources based on Member State reports was disclosed in June 2018. Except the 8-day submission delay, the Romania’ Report did not mention problems and there were neither infringement cases nor EU Pilot investigation opened for Romania. Including to date. Overall, the reports prepared by Page 41 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Romania on the Nitrate Directive implementation for the last four reporting periods (2004-2007; 2008-2011; 2012-2015; 2016-2019) were submitted on time and were accepted by the DG Environment of the EU Commission. The next report for the period of 2020-2023 will be due by June 2024. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Nutrient load reduction Tons/year 0.00 300.00 600.00 698.68 (Nitrogen(N)) achieved under the project 01-Feb-2008 31-Dec-2013 31-Mar-2022 31-Dec-2023 Comments (achievements against targets): Target: 232% achieved compared to the original target; 116% achieved compared to the formally introduced at the AF The PDO indicator was formally introduced at time of the AF and is fully achieved. The monitoring data were collected through the Database software application for online communication with the local authorities. This indicator is estimated on a yearly basis, with the last updates received for CY2022 (covering only 129 operational platforms out of 174 constructed platforms). The nutrients load reduction (N) due to the platform’s operation is calculated at 671.18 tons. The nutrients load reduction (N) due to the sewerage systems operation is calculated to 25.50 tons. A.2 Intermediate Results Indicators Component: Investments in Local Communities for Reducing Nutrient Pollution Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Percentage of cropped area in Text 9% (updated from 30% 60% 75.8% the project communes under baseline survey) Page 42 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) relevant nutrient reduction 26-Feb-2009 31-Dec-2013 31-Mar-2022 31-May-2023 measures. Comments (achievements against targets): Target: 126% achieved This IRI was introduced since the INPCP approval. The target was revised with the AF and it is fully achieved. The Final Beneficiary Survey[1] in the Additional Financing was completed in October 2023. It showed that the percentage of cropped area in the project communes under relevant nutrient reduction measures is 75.8% as compared with the target of 60.0%. [1] Ministry of Environment, Water and Forests, End of Project Survey, submitted on October 30, 2023 Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of communal Text 0.00 86.00 150.00 174.00 platforms completed (cumulative) 26-Feb-2009 31-Dec-2013 31-Mar-2022 31-Dec-2023 Comments (achievements against targets): Target: 116% achieved This IRI was introduced since the INPCP approval. The target was revised with the AF and it is fully achieved. Under the original loan, 86 platforms for animal waste management and storage have been completed in 81 communes by May 2017. New investments in 88 platforms and composting stations for animal waste management in the AF are completed in 85 communes. Page 43 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Percentage of households with Text 0.00 30% 60% 86.23% access and connection to sewage system (in targeted 16-Feb-2007 31-Dec-2013 31-Mar-2022 31-Dec-2023 villages receiving sewage investments) Comments (achievements against targets): Target: 143% achieved This IRI was introduced since the INPCP approval and the target was revised with the AF. The IRI has exceeded the revised target. It is calculated as the average of connection percentages for each completed sewage system in 12 communes (reported by the beneficiaries). Overall, availability of the sewage network in front of the households created a positive trend of more households being in favor of building toilets and bathrooms. Component: Institutional Strengthening and Capacity Building Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Working groups at Water Basin Text Ad-hoc WGs effective to WGs effective to WGs effective to and County levels functioning implementation of support EU reporting support EU reporting support EU reporting effectively and all staff working working groups and coordinate with and to coordinate and to coordinate on the Nitrates Directive fully other agencies actions of other actions of other operational. (common agenda and agencies agencies 85% WG members trained) Page 44 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) 16-Feb-2007 31-Dec-2013 31-Mar-2022 31-Dec-2023 Comments (achievements against targets): Target: 100% achieved This IRI has been introduced in the parent INPCP and is fully achieved. The regulation of organization and functioning of the Basin Committees (Working groups) was re-approved by GD 270/2012 and remains operational. The Committee consists of: a) two representatives of the central public authority in the field of water and environmental protection, of which one from its central structure and one appointed from the environmental protection agencies of the respective basin area; b) a representative of the public health directorates of the respective basin/basin area counties, appointed by the National Institute of Public Health; c) two mayors of municipalities and a mayor of the respective city or municipality in the respective basin; d) a representative appointed by non-governmental organizations headquartered in the respective basin area; e) a prefect of that river basin area, appointed by the central public authority in the field of administration and internals; f) chairmen of all county councils in the respective basin area; g) three representatives of water users in the respective basin/water area, depending on the water requirement and the impact of discharged waste water on water resources; h) two representatives of the National Administration “Romanian Waters”; i) a representative from the county commissariats for consumer protection in t he respective basin area. One of the responsibilities of the Basin Committees, specifically relevant to the INPCP, is “to analyze the implementation of the Action Plan for the Protection of Waters against Nitrate Pollution from Agricultural Sources, of the Code of Good Agricultural Practices and the Action Program for Vulnerable areas to Nitrates, developed in accordance with the provisions of Government Decision No 964/2000 concerning the approval of the Action Plan for the Protection of Waters against Pollution from Nitrates from Agricultural Sources, with subsequent amendments and supplements, and of the Order of the Minister for Environment and Water Management, Minister of Agriculture, Forests and Rural Development No 296/216/2005 approving the framework program for technical action for drawing up action programs in vulnerable areas to nitrate pollution from agricultural sources”. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Increased number of Number 7.50 8.00 8.12 groundwater quality monitoring sites and sample 04-Nov-2015 31-Mar-2022 31-Dec-2023 analysis for the Nitrate Page 45 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Directive Comments (achievements against targets): Target: 101% achieved This IRI was introduced at the AF and is fully achieved. It is expressed as the number of monitoring sites per 1000 km2 of monitored area. The baseline value has been calculated based on the total number of groundwater monitoring stations in the year 2011, which was 1809, representing a density of 7.50 per 1000 km2 of groundwater monitoring stations. The INPCP has contributed to the extension of the network of groundwater monitoring stations through (i) the construction of 63 piezometers for underground table waters in Nitrate Vulnerable Zones (NVZs) from the original Loan; and (ii) the construction of 13 new piezometers and the rehabilitation of 107 piezometers supported by the INPCP AF[1]. As of CY2023, the total number of groundwater monitoring stations is 1935 (1809 existing + 63 new from the parent INPCP + 13 new from the INPCP AF + 50 rehabilitated piezometers in the existing network), representing to a density of 8.12 per 1000 km2 [1] Note: 57 of the 107 rehabilitated piezometers are part of the existing monitoring network, while the rest of 50 piezometers represents an extension of the network requested by ANAR in 2009 to be introduced with support from the original Loan that could not be implemented due to no interest from any contractor. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of technical staff Text 0.00 700.00 709.00 (ANAR, EPA, Health Directorates) trained 26-Feb-2009 31-Mar-2022 31-Dec-2023 (cumulative) Comments (achievements against targets): Target: 101% achieved Page 46 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) This IRI was formally introduced at AF and is fully achieved. The trainings were organized based on ANAR’s needs related to water quality monitoring. The last training sessions were delivered in Q1, 2019 when 30 ANAR technical staff were trained on pesticides analysis using Gas-Chromatographs and in November 2023, for a group of 20 ANAR staff. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of farmers trained by Number 0.00 6,000.00 6,504.00 knowledge and training providers on Code of Good 04-Nov-2015 31-Mar-2022 31-Dec-2023 Agricultural Practices (male/female disaggregated) Number of female farmers Number 0.00 3,000.00 2,827.00 trained by knowledge and training providers on Code of 04-Nov-2015 31-Mar-2022 31-Dec-2023 Good Agricultural Practices Comments (achievements against targets): Target: 108% achieved This IRI has been introduced at AF and is fully achieved. A total number of 7,439 participants received the 1st day of training; 6,843 participants received the 2nd day of training; and 6,504 participants took part and received the 3rd day of training. The target considers farmers that got trained in all 3 training sessions. Additionally, 253 participants (out of 6,504) received a special 4th day of training that was delivered through an integrated approach on nitrogen pollution, with participants learning also about the air emissions (especially ammonia and nitrous oxide) which are finally leading to nitrates emissions (as nitrogen travels by air but ends up in water as nitrates). The project set-up around 369 discussions groups, supported by around 243 champion farmers and 76 communal platforms hosting demonstrations for manure management good practices. Page 47 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Reduction in number of Percentage 50.00 25.00 14.47 farmers penalized by APIA for non-compliance with Nitrate 04-Nov-2015 31-Mar-2022 31-Dec-2023 Directive Comments (achievements against targets): Target: 172% achieved The IRI was introduced with the AF and the target is fully achieved. The baseline was established as the percentage of farmers penalized for noncompliance with Nitrate Directive – Norms SMR1[1]. In 2020, 835,000 payment requests were submitted, out of which only 1% was subject to control. As result of the control, 1,044 people were penalized. Therefore, the percentage of farmers penalized for non-compliance with Nitrate Directive is 12.50%. In 2021, 15,135 farmers were under control, out of which 1,908 farmers were penalized, meaning the equivalent of 12.6%. In 2022, the non-conformity rate communicated by APIA was 14.47%. The slight increase is the result of strengthening the measures related to manure storage that farmers had to apply starting with end of 2021 (and controlled in 2022). [1] This means SMR 1: Protection of Water against Pollution caused by Nitrates. The aim of this requirement is to reduce the pollution of waters caused by nitrates and phosphates occurring from agricultural land and farmyards. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Land users adopting Number 0.00 30,000.00 48,300.00 Page 48 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) sustainable land mgt. practices 01-Feb-2008 31-Mar-2022 31-Dec-2023 as a result of the project Comments (achievements against targets): Target: 161% achieved This IRI was formally introduced at AF and has exceeded its end target. Actual values represent the calculation based on the finalized investments. It was estimated that on average there are 300 citizens per commune that are using and benefit from the project investments. As of end-December 2023, there are 202 communes with completed investments Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of project communes Text 0.00 68.00 200.00 202.00 implementing at least one of the following nutrient 26-Feb-2009 31-Dec-2013 31-Mar-2022 31-Dec-2023 reduction measures: communal platforms, pasture rehabilitation, tree planting (cumulative) Comments (achievements against targets): Target: 297% achieved compared to the original target; 101% achieved compared to the revised target in the AF. The target was tracked since 2012 (ISR 8) with a target of 68 communes by end-December 2013, and it formed part of the evaluation at the interim ICR. This IRI was formally introduced and revised at AF and has exceeded its end target. As of December 2023, there are 202 communes implementing different practices and measures for nutrients reduction, such as. Page 49 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) a) 133 communes (50 communes from Original Loan + 83 communes from INPCP-AF) implementing only manure management practices b) 12 communes implementing manure management, pastures rehabilitation and tree planting c) 22 communes implementing manure management and tree planting d) 31 communes implementing only tree planting. e) final set of investments completed in December 2023: 5 communes implementing 2 manure platforms and 3 composting stations Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Land area where sustainable Hectare(Ha) 0.00 18,000.00 38,000.00 43,756.00 land mgt. practices were adopted as a result of proj 01-Feb-2008 31-Dec-2013 31-Mar-2022 31-Dec-2023 Comments (achievements against targets): Target: 243% achieved compared to the original target; 115% achieved compared to the revised target at the AF The target was tracked since 2012 (ISR 8) with a target of 18,000 ha by end-December 2013, and it formed part of the evaluation at the interim ICR. The IRI was formally introduced at AF and has exceeded its end target. The target was established considering that, on average, a manure platform will help farmers to adopt sustainable land management practices in an area of 250 ha. To date, 174 manure platforms and the related equipment were completed and handed over to the beneficiary communes. In addition to manure management practice, the communes adopted and implemented the tree planting on a total area of 256 ha. All these interventions result in the total area where sustainable land management practices were adopted of 43,756 ha. Page 50 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Component: Public Awareness and Information Support Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of meetings/public Number 0.00 100.00 250.00 consultations/workshops organized towards meeting 04-Nov-2015 31-Mar-2022 31-Dec-2023 project objectives Comments (achievements against targets): Target: 250% achieved This IRI was introduced at AF and substantially exceeded the end-target. The following capacity building activities implemented during the public awareness program: 14 regional workshops - 1260 participants; 174 seminars at community level – 5640 participants; 87 training of trainers - 1327 participants; 104 seminars in schools - 6500 participants. The events were targeted at professionals and organizations with responsibilities in environmental issues at regional level; farmers; individual householders; local authorities; community leaders; children in 87 project communes. All participants received informational and promotional materials developed under the project. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Percentage of questions, Percentage 0.00 100.00 100.00 comments or complaints relevant to the project that are 04-Nov-2015 31-Mar-2022 31-Dec-2023 received and addressed within indicated 30 days Page 51 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Comments (achievements against targets): Target: 100% achieved The IRI was introduced at AF and is fully achieved. Throughout the implementation period, only in 2019 one complaint was received from a person involved in the construction works regarding the quality of construction works for the sewerage investment in Targsoru Vechi, Prahova County. The PMU provided a response with the check findings within the indicated period of 30 days. During the implementation period, no further complaints were received. Component: Project management Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of surveys conducted Number 0.00 3.00 3.00 that collect feedback and report back the results to the 04-Nov-2015 31-Mar-2022 31-Dec-2023 communities Comments (achievements against targets): Target: 100% achieved This IRI was introduced at AF and is fully achieved. The Baseline Survey conducted between April-July 2018. According to the approved methodology, 3753 households (HHs) have been interviewed in total, as follows: i. 3002 households in 100 communes – main sample (30 households interviewed in each) selected out of the total number of communes that submitted Concept Notes under the First Call for sub-projects proposals and taking into account that the overall sample be representative for the national rural area, within a maximum margin error of +/- 2% at a 95% level of confidence and simultaneously have a representativeness of +/-3.5% for a confidence level of 95% at the region level subsamples (three major regions considered, Moldova, Muntenia and Transilvania) should be met, and Page 52 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ii. 751 households in 30 communes – control sample (25 households interviewed in each) selected as control group based on the criteria such as the distance from the communes included in the main sample, the size of the communes in terms of inhabitants and the geographic particularities with the ultimate goal of obtaining similarity with the communes targeted by the Project. The Mid Term Survey was completed in December 2020, using the same methodology. The Final Survey was completed in October 2023. Page 53 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) B. KEY OUTPUTS BY COMPONENT Outcome: To support the Government of Romania towards meeting EU Nitrate Directive requirements at a national scale Outcome Indicators OI 1: Improved inter-governmental coordination and capacity to assess, monitor and report on progress with implementation of the EU Nitrates Directive (Target: Improvements acknowledged; Actual: Improvements acknowledged - 100% achieved) OI 2: Favorable EU assessment of Romania's progress towards meeting EU Nitrates Directive (Target: Progress acknowledged; Actual: Progress acknowledged - 100% achieved) Intermediate Results • Working groups at Water Basin and County levels functioning effectively and all staff working on the Nitrates Directive Indicators fully operational (Actual: 100% achieved with WGs effective to support EU reporting and to coordinate actions of other agencies) • Number of technical staff (ANAR, EPA, Health Directorates) trained (cumulative) (Target: 700; Actual: 709, 101% achieved) • Reduction in number of farmers penalized by APIA for non-compliance with Nitrate Directive (Percentage) (Target: reduced by half, from 50% to 25%; Actual: 14.47%, fully achieved) • Number of meetings/public consultations/workshops organized towards meeting project objectives (Target: 100; Actual: 250, 250% achieved) • Percentage of questions, comments, or complaints relevant to the project that are received and addressed within indicated 30 days (Actual: 100%, fully achieved) Key Outputs by Component 2: Institutional Strengthening and Capacity Building Component • Revisions of the Code of Good Agriculture Practices for the Protection of Water against Pollution with Nitrates from Agricultural Sources through a research institute together with support from MADR and farmers' organizations, with a focus of revisions to the current needs of farmers and with an emphasis on the efficiency of the use of fertilizers • Diverse range of trainings: total organic carbon - TOC analysis (15 specialists), molecular absorption spectroscopy – UV- VIS (42 specialists), geographic information systems – ArcGIS (39 specialists), implementation of the Nitrates Directive at county level (51specialists), sampling procedures for technicians (41 specialists), analysis of nutrients and metalsin sediments and water suspensions (32 specialists), specific analysis for phytoplankton, phytobenthos, and macrozoobenthos (41 specialists), standards and methodologies (41 specialists) Page 54 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) • 3 Conferences organized within KTNs for farmers, representatives of local administrations and other interested parties with a focus on agricultural legislation, environmental compliance requirements, available funding sources, penalties associated with non-compliance, analysis of the actions undertaken by the Member States for the sustainable management of nitrogen and on the development of a model action plan to reduce pollution with nitrogen compounds. • Public awareness program that covered: 14 regional workshops - 1260 participants; 174 seminars at community level – 5640 participants; 87 training of trainers - 1327 participants; 104 seminars in schools - 6500 participants. The events were targeted at professionals and organizations with responsibilities in environmental issues at regional level; farmers; individual householders; local authorities; community leaders; children in 87 project communes. Outcome Indicators OI 3: Percentage of population in the project area adopting preventative and remedial measures to reduce nutrient discharges (index measures various rural waste management and good agricultural practices) (Target: 75%; Actual: 76.5%, equal to 102% of the target) Intermediate Results • Percentage of households with access and connection to sewage system (in targeted villages receiving sewage Indicators investments) (Target: 60%; Actual: 86%, 143% achieved) • Land users adopting sustainable land management practices as a result of the project (Target: 30,000; Actual: 48,300, 161%) • Number of project communes implementing at least one of the following nutrient reduction measures: communal platforms, pasture rehabilitation, tree planting (cumulative) (Target: 200; Actual: 202, 101% achieved) • Number of farmers trained by knowledge and training providers on Code of Good Agricultural Practices (male/female disaggregated) (Target: 6,000; Actual: 6,504, 108% achieved) • Number of female farmers trained by knowledge and training providers on Code of Good Agricultural Practices (Target: 3,000; Actual: 2827, 94% achieved) • Number of surveys conducted that collect feedback and report back the results to the communities (Target: 3; Actual: 3, 100% achieved) Key Outputs by Component 1: Investments in Local Communities to Reduce Nutrient Pollution Component • 202 communes with either completed investments or implementing nutrient reduction measures (see also under OI 4 and OI5) • 1,266 individual platforms built; 5,394 waste bins delivered to households • 256 ha in over 57 localities planted Page 55 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) • Manure management equipment: 86 equipment sets, which include 81 frontal loaders, 88 tractors, 176trailers, 82 vacuum tankers, and 82 manure spreaders for the communes where the platforms were built Component 2: Institutional Strengthening and Capacity Building • Knowledge Transfer Network (KTN) set up to promote good agricultural practice and reduce the risk of nitrate pollution in Romania • Establishment of about 369 discussions groups, supported by around 243 champion farmers and 76 communal platforms hosting demonstrations for manure management good practices • 1600 trained farmers • A special control plan established through the National Environmental Guard • Development of template design of communal and individual platforms for further European financing (NRRP) 07/CQ/2022 Component 3: Public Awareness and Information Support • Successfully carried out extensive national awareness campaign on nitrate pollution, including the broadcasting of TV and radio spots, interventions through social media, contests for children, a caravan through which the water from the wells was tested; 146 TRPs in total • Project website and blog, accounts on Facebook, My Space, You Tube, LinkedIn, contests for children and farmers • 1,124 articles published • 15,125 news integrated in the FocusInfo Section • Total traffic on web portal - 13,217 users • 1,516 unique visitors (average no./month) Component 4: Project Management • 3 Beneficiary Surveys carried out • 3753 households (HHs) interviewed Outcome Indicators OI 4: Downward trend of nitrates concentration in waters: at least 70% of targeted project areas show 10% reduction in nitrates discharge to water bodies (Target: 70%; Actual: 70.1%, equal to 100% of the target) OI 5: Nutrient load reduction (Nitrogen(N)) achieved under the project (Target: 600 tones/year; Actual: 696.68 tones/year; equal to 116% of the target) Intermediate Results • Percentage of cropped area in the project commune under relevant nutrient reduction measures (Target: 60%; Actual: Indicators 75.8% or 126% achieved) • Number of communal platforms completed (cumulative) (Target: 150; Actual: 174 or 116% achieved) Page 56 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) • Land area where sustainable land management practices were adopted as a result of project (Ha) (Target: 38,000 ha; Actual: 43,756 ha or 115% achieved) • Increased number of groundwater quality monitoring sites and sample analysis for the Nitrate Directive (Target: 8; Actual: 8.12, measured as density per 1000km2, 102% achieved) Key Outputs by Component 1: Investments in Local Communities to Reduce Nutrient Pollution Component • Construction of 86 manure platforms and the Seini biogas station during the original INPCP (before 2017) and 90 communal manure platforms and 3 composting stations during INPCP AF (after 2017) – all provided with the necessary equipment for. The total capacity of manure storage built by the INPCP is over 420 thousand cubic meters. • 11 sewage systems completed and handed over to mayors; 2,400 households and 50 institutions connected to sewerage facilities. • Investments in drilling equipment, measuring water parameters and laboratories to strengthen the monitoring system of the Romanian National Water Administration • Rehabilitation of over 120 boreholes necessary for the creation of groundwater monitoring wells, equipping the surface water monitoring sections with various measuring instruments, as well as provision of equipment to laboratories at the level of hydrographic basins. • 107 rehabilitated piezometers: 57 are part of the existing monitoring network, other 50 piezometers represent an extension of the network Component 2: Institutional Strengthening and Capacity Building • Fully operational ANAR training center (Voina Training Centre) constructed/extended, equipped laboratories • Equipment and software for supporting the work of ANAR to increase the monitoring and reporting capacity under Nitrate Directive & WFD • Pilot biogas plant in the Southern part of Seini locality, Maramures County Page 57 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 2. BANK LENDING AND IMPLEMENTATION SUPPORT/SUPERVISION A. TASK TEAM MEMBERS Name Role Preparation Karin Shepardson Task Team Leader Cesar Niculescu Task Team Leader Gayane Minasyan Task Team Leader Dmytro Donets Procurement Specialist Bogdan Constantinescu Senior FM Specialist Aziz Bouzaher Consultant Dariusz Kobus Consultant Supervision/ICR Alexandru Cosmin Buteica, Berengere P. C. Prince Task Team Leader(s) Elena Corman Procurement Specialist(s) Anneliese Viorela Voinea Financial Management Specialist Harika Masud Social Specialist Adrian Laurentiu Mihailescu Environmental Specialist Ana Maria Luchian Procurement Team Irina Elena Talos Team Member Yelena Yakovleva, Sanne Tikjoeb ICR Co-authors B. STAFF TIME AND COST Staff Time and Cost Stage of Project Cycle No. of staff weeks US$ (including travel and consultant costs) Preparation Page 58 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) FY05 5.437 34,672.91 FY06 34.015 147,296.66 FY07 44.184 197,324.30 FY08 6.625 44,645.88 Total 90.26 423,939.75 Supervision/ICR FY24 22.261 86,036.28 FY23 17.950 96,554.07 FY22 29.338 160,449.29 FY21 26.603 166,407.17 FY20 15.508 88,006.72 FY19 15.237 114,385.02 FY18 12.890 68,058.56 FY17 12.287 75,796.19 FY16 28.988 78,789.15 FY15 16.075 60,670.22 FY14 13.542 42,412.80 FY13 16.554 61,960.68 FY12 18.300 83,609.90 FY11 33.164 113,965.53 FY10 23.938 95,292.57 FY09 16.479 77,718.78 FY08 10.290 50,598.76 FY07 0 35.75 FY06 0 26.96 Total 329.40 1,520,774.40 Page 59 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 3. PROJECT COST BY COMPONENT Table 3.1. Components and Actual Costs (IBRD, EUR) Amount IBRD at Total amount Actual at Percentage of Components Approval IBRD with AF Project Closing Total, % (EUR) (EUR) (EUR) Investments in Local Communities for 39.4 74.4 74.2 99 Reducing Nutrient Pollution Institutional Strengthening and Capacity 3.9 9.4 9.1 97 Building Public Awareness and Information 2.5 6.0 5.99 100 Support Project management 4.2 8.2 8.2 100 Total 50.0 98.0 97.52 99.5 Table 3.2. Components and Actual Costs (IBRD and TF, US$) Amount IBRD Total amount Revised total Actual at with TF at IBRD with AF amount (closed Project Components Approval and TF IBRD and TF) Closing (US$) (USD) (USD) (USD) Investments in Local Communities for 57.8 93.90 92.10 88.0 Reducing Nutrient Pollution Institutional Strengthening and Capacity 7.4 14.00 13.50 13.0 Building Public Awareness and Information Support 3.1 7.52 7.52 7.27 Project management 5.3 10.57 10.57 10.57 Total 73.6 125.99 123.69 118.84 Table 3.3. Evolution of Components and Costs with Restructurings, 2007-2023 Project at Component/ Approval (IDA 2016 Additional 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Sub- 4873-RO & Financing component GEF (Level 1) TF058040) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) Date 15-Oct- 22-Oct- 20-Mar- 30-Oct-07 5-Jul-12 5-Aug-13 8-Sep-15 28-Mar-16 3-Nov-16 Approved 19 21 23 IBRD loan EUR 50m (US$120.49m IBRD loan Amount - - - equivalent) and - - - - (US$68.1m US$5.5m GEF equivalent) grant Page 60 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Project at Component/ Approval (IDA 2016 Additional 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Sub- 4873-RO & Financing component GEF (Level 1) TF058040) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) and US$5.5m GEF grant Commune- based Revised: Investments Investments in in NVZs Local (EUR45.9 Communities to million – IBRD Reduce Nutrient No No No Component 1 EUR39.4 No change No change No change Pollution No change change change change million and (US$93.90 million, GEF US$2.1 out of which AF million) loan of EUR 35 [80% of the million/ US$38.20 Project’s loan million) amount] Revised scope 1.1 (dropping Communal 1.5): Storage and 1.1 Handling Communal systems to Storage and Revised scope promote Handling (moving 1.4 to better systems to 2.1): management promote 1.1 Communal of livestock better Storage and and management Handling systems household of livestock to promote better Sub- waste and management of No No No components/ 1.2 Planting of No change No change No change household livestock and change change change activities BufSer Strips waste household waste and Pastures’ 1.2 Planting 1.2 Planting of Rehabilitation of BufSer BufSer Strips and 1.3 Water & Strips and Pastures’ Sanitation Pastures’ Rehabilitation 1.4 Promotion Rehabilitation 1.3 Water & of Code of 1.3 Water & Sanitation Good Sanitation Agricultural 1.4 Practices Promotion of 1.5 Feasibility Code of Good Studies Agricultural Practices Support for Revised: Institutional Institutional Strengthenin Strengthening No No No Component 2 No change No change No change No change g and and Capacity change change change Capacity Building Building (5.3 (US$14.00 million, Page 61 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Project at Component/ Approval (IDA 2016 Additional 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Sub- 4873-RO & Financing component GEF (Level 1) TF058040) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) million Euro, out of which AF of which 3.9 loan of EUR5.5 million Euro i million/US$6.00 s IBRD, and million) US$2.7 million is GEF 2.1 Development of national knowledge and training activities (through providers), as well as support for on- farm demonstrations, to improve Sub- No No No - - - - compliance, No change components change change change adoption and monitoring of the Code of Good Agricultural Practices to reduce nutrient pollution (originally was Sub-component 1.4) Public Awareness Revised: Public and Awareness and Replication Information Strategy (2.6 Support (US$7.52 million Euro, No No No Component 3 No change No change No change million, out of No change of which 2.5 change change change which AF loan of million Euro i EUR3.5 s IBRD, and million/US$3.82 US$0.2 million million i s GEF) Project Project Management Management (4.6 million (US$10.57 million, Euro, of which No No No Component 4 No change No change No change out of which AF No change 4.2 million change change change loan of EUR4 Euro i s IBRD, million/US$4.37 and US$0.5 million) million is GEF) Page 62 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 4. EFFICIENCY ANALYSIS 1. The efficiency analysis is divided in two sections: (i) Aspects of design and implementation, and (ii) Economic analysis. ii. Aspects of design and implementation Cost by component 2. Overall project costs by component remained proportional to the additional financing approved. Actual project cost as a percentage of the original amount approved is 171 percent. Based on the original project cost of US$73 million, the additional financing of US$52 million accounts for 71 percent of overall project cost at closing. For Component 1, actual expenditures on physical investments were proportional to the estimated cost as both the appraised and actual value accounted for 75 percent of project funds. Similarly for Component 2 on institutional strengthening, actual expenditures were equal to 175 percent of the original appraisal estimate. Component 3, which accounted for just 5 percent of project cost, was financed at 203 percent of the originally estimated cost due to a larger allocation at the AF. Finally, actual administrative cost on project management remained proportional to the original allocation (Component 4). 3. Expected outcomes remained commensurate with the additional investment, such as the number of communal platforms completed, which increased 74 percent from 86 to 150 (IRI 2), and the land area where sustainable land management practices were adopted, which doubled from 18,000 ha to 38,000 ha (IRI 12). In some ways, the project became more ambitious with the AF raising the targets for several indicators based on a percentage achievement (OI 3, IRI 1, and IRI 3) and introducing new ones to track additional outputs and outcomes (OI 5, IRI 4, IRI 7 and IRI 9). 4. Overall, a comparison of actual cost by component to appraisal estimates indicate a reasonable level of efficiency when considering the additional financing and additional expected outputs and outcomes as well as the actual overachievement of most indicators at project closing. Time overruns 5. There were significant time overruns, as the original project was extended five years. The country context at the time of approval was characterized by high levels of inefficiency at the government level. As recounted under factors that affected implementation, the project suffered effectiveness delay of over a year and implementation progress was slow with many activities lagging behind schedule due to procurement challenges and cumbersome internal approval procedures. Furthermore, the different approach endorsed during the AF to forego the standardized platform template design and allow for customized designs resulted in a significant burden on the PMU to consult and quality control every single platform design to ensure proper implementation of funded activities. Finally, the financial crisis and the global pandemic compounded project inefficiencies by (i) limiting budgetary support, including salary freezes that affected hiring in the early phase of establishing the PMU, (ii) by COVID-19 restrictions, which led to initial blockages in trainings and workshops and the slowdown of adoption of good agricultural practices, and (iii) by raising the cost of materials and equipment, which affected the construction phase towards the end of the project until a national mechanism for prices adjustments was approved and implemented. Nevertheless, the high prices raised the cost of manure platform construction as well the Page 63 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) KTNs implementation due to higher prices of fuel, accommodation and luncheons, as no mechanisms were approved for mitigating the effect of higher prices on services. 6. The decision was made to proceed with an AF restructuring rather than prepare a new project as the development outcome was identical and implementation built on the previous project. It was also a way to keep the PMU intact and prevent a significant loss of capacity. In hindsight, the decision enabled the retention, continuation and development of technical skills and managerial capacity at the PMU, which served the project and Romania well. The INPCP had just two PMU Directors/Coordinators as well as some permanent key technical staff (procurement and technical engineer) over the 16-year life of the project, and this continuity (in the face of 32 changes of Minister and turnover at departmental levels) overall favored project implementation. The PMU grew to become a department in the MEWF and forms part of the technical expertise at the highest level of government, representing Romania in European and international context, and providing critical support for the coordination of international cooperation and development assistance including EU funding, such as the technical designs for the upcoming NRRP. Furthermore, the project overperformed on several key indicators and leveraged an additional US$63 million in the World Bank follow-on RAPID project and US$250 million from EU sources under the NRRP. It may also be noted that between the Interim ICR in 2016 and the Final ICR in 2024 project achievements have improved above what is commensurate with the additional investment. ii. Economic analysis 7. The project will have clear benefits in addressing key elements in nutrient pollution of the Black Sea from poor agricultural practices in the Romanian catchments that drain into the Danube River. 8. Besides improvements in the quality of ground and surface waters, project benefits also include: (i) progress towards compliance with the EU Nitrates Directive and increased absorption capacity of future EU funds for water and sanitation; (ii) sequestering carbon in the grasslands, croplands and forests; (iii) improvements in health as there will be an improvement in the drinking water, sanitation and general hygiene of the population; (iv) additional farm income from effective use of organic waste, crop rotations, organic products and improved livestock grazing practices and improved agricultural productivity through better agricultural practices, low input use and better farm management; (v) additional farm income from fertilization with pellets; (vi) increased capacity building of local institutions. 9. It is often difficult to categorize the cost effectiveness of different agricultural nutrient removal interventions because this is typically a function of local conditions: topography, climate, cropping systems, maintenance, site selection and installation. In addition, most interventions are rarely used alone, but in combination with one or more types of interventions. 10. This analysis focuses on various measures of cost effectiveness as well as a cost-benefit analysis to assess the economic impact of manure platforms in terms of EU subsidies to farmers and avoided penalties. Cost-effectiveness analysis 11. Various measures of unit cost analysis to compare with appraisal estimates and similar projects. a. Value of investments per commune 12. At the time of appraisal, the average value (base cost) of the package of investments per commune would Page 64 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) be approximately US$445,000. Based on information in the PAD, it is noted that the average investment is (i) EURO630,000 (or US$850,000 equivalent) for each of the nine training and demonstration sites, EURO2.4 million (or US$3,2 million equivalent) for the two TDS communes also receiving a water and sewage treatment facility, and EURO260,000 (or US$350,000 equivalent) for the other 80 roll-out communes (using the EUR/USD exchange rate of 1.35 as valid in September 2007). Cost estimates provided for the construction of one or two communal storage facilities with capacity for holding up to 3,000 tons of livestock waste in each commune, together with about 200 household storage bunkers. Table 4.1 Cost estimates/ investments Communes Investment per unit (US$) Total # of units Total Communes with training and demonstration sites 850000 9 7 650 000 Communes with TDS and water and sewage treatment facility 2400000 2 4 800 000 All other communes 350000 80 28 000 000 Total 40 450 000 Per Commune 444 505 13. At project closing, the realized average package of investments to 202 participating communes is US$465,000. This is based on actual expenditures under Component 1 of US$94 million and the cumulative number of project communes implementing at least one type of nutrient reduction measures, such as communal platforms, wastewater treatment facility, pasture rehabilitation, and tree planting. The actual achievement compares favorably to the appraisal estimate. b. Unit cost per communal manure platform 14. In the PAD, it is estimated that each communal platform for composting manure would cost EUR260,000 (or US$350,000 equivalent at the time of appraisal). Cost estimates provided for the construction of one or two communal storage facilities with capacity for holding up to 3,000 tons of livestock waste in each commune, together with about 200 household storage bunkers. At project end, the actual average cost for each platform is assessed by the Project Team to be RON1 million (or US$220,000 equivalent at the time of project closing). The net gain can be partly contributed to an on average lower capacity for communal platforms (lowered from 3,000 tons per year to 1,500 tons per year over the life of the project), and partly to currency exchange rate savings as the US dollar strengthened significantly against the EURO since 2007 to 2023 (from EUR/USD 1.4 in October 2007 to EUR/USD 1.09). c. Unit cost of nutrient reduced 15. At appraisal, an analysis examining the cost effectiveness of nutrient reduction interventions was carried out with estimated CE ratios varying between 10 US$/kg and 40 US$/kg. The analysis focused on determining reductions of nutrients (N, P and K) leakage into the environment that were achieved as a result of improved manure management and other agricultural practices, including afforestation, nutrient and grazing management, crop rotations, vegetation strips, etc. Cost effectiveness ratios were then calculated, as the ratio of total monetary cost of reduced leakages over the total amount of nutrient reductions achieved. The costs considered included capital investment costs, maintenance and operation costs, and project management costs. 16. At closing, the annual total manure diverted in 2022 from dumping was 87,736 tons, generating a reduction of 671 tons nitrogen and 364 tons phosphorous in nutrient discharge. CE ratios were estimated for reductions in nutrient leakage (to ground and surface waters) associated with 129 active communal Page 65 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) manure platforms. The CE ratio for nutrient reduction is defined as the ratio of the annualized cost of constructing and managing manure platforms over annual nutrient reductions achieved. Hence the CE ratio is measured in terms of (US$/ kg of nutrient reduced). CE ratios are calculated for N and P. 17. Estimation of costs included are (i) average initial investment costs per platform and (ii) annual operations and maintenance (O&M) costs., which are assumed to be equal to 10 percent of investment costs. Platform lifespan is assumed to be 20 years. The analysis proceeds with two scenarios: at the platform level to isolate the cost effectiveness of the construction and operation of a single communal manure platform (RON1 million per platform), and second, at the level of Component 1 to consider the cost effectiveness per nutrient discharge reduced against the total cost of all physical investments (US$94 million). 18. The analysis shows that expected cost effectiveness per kg of nutrient discharge reduced at project closing range from US$6-12 for a single platform and US$20-39 against the total cost of all physical investments financed by Component 1. These results compare favorably to both the appraisal estimate of between 10 USD/kg and 40 USD/kg as well as to figures from similar projects in Moldova, Poland, and the US (Table 4.2). In Moldova, cost-effectiveness figures under the Agricultural Pollution Control Project were US$3 / kg nitrogen and US$4 / kg potassium. In Poland, CE ratios in the Bank-funded Rural Environmental Protection Project ranged from US$18.5/ kg N to US$24.8/ kg N. Meanwhile, in the United States Chesapeake Basin, the estimated median CE ratio for animal waste systems was US$39/ kg N removed. Table 4.2. Cost-effectiveness (US$ / Kg) Page 66 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 5.A. BORROWER, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS The Bank shared the draft Implementation Completion and Results Report (ICR) for the Romania Integrated Nutrient Pollution Control Project with the Ministry of Finance as well as the Project Management Unit (PMU) on April 24, 2024, with a kind request to provide any feedback and comments by May 17, 2024. The Ministry of Finance informed on May 28, 204 that there are no comments from their side, acknowledging the collaboration with the PMU and World Bank team. The PMU informed the Bank team on May 22, 2024 that they are satisfied with the draft ICR and confirmed that the document accurately reflects the INPC Project progress and achievements. The PMU also thanked the Bank and Ministry of Finance teams for providing the needed support along the INPCP implementation. Page 67 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 5.B. SUMMARY OF FINAL BENEFICIARY SURVEY The summary outlines the key findings from the Report No. 3 – End of Project Survey dated October 2023. The research was conducted by CURS (Center for Urban and Regional Sociology) and NOVEL Research for MEWF (Ministry of Environment, Waters and Forests) in 2023. It primarily focuses on significant changes observed in the development of infrastructure and utilities, as well as the impact assessment of measures taken to reduce nutrient pollution. Key findings: • Communes with investments have seen significant improvements in infrastructure, utilities, and waste management systems, with a higher percentage of households connected to sewage, water systems, and waste collection systems. • The adoption of nutrient reduction measures and awareness of pollution from improper waste and manure management has increased significantly in communes with investments. • There is a trend towards urbanization in communes with investments, with a decrease in households raising livestock and an increase in households connected to urban infrastructure. • The notoriety of the Code for Good Agricultural Practices has increased at the household level, and the use of manure as fertilizer is common in both communes with and without investments. • The main method for waste discharging in the surveyed communes is using special waste containers, and the practice of selective waste collection has become more prevalent over time. • The awareness of the polluting effects of improper waste management and agricultural practices is relatively high, but the adoption rate of improved waste management practices is below average. • The service for collecting waste is available in most of the surveyed communes, and the awareness of the Integrated Nutrient Pollution Control Project (INPCP) was relatively high. Page 68 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 6. RESTRUCTURING PROCESSES, 2007-2023 Table 6.1. INPCP Restructuring Processes, 2007-2023 Project at 2016 Additional Item/Rational Approval (IDA 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Financing e 4873-RO & GEF (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 1) TF058040) Date Approved October 30, July 5, 2012 August 5, September 8, March 28, 2016 November 3, October 15, October 22, March 20, 2007 2013 2015 2016 2019 2021 2023 Total Project EUR 50m IBRD - - - EUR 50m + EUR - - - - Amount loan (US$68.1m 48m IBRD loan equivalent) and (US$120.49m US$5.5m GEF equivalent) and grant US$5.5m GEF grant Amount - 14.55 30.11 46.21 48.88 53.70 69.75 90.47 108.17 Disbursed PDO to reduce nutrient discharges into water bodies and to promote to support the Borrower towards meeting EU Nitrate Directive requirements at a behavior change through strengthened institutional and regulatory national scale25 capacity and demonstrated commune-based actions and, hence, support the Government of Romania to meet the EU requirements in the field of water protection24 Proposed December 31, December 31, November May 31, 2017 March 31, 2022 March 31, March 31, June 30, December Closing Date 2013 2013 30, 2015 2022 2022 2023 31, 2023 (in bold) Rationale for - - Due to To fully Due to AF - - To ensure all To ensure all Extension substantially achieve the project project reduced PDO and activities are activities are budget support AF fully fully allocation in preparation implemented implemented 2013 in a in a (budget satisfactory satisfactory deficit) at manner and manner (high 24 PDO as in the Loan Agreement dated 2007 25 PDO as in the Loan Agreement dated 2016 on Additional Financing Page 69 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Project at 2016 Additional Item/Rational Approval (IDA 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Financing e 4873-RO & GEF (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 1) TF058040) government the loan is inflation level, fully affected affecting disbursed, procurement) completion delayed due of all project to COVID-19 activities outbreak Other Changes - • Dropping Only Closing • Reallocation • AF Reallocation • New Only Closing Only Closing activity, Date between • Components & between safeguard Date Date Comp 1 Extension components Costs components policy Extension Extension • Revised RF • RF triggered – • Reallocation • Impl Plan OP 4.04: between • Disbursements Natural components Habitats; • Environmen tal Analysis Results Original RF Dropping IRI Revised RF Framework PDO level #1 linked to PDO level (formal indicators: 5 FS indicators: 5 revisions) (incl. GEO: 1) (GEO: 1 – not mentioned in AF IRI indicators: 10 but remained in RF till 2018) Revised IRI indicators: 15 Components Commune-based Investments in NVZs (EUR45.9 million – IBRD Investments in Local Communities to Reduce Nutrient Pollution (US$93.90 million, and Costs EUR39.4 million and GEF US$2.1 million) out of which AF loan of EUR 35 million/ US$38.20 million) Component 1 1.1 Communal Storage and Handling systems to promote better 1.1 Communal Storage and Handling systems to promote better management of management of livestock and household waste livestock and household waste 1.2 Planting of BufSer Strips and Pastures’ Rehabilitation 1.2 Planting of BufSer Strips and Pastures’ Rehabilitation 1.3 Water & Sanitation 1.3 Water & Sanitation 1.4 Promotion of Code of Good Agricultural Practices 1.5 Feasibility Studies (dropped at 2012 RP) Component 2 Support for Institutional Strengthening and Capacity Building (5.3 Institutional Strengthening and Capacity Building (US$14.00 million, out of which AF million Euro, of which 3.9 million Euro is IBRD, and US$2.7 million is loan of EUR5.5 million/US$6.00 million) Page 70 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Project at 2016 Additional Item/Rational Approval (IDA 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Financing e 4873-RO & GEF (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 1) TF058040) GEF) 2.1 Development of national knowledge and training activities (through providers), as well as support for on-farm demonstrations, to improve compliance, adoption and monitoring of the Code of Good Agricultural Practices to reduce nutrient pollution (originally was [1.4]) Component 3 Public Awareness and Replication Strategy (2.6 million Euro, of Public Awareness and Information Support (US$7.52 million, out of which AF loan of which 2.5 million Euro is IBRD, and US$0.2 million is GEF) EUR3.5 million/US$3.82 million Component 4 Project Management (5.6 million Euro, of which 4.2 million Euro is Project Management (US$10.57 million, out of which AF loan of EUR4 million/US$4.37 IBRD, and US$0.5 million is GEF) million) Table 6.2. Summary of Key Changes Made via Restructurings Key Changes 2016 Additional 2012 RP 2013 RP 2015 RP 2016 RP 2019 RP 2021 RP 2023 RP Financing (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 2) (Level 1) Change in Project's Development Objectives Change in Results Framework Change in Safeguards Policies Triggered Other Changes to Safeguards Change in Legal Covenants Change in Loan/Grant Closing Date Reallocation between Disbursement Categories Change in Disbursement Estimates Change in Components and Costs Change in Financial Management Change in Procurement Change in Implementation Schedule Other Changes Page 71 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 7. RESULTS FRAMEWORK ACHIEVEMENTS AND EVOLUTION VIA RESTRUCTURINGS, 2007-2023 Table 7.1. Results Framework Achievements PDO and IRIs Indicators Unit Baseline Target Actual Value Dec 31, 2023 Achieved # PDO Indicators DO To support the Government of Romania towards meeting EU Nitrate Directive requirements at a national scale Downward trend of nitrates concentration in waters: at least 70% of targeted project areas show 10% reduction in nitrates discharge to water % 0 70.1 Achieved OI1 70 bodies Nutrient load reduction (Nitrogen(N)) achieved under the project Achieved OI2 - 0 696.68 (Tones/year) 600 Percentage of population in the project area adopting preventative and 3 remedial measures to reduce nutrient discharges (index measures various % (survey, 76.5 Achieved OI3 75 rural waste management and good agricultural practices) 2009) Improvements acknowledged -Good capacity of the governmental Improved inter-governmental coordination and capacity to assess, monitor Improvements Achieved OI4 Text institutions in the assessment, and report on progress with implementation of the EU Nitrates Directive acknowledged monitoring and reporting regarding the implementation of the EU Nitrates Directive Progress acknowledged Favorable EU assessment of Romania's progress towards meeting EU Achieved OI5 Text through EU Progress acknowledged Nitrates Directive comments on reports Increased awareness of linkages between local actions and impact on Black Partially OI6 % 9 30 23.5 achieved Sea and Danube River water quality (GEO indicator) Intermediate Indicators Component 1: Investments in Local Communities to Reduce Nutrient Pollution Page 72 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) 9 Percentage of cropped area in the project commune under relevant nutrient (baseline Achieved 1 60 75.8 reduction measures survey, % 2009) Percentage of households with access and connection to sewage system (in Achieved 2 0 60 86 targeted villages receiving sewage investments) % Number of communal platforms completed (cumulative) 0 150 174 Achieved 3 Land area where sustainable land mgt. practices were adopted as a result of Achieved 4 0 (2008) 38,000 43,756 project (Ha) Component 2: Institutional Strengthening and Capacity Building Ad-hoc WGs effective impleme to support EU Working groups at Water Basin and County levels functioning effectively and ntation reporting and WGs are functioning Achieved 5 all staff working on the Nitrates Directive fully operational of coordinate effectively working with other groups agencies Land users adopting sustainable land mgt. practices as a result of the project 0 (2008) 30,000 48,300 Achieved 6 Number of project communes implementing at least one of the following nutrient reduction measures: communal platforms, pasture rehabilitation, 0 (2009) 200 202 Achieved 7 tree planting (cumulative) Number of technical staff (ANAR, EPA, Health Directorates) trained Achieved 8 0 700 707 (cumulative) Reduction in number of farmers penalized by APIA for non-compliance with Achieved 9 50 30 14.47 Nitrate Directive (Percentage) Increased number of groundwater quality monitoring sites and sample 7.50 Achieved 10 8 8.12 analysis for the Nitrate Directive (2015) Number of farmers trained by knowledge and training providers on Code of Achieved 11 0 (2015) 6,000 6,504 Good Agricultural Practices (male/female disaggregated) Number of female farmers trained by knowledge and training providers on Partially 12 0 (2015) 3000 2,827 achieved Code of Good Agricultural Practices Component 3: Public Awareness and Information Support Page 73 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Number of meetings/public consultations/workshops organized towards Achieved 13 0 (2015) 100 250 meeting project objectives Percentage of questions, comments or complaints relevant to the project Achieved 14 0 (2015) 100 100 that are received and addressed within indicated 30 days Component 4: Project Management Number of surveys conducted that collect feedback and report back the Achieved 15 0 (2015) 3 3 results to the communities Table 7.2. Evolution of PDO Objectives, PDO Indicators and Targets At Approval 2007 At Project Closing 2023 PDO Outcomes PDO Indicators Targets Revised PDO Revised PDO Indicators Revised Targets (Original Loan Outcomes (AF 2016) 2007) To support the OI1: Improved inter-governmental Improvements To support the OI1: Improved inter-governmental Improvements Government of coordination and capacity to assess, acknowledged Government of coordination and capacity to assess, monitor acknowledged Romania to meet monitor and report on progress with Romania towards and report on progress with implementation the EU implementation of the EU Nitrates meeting EU Nitrate of the EU Nitrates Directive requirements in Directive Directive the field of water requirements at a OI2: Favorable EU assessment of Romania’s Progress protection OI2: Favorable EU assessment of Progress national scale progress towards meeting EU Nitrates acknowledged Romania’s progress towards meeting acknowledged Directive EU Nitrates Directive To promote OI3: Around 50 percent of the 50% OI3: Percentage of population in the project 75% behavior change population in the project area adopting area adopting preventative and remedial preventative and remedial measures to measures to reduce nutrient reduce nutrient discharges discharges (index measures various rural waste management and good agricultural practices) To reduce nutrient OI4: At least 80 percent of targeted 80% OI4: Downward trend of nitrates 70% discharges into NVZs show 10 percent reduction in concentration in waters: at least 70% of water bodies nutrient discharge to water bodies targeted project areas show 10% reduction in nitrates discharge to water bodies OI 5: Nutrient load reduction (Nitrogen(N)) 600 tons/year achieved under the project (Tones/year) Page 74 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) At Approval 2007 At Project Closing 2023 GEO: OI5: Increased awareness of linkages to reduce over the between local actions and impact on long term, the Black Sea and Danube River water discharge of quality nutrients into water bodies leading to the Danube and Black Sea Table 7.3. Evolution of Results Framework via Restructurings, 2007-2023 Original PAD Restructuring (2012) Additional Financing (2016) Actual value October 3, 2007 achieved Notes Dec 31, 2023 Revised Revised Revised New/Revised New/ Revised # PDO Indicators Unit Baseline Target Revised Indicators Achieved target Indicators baseline target baseline target Revised: Downward Percentage of trend of nitrates targeted NVZs concentration in show 10% PDO 1 OI No waters: at least 70% of reduction in % 0 80 0 70 70.1 1 change targeted project areas nutrient load show 10% reduction discharge to water in nitrates discharge bodies to water bodies New: Nutrient load Reported first time in reduction ISR Seq. 08 dated OI - - - - (Nitrogen(N)) 0 600 696.68 December 2012; 2 achieved under the Restructuring project (Tones/year) processed in July 2012 Revised: Percentage Percentage of the of population in the population in the project area adopting PDO 2 OI project area No 3 (survey, % 0 50 preventative and 75 76.5 3 adopting change 2009) remedial measures to preventative and reduce nutrient remedial measures discharges (index Page 75 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Original PAD Restructuring (2012) Additional Financing (2016) Actual value October 3, 2007 achieved Notes Dec 31, 2023 to reduce nutrient measures various discharges rural waste management and good agricultural practices) Improvements acknowledged - Improved inter- Good capacity of No change: Improved governmental the inter-governmental coordination and governmental coordination and capacity to assess, institutions in the OI Improvements No capacity to assess, Improvements monitor and report Text assessment, 4 acknowledged change monitor and report on acknowledged on progress with monitoring and progress with implementation o f reporting PDO 3 implementation of the the EU Nitrates regarding the EU Nitrates Directive Directive implementation of the EU Nitrates Directive Favorable EU Progress No change: Favorable Progress assessment of acknowledged EU assessment of acknowledged OI Romania’s No Progress Text through EU Romania's progress through EU 5 progress towards change acknowledged comments on towards meeting EU comments on meeting EU reports Nitrates Directive reports Nitrates Directive Increased Increased awareness awareness o f Last reported in Seq.19 16% of linkages between linkages between ISR - June 11, 2018; (revised: local actions and OI local actions and No 16 (survey, removed in Seq.20 ISR; GEO % 0 30 baseline 30 impact on Black Sea 30 n/a 6 impact on Black change 2009) actual target - 23.5%; survey, and Danube River Sea and Danube GEF TF closed on May 2009) water quality (GEO River water quality 31, 2017) indicator) (GEO indicator) Page 76 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Intermediate Results Indicators Actual Original PAD Additional Financing value Restructuring 2012 Notes October 3, 2007 (2016) Dec 31, 2023 Revise Revised Revise Intermediate d Revised Revised Achieved # U Baseline Target Indicato d Revised Indicators Indicators Baselin Baseline target target rs target e A higher share of Restructurin programmed EU g approved rural development only in July grant resources 2012, IRI was linked with nutrient >1 Dropped - - - n/a already control measures in removed NVZs than in non- from Seq.07 NVZs & over ISR - March 1 baseline 2012 Cost of measures Already for reduced < USD 40 No Dropped - - n/a dropped in discharge for 1 Kg of in average change 2012 Component 1 2 N (000RON) Percentage of households with livestock adopting No % 4 45 Dropped - - n/a improved waste change management 3 practices No info Percentage of before Seq. targeted communes 06 ISR March with tree planting 2011 - Likely, No 4 and the pastures % 0 75 - - - n/a revised as change rehabilitation in the "Number of agreed project project plans implemented communes implementin Page 77 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Actual Original PAD Additional Financing value Restructuring 2012 Notes October 3, 2007 (2016) Dec 31, 2023 g at least one of the following nutrient reduction measures: communal platoforms, pasture rehabilitation , tree planting (cumulative)" Revised Target: Percentage of Percentage of cropped area in the cropped area in the 9 (updated project commune No 5 % <2 30 project commune from baseline 60 75.8 under relevant change under relevant survey, 2009) nutrient reduction nutrient reduction measures measures Revised Target: Percentage of Percentage of households in households with targeted villages access and No connected to the % 0 30 connection to 0 60 86 change sewage system with sewage system (in appropriate targeted villages treatment receiving sewage 6 investments) Revised Target: Appeared in Number of Seq. 06 ISR communal platforms 0 150 174 starting completed March 2011 (cumulative) Page 78 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Actual Original PAD Additional Financing value Restructuring 2012 Notes October 3, 2007 (2016) Dec 31, 2023 Revised Target: Land area where sustainable land mgt. 0 (2008) 38,000 43,756 practices were adopted as a result of project (Ha) Relevant legislation updated and Ministerial Orders Legislative EU issued clearly and acceptanc defining reporting e No Dropped - - n/a responsibilities. EU framewor of change reporting process k Romania tested and using untested report inputs of multiple institutions Satisfacto- Unified set of Separated ry imple- monitoring monito- men- Component 2 guidelines and ring tation to standards for soil No frame- meet Dropped - - n/a and water adopted, change work for governme and monitoring water and nt and EU program soil require- implemented ments WGs WGs Working groups at effective Revised: Working effective Water Basin and to support groups at Water to Ad-hoc WGs are County levels EU Basin and County Ad-hoc support implemen functioni functioning reporting No levels functioning implementati EU tation of ng effectively and all and change effectively and all on of working reporting working effectivel staff working on the coordinat staff working on the groups and to groups y Nitrates Directive e with Nitrates Directive coordina fully operational other fully operational te agencies actions Page 79 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Actual Original PAD Additional Financing value Restructuring 2012 Notes October 3, 2007 (2016) Dec 31, 2023 (common of other agenda agencies and 85% WG members trained) New: Land users adopting sustainable 0 (2008) 30,000 48,300 land mgt. practices as a result of the project New: Number of project communes implementing at least Appeared in one of the following Seq. 06 ISR nutrient reduction 0 (2009) 200 202 starting measures: communal March 2011 platoforms, pasture rehabilitation, tree planting (cumulative) New: Number of Appeared in technical staff (ANAR, Seq. 06 ISR EPA, Health 0 700 709 starting Directorates) trained March 2011 (cumulative) New: Reduction in number of farmers penalized by APIA for 50 30 14.47 non-compliance with Nitrate Directive (Percentage) Page 80 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Actual Original PAD Additional Financing value Restructuring 2012 Notes October 3, 2007 (2016) Dec 31, 2023 New: Increased number of groundwater quality Measured as monitoring sites and 7.50 (2015) 8 8.12 density per sample 1000km2 analysis for the Nitrate Directive New: Number of farmers trained by knowledge and training providers on 0 (2015) 6,000 6504 Code of Good Agricultural Practices (male/female disaggregated) 3000 New: Number of female farmers 2,400 trained by knowledge (updated and training 0 (2015) 2827 in ISR providers on Code of Seq.24 - Good Agricultural Dec Practices 2020) Percentage increase of rural population in project and non- Baseline and project areas aware No target not - - - n/a Component 3 of and initiating / change defined at implementing appraisal. actions related to nutrient reduction New: Number of meetings/public - 0 (2015) 100 250 consultations/worksh ops organized Page 81 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) Actual Original PAD Additional Financing value Restructuring 2012 Notes October 3, 2007 (2016) Dec 31, 2023 towards meeting project objectives New: Percentage of questions, comments or complaints relevant to the - 0 (2015) 100 100 project that are received and addressed within indicated 30 days New: Number of surveys conducted that collect feedback - 0 (2015) 3 3 and report back the results to the communities Component 4 Removed PMU fully from RF functional and No S S - - - n/a since Seq.06 operating change ISR in March effectively 2011 Continued strong Removed support from Inter- from RF No ministerial S S - - - n/a since Seq.06 change Committee for ISR in March project 2011 Page 82 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 8. REALLOCATION OF LOAN AND GRANT PROCEEDS DETAILS 1. Restructuring #1 (2012): Amount of the Loan Allocated % of Expenditures Category (Expressed in EUR) to be Financed Current Revised 1. Goods, Works, Consultants’ Services and Training under Part I of the Project 39,413,200.00 42,052,738.56 100% 2. Goods, Works, Consultants’ Services and Training under Part II of the Project 3,884,000.00 3,364,489.10 100% 3. Goods, Works, Consultants’ Services and Training under Part III of the Project 2,481,800.00 1,953,207.40 100% 4. Goods, Works, Consultants’ Services (including Audits), Incremental Operating 4,221,000.00 2,629,564.94 100% Costs under Part IV of the Project TOTAL 50,000,000.00 50,000,000.00 Amount of the Grant Allocated % of Expenditures Category (Expressed in USD) to be Financed Current Revised 1. Goods, Works, Consultants’ Services and Training under Part I of the Project 2,060,000.00 3,096,234.36 100% 2. Goods, Works, Consultants’ Services and Training under Part II of the Project 2,740,000.00 1,921,191.43 100% 3. Goods, Works, Consultants’ Services and Training under Part III of the Project 150,000.00 127,300.00 100% 4. Goods, Works, Consultants’ Services (including Audits), Incremental Operating 550,000.00 355,274.21 100% Costs under Part IV of the Project TOTAL 5,500,000.00 5,500,000.00 2. Restructuring #3 (2015): Disbursement % Allocation Ln/Cr/TF Currency Current Category of Expenditure (Type Total) Current Proposed Current Proposed IBRD- EUR IBRD48730 - G,W,CS,TR PART 1 42,052,738.56 40,509,031.66 100.00 100.00 48730 IBRD48730 - G,W,CS,TR PART 2 3,364,489.10 3,814,202.30 100.00 100.00 IBRD48730 - G,W,CS,TR PART 3 1,953,207.40 2,280,654.38 100.00 100.00 IBRD48730 - G,W,CS,AUD,IOC 2,629,564.94 3,396,111.66 100.00 100.00 PART 4 Total: 50,000,000.00 50,000,000.00 Page 83 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) TF- USD TF58040 - G,W,CS,TR PART 1 3,096,234.36 3,392,607.62 100.00 100.00 58040 TF58040 - G,W,CS,TR PART 2 1,921,191.43 1,624,818.17 100.00 100.00 TF58040 - G,W,CS,TR PART 3 127,300.00 196,493.22 100.00 100.00 TF58040 - G,W,CS,AUD,IOC PART 4 355,274.21 286,080.99 100.00 100.00 Designated Account 0.00 0.00 100.00 100.00 Total: 5,500,000.00 5,500,000.00 3. Restructuring #5 (2016): Disbursement % Ln/Cr/ Allocation Currency Current Category of Expenditure (Type Total) TF Current Proposed Current Proposed IBRD- IBRD48730 - G,W,CS,TR PART 1 until EUR 40,509,031.66 35,216,037.59 100.00 100.00 48730 November 15, 2016 IBRD48730 - G,W,CS,TR PART 2 until 3,814,202.30 2,947,333.71 100.00 100.00 November 15, 2016 IBRD48730 - G,W,CS,TR PART 3 until 2,280,654.38 1,923,791.00 100.00 100.00 November 15, 2016 IBRD48730 - G,W,CS,AUD,IOC PART 4 3,396,111.66 2,229,896.64 100.00 100.00 until November 15, 2016 Total: 50,000,000.00 50,000,000.00 IBRD- EUR G,W,non-CS,CS,TR,OC,PI-IV 48,000,000.00 48,000,000.00 100 100 85970 Total 48,000,000.00 48,000,000.00 TF- TF58040 - G,W,CS,TR PART 1 until USD 3,392,607.62 2,726,891.79 100.00 100.00 58040 November 15, 2016 TF58040 - G,W,CS,TR PART 2 until 1,624,818.17 1,624,818.17 100.00 100.00 November 15, 2016 TF58040 - G,W,CS,TR PART 3 until 196,493.22 150,383.05 100.00 100.00 November 15, 2016 TF58040 - G,W,CS,AUD,IOC PART 4 286,080.99 286,080.99 100.00 100.00 until November 15, 2016 G, W, CS (incl audits), TR, and IOCS under Parts I, II, III and IV from 0.00 711,826.00 100.00 100.00 November 16, 2016 Total: 5,500,000.00 5,500,000.00 Page 84 The World Bank GEF Romania Integrated Nutrient Pollution Control Project (P093775) ANNEX 9. LIST OF SUPPORTING DOCUMENTS • INPCP Project Appraisal Document (PAD), available at: https://documents.worldbank.org/en/publication/documents- reports/documentdetail/711521468093583902/romania-integrated-nutrient-pollution-control- project • Romania - Integrated Nutrient Pollution Control Project : Additional Financing; available at: https://documentsinternal.worldbank.org/search/26053878 • Disclosable versions of the Implementation Supervision Reports 1-24, available at: https://projects.worldbank.org/en/projects-operations/document-detail/P093775?type=projects • Restructuring Papers 2012-2023, available at: https://projects.worldbank.org/en/projects- operations/document-detail/P093775?type=projects • Loan Agreement L4873-RO, available at: https://documents.worldbank.org/en/publication/documents- reports/documentdetail/793171468296428210/loan-agreement-l4873-ro-conformed • Loan Agreement L8597-RO, available at: https://documents.worldbank.org/en/publication/documents- reports/documentdetail/243421468295003179/official-documents-loan-agreement-l8597-ro- closing-package • Interim INPCP ICR 2016, available at: https://documents.worldbank.org/en/publication/documents- reports/documentdetail/547971475869355403/romania-integrated-nutrient-pollution-control- project • INPCP Project Website: http://www.inpcp.ro/en/home/ • Romania - Country partnership framework for the period FY19-FY23 (CPF), available at: https://documents.worldbank.org/en/publication/documents- reports/documentdetail/954721529638270108/romania-country-partnership-framework-for-the- period-fy19-fy23 • Romania - Country partnership strategy for the period FY2014-2017, available at: https://documentos.bancomundial.org/es/publication/documents- reports/documentdetail/801961468095641262/romania-country-partnership-strategy-for-the- period-fy2014-2017 • Romania - Country partnership strategy progress report for the period FY2009-13, available at: http://documents.worldbank.org/curated/en/121741468105256304/Romania-Country-partnership- strategy-progress-report-for-the-period-FY2009-13 • Romania - Country Partnership Strategy, 2006; available at: https://documents.worldbank.org/en/publication/documents- reports/documentdetail/214631468093573490/romania-country-partnership-strategy Page 85