Document of The World Bank FOR OFFICIAL USE ONLY Report No: ICR00005160 IMPLEMENTATION COMPLETION AND RESULTS REPORT TF0A5680 ON A SMALL GRANT IN THE AMOUNT OF USD 0.5 MILLION TO THE Ministry of Science, Energy and Technology (Jamaica); Ministry of Public Utilities and Logistics (Belize); Ministry of Finance, Economic Development, Physical Development, Public Utilities and Energy (Grenada); Guyana Energy Agency (Guyana); Ministry of Natural Resources (Suriname) FOR Caribbean Energy Statistics Capacity Enhancement (P155034) June 30, 2021 Energy & Extractives Global Practice Latin America and Caribbean Region Regional Vice President: Carlos Felipe Jaramillo Country Director: Tahseen Sayed Khan Regional Director: Franz R. Drees-Gross Practice Manager: Stephanie Gil Task Team Leader(s): Anh Nguyet Pham, Koffi Ekouevi ABBREVIATIONS AND ACRONYMS BACI International Trade Database at the Product-Level CARICOM Caribbean Community and Common Market C-SERMS Caribbean Sustainable Energy Roadmap and Strategy GDP Gross Domestic Product IEA International Energy Agency IRES International Recommendations for Energy Statistics LAC Latin America and the Caribbean MESTPU Ministry of Energy, Science, and Technology and Public Utilities MW Megawatt M&E Monitoring and Evaluation OLADE Latin American Energy Organization PDO Project Development Objective sieBELIZE Energy Information System of Belize sieGRENADA Energy Information System of Grenada sieGUYANA Energy Information System of Guyana sieJAMAICA Energy Information System of Jamaica sieLAC Energy Information System of Latin America and the Caribbean sieSURINAME Energy Information System of Suriname TABLE OF CONTENTS DATA SHEET ....................................................................... ERROR! BOOKMARK NOT DEFINED. I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES ....................................................... 4 I. OUTCOME ...................................................................................................................... 7 II. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME ................................ 11 III. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME .. 12 IV. LESSONS LEARNED AND RECOMMENDATIONS .............................................................. 13 ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS ........................................................... 14 ANNEX 2. PROJECT COST BY COMPONENT ........................................................................... 19 ANNEX 3. RECIPIENT, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS ...... 20 ANNEX 4. COUNTRY CONTEXT ............................................................................................. 21 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) DATA SHEET BASIC INFORMATION Product Information Project ID Project Name P155034 Caribbean Energy Statistics Capacity Enhancement Country Financing Instrument Caribbean Investment Project Financing Original EA Category Revised EA Category Organizations Borrower Implementing Agency Ministry of Science, Technology, Energy and Mining (Jamaica), Ministry of Energy, Science and Technology, and Public Utilities (MESTPU-Belize), Ministry of Infrastructure Development, Public Utilities, Energy, OLADE - Latin American Energy Association Transport and Implemen. (Grenada), Guyana Energy Agency, Ministry of Natural Resources and Environment (Suriname) Project Development Objective (PDO) Original PDO The PDO is to enhance energy statistics and planning capacity within five Caribbean client countries: Belize, Grenada, Guyana, Jamaica and Suriname. Page 1 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) FINANCING FINANCE_TBL Original Amount (US$) Revised Amount (US$) Actual Disbursed (US$) Donor Financing TF-A5680 500,000 493,324 493,324 Total 500,000 493,324 493,324 Total Project Cost 500,000 493,324 493,324 KEY DATES Approval Effectiveness Original Closing Actual Closing 21-Sep-2017 07-Nov-2017 16-Sep-2019 31-Dec-2020 RESTRUCTURING AND/OR ADDITIONAL FINANCING Date(s) Amount Disbursed (US$M) Key Revisions 13-Jun-2019 0.25 Change in Results Framework Change in Loan Closing Date(s) Change in Implementation Schedule 07-May-2020 0.50 Change in Loan Closing Date(s) Change in Implementation Schedule KEY RATINGS Outcome Bank Performance M&E Quality Satisfactory Satisfactory High RATINGS OF PROJECT PERFORMANCE IN ISRs Actual No. Date ISR Archived DO Rating IP Rating Disbursements (US$M) 01 28-Mar-2018 Satisfactory Satisfactory 0.05 02 28-Mar-2019 Moderately Satisfactory Moderately Satisfactory 0.22 Page 2 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) 03 11-Jun-2020 Satisfactory Satisfactory 0.50 ADM STAFF Role At Approval At ICR Regional Vice President: Jorge Familiar Calderon Carlos Felipe Jaramillo Country Director: Tahseen Sayed Khan Tahseen Sayed Khan Director: Riccardo Puliti Franz R. Drees-Gross Antonio Alexandre Rodrigues Practice Manager: Stephanie Gil Barbalho Mark Stephen Lambrides, Anh Nguyet Pham, Koffi Task Team Leader(s): Elisabeth Maier Ekouevi ICR Contributing Author: Anh Nguyet Pham Page 3 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES Context A. Context 1. Access to cost-effective, reliable energy is a major challenge and impediment to competitiveness for many Caribbean island states. The region suffers from a near-total dependence on imported petroleum products, inadequate energy governance and regulatory structures, and outdated generation facilities and transmission networks, leading to a vicious cycle that discourages investment in the region. The result is expensive, unreliable, and carbon-intensive electricity. The high cost of fuel diverts hard currency away from economic development, reduces competitiveness across almost all economic sectors, and renders the energy sector vulnerable to supply shocks. 2. However, the region has access to an abundance of renewable and other sustainable energy resources. These alternatives have the potential to diversify the energy matrix, reducing the region’s dependence on imported petroleum products, while enhancing reliability and even lowering electricity costs in the long run. Achieving the appropriate balance of base-load renewables, including geothermal energy, and variable sources, such as solar and wind power, would be critical to meet future demand and rising electricity tariffs throughout the region. When judiciously combined with measures to enhance energy efficiency, greater use of multiple clean energy alternatives could provide a stable and lower-cost solution that would boost the region competitiveness and reduce the vulnerability to high and volatile fuel prices. However, integration of sustainable energy solutions would also present both challenges and opportunities. To take advantage of these alternatives, numerous market adjustments would be critical, including policy and regulatory reforms, aggregation of small energy markets, strengthening the capacity of key energy stakeholders, including on energy statistics, planning, elaborating energy balances, and monitoring energy indicators.. While energy data and statistics existed, there was no energy information system in place nor a functioning team with the energy statistical capacity to manage an energy information system 3. The Caribbean countries in overall had very limited energy statistical capacity. While energy data and statistics existed, there was no energy information system in place nor a functioning team with the energy statistical capacity to manage an energy information system. The Project was designed to provide critical support to five countries, Belize, Grenada, Guyana, Jamaica, and Suriname in their efforts to harmonize energy data, with a focus on energy statistics capacity and management. The rationale for selecting these five countries was that these countries were the only members of OLADE in the Caribbean at that time. Thus, it was decided together with OLADE to begin the Project with its five member countries in the region before eventually expanding and scaling-up the services to non-member countries. The context or each Project country at appraisal is provided in Annex 4. B. Higher Level Objectives to which the Project Contributes 4. The Project was aligned with the World Bank priorities for small developing states in terms of capacity strengthening on key data administration and infrastructure sector planning. It was also consistent with the World Bank-led Caribbean Energy Infrastructure Facility initiative. Page 4 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) 5. The Project was also aligned with the 2013 paper ‘Toward a Sustainable Energy Future for All: Directions for the World Bank Group’s Energy Sector’ supporting the creation of an enabling environment in terms of energy planning, promoting regional integration, and strengthening energy institutions. The Project also contributed to the World Bank’s twin goals of eliminating extreme poverty and boosting shared prosperity by supporting the five target countries in having better energy data and statics capacities, which would indirectly lead to an improved enabling environment for energy and private sector investments leading to improved socioeconomic development. 6. The Project would provide critical support to five countries (Belize, Grenada, Guyana, Jamaica, and Suriname) in their efforts to harmonize energy data, with a focus on energy statistics capacity and management. Resources would be deployed through OLADE, which would provide political and technical support to its member states toward regional and sub-regional energy integration. This would be in line with Caribbean Community and Common Market’s (CARICOM) commitment to engage with OLADE’s Regional Energy Information System sieLAC, which together with its national applications, has a high potential for contributing to the key pillars of the C-SERMS platform. Project Development Objectives (PDOs) 7. The PDO is to enhance energy statistics planning and management capacity within five Caribbean countries: Belize, Grenada, Guyana, Jamaica, and Suriname. Project Beneficiaries 8. OLADE was the recipient of the grant, and the staff of the energy ministries in Belize, Grenada, Guyana, Jamaica, and Suriname were the direct Project beneficiaries. The enhanced energy statistics capacity enhancement Project would indirectly benefit the national statistics agencies and all the stakeholders of the energy sector in the targeted countries, including the private sector. The private sector would benefit from an enhanced energy data quality and availability, and more skilled counterparts. Line ministers and public institutions would reap the benefits of accessible energy data for decision-making and planning purposes. The capacity enhancement program was predominantly dedicated to the staff of the Statistics, Data and Planning Departments within the Ministries of Energy. In addition, key experts in the Ministry of Planning and/or Finance would also benefit from the capacity-building program. All targeted staff were selected to receive training, and the knowledge acquired tested through theoretical and practical examinations/surveys. Key Expected Outcomes and Outcome Indicators 9. The PDO level results indicators are the following: (a) Number of people trained on energy statistics management/planning (of which are women); (b) Enabled National Energy Information Systems; (c) Number of National Energy Information and Planning Units able to produce energy data reports in target countries. Components Page 5 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) 10. The Project has three components: 11. Component 1: Analysis of energy structure and institutional and regulatory framework (estimated cost US$120,000; actual cost US$90,000). This component was to support the analysis of the target countries’ energy mix and their energy statistical, institutional, and regulatory framework, providing a preliminary energy flow and stakeholder mapping per country. 12. Component 2: Strengthening energy statistics system and capacity (estimated cost US$340,000; actual costs US$370,000). This component was to support the development of a specific methodology, including software and hardware, to gather information and manage energy data for each country. The final output to be financed under this component was the official launch and dissemination of a guide focused on good practices for energy statistics management, energy balance elaboration, and systems implementation. 13. Component 3: Project management and Monitoring and Evaluation (M&E) (estimated costs US$40,000; actual costs US$30,000). This component was to finance the incremental costs associated with the implementation of the Project activities. Significant Changes During Implementation 14. The Project was restructured in June 2019 and May 2020. The first restructuring, approved on June 13, 2019, was to extend the closing date of the Project for eight months from September 16, 2019 to May 31, 2020 and updated the target end dates of all indicators with the new closing date. The restructuring, requested by OLADE on May 22, 2019, followed recommendations from the Project Mid-Term Review, which was carried out in January-February 2019. The extension was to provide additional time to complete the Project activities under Component 2, which were behind the original schedule due to (I) initial effectiveness delays; (ii) inadequate staff in some beneficial countries in charge of the Project activities; and (iii) the inclusion of a harmonized methodology for Energy Balances with other international energy agencies. During Project implementation, OLADE launched a harmonization process between its original methodology for Energy Balances and the International Recommendations for Energy Statistics (IRE) Methodology. It was decided to include this new harmonized methodology in the Project, which became the basis for the definition of each energy matrix in each system. 15. The second restructuring, approved in May 12, 2020 at the request of OLADE dated May 4, 2020, extended the Project closing date, from May 31, 2020 to December 31, 2020. The extension was needed to complete all pending Project activities under Component 2 which had been temporarily put on hold due to the COVID-19 pandemic and related travel restrictions and lockdowns. Page 6 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) I. OUTCOME Assessment of Achievement of Each Objective/Outcome 16. The Project contributed to the enhancing the energy statistics planning and management capacity in five countries of Belize, Grenada, Guyana, Jamaica and Suriname to a satisfactory extent. Five National Energy Information Systems (NEIS) supported by the Project have been enabled and functional, and the capacity of key staff of these units have been improved through the training programs under the Project dedicated to them. Further, the National Energy Information and Planning Units within the Ministry of Energy in each of the five countries have been able to produce energy data reports for their countries using the NEIS. The performance of the PDO level result indicators and intermediate indicators is provided below. 17. Indicator One: Number of people trained on energy statistics management/planning (of which are women): Exceeded. Based on the surveys made during the different workshops held during the Project, the total number of staff trained on energy statistics management and planning is 103, of which 36 are women (accounting for 35%), exceeding the target of 75 people. It worths noting that the targets have been surpassed on an annual basis as indicated in the table below. Number of people trained on energy statistics management/planning (of which women) Baseline Cumulative Target Values Cumulative Results Unit of Measure YR 1 YR 2 YR 3 YR 1 YR 2 YR 3 Number 0 50 75 — 76 92 103 (36) 18. Indicator Two: National Energy Information Systems in all five countries are enabled: Fully Achieved. This indicator measured the functioning of the hardware and MIS software of the National Energy Information systems financed by the Project in the beneficiary countries. 19. An analysis of each country energy structure, institutional and regulatory framework was undertaken to establish the foundation for the NEIS. Then, the methodological harmonization of Energy Balances for the countries with the International Recommendations for Energy Statistic (IRES) was finalized in 2019. OLADE improved its methodology for constructing Energy Balances during the project implementation to harmonize with the global standards following the IRES and IEA recommendations, in order to optimize the dissemination of relevant data, promoting the availability of comparable regional and global energy statistics aligned with other International Organizations. Therefore, the indicator definition was updated involving in a renew process of analyzing the energy structure in each country based on the new methodology. 20. A based version of the system with the harmonized methodology- a “sieCOUNTRY� has been developed, which integrates the energy balance OLADE-IRES along with other themes such as supply demand, infrastructure, prices, reporting tools and indicators. A methodology for gathering information and managing energy data for each country was also developed and training was provided to the relevant staffs in each country. After having the Development and Production Environment and Backup Environment setup, each of the energy information system were generated from the base version. The configuration of each portal was done, and testing of each system was completed. There was a delay in meeting this Page 7 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) indicator as indicated in the table below due to the additional time needed for harmonization of methodology (as mentioned in more details in the following paragraph) before proceeding with procurement of information systems and slow mobilization of focal point staff in some countries. The links to the national information system of each country are provided below. (a) sieBELIZE http://sieBELIZE.olade.org (b) sieGRENADA http://sieGRENADA.olade.org (c) sieGUYANA http://sieGUYANA.olade.org (d) sieJAMAICA http://sieJAMAICA.olade.org (e) sieSURINAME http://sieSURINAME.olade.org Number of Enabled National Energy Information Systems Cumulative Target Values Cumulative Results Unit of Measure Baseline YR 1 YR 2 YR 3 YR 1 YR 2 YR 3 Number 0 3 5 — 0 1 5 21. Indicator Three: Number of National Energy Information and Planning Units able to produce energy data reports in target countries: Fully Achieved. This indicator measured the ability to produce energy reports based on the NIES and training financed by the Project. 22. Based on the analysis of the Energy Structure of each beneficiary country, and the Capacity Building in Energy Balance given to the staff of each ministry as mentioned above, an energy balance tool was designed for each energy unit. The tools were used according to the energy flows of each country by the focal points and energy officers in charge, with the guidance of OLADE’s energy consultants. The methodology and formats for collection of necessary data were provided and trained to enable gathering of data. The reports of Energy Balance in physical and energy units have been validated. The following units are able to produce energy data reports: (a) Energy Unit at the Ministry of Public Utilities and Logistics in Belize (b) Energy Division at the Ministry of Finance, Economic Development, Physical Development, Public Utilities and Energy in Grenada (c) Energy Unit at the Guyana Energy Agency in Guyana (d) Energy Division at the Ministry of Science, Energy and Technology in Jamaica (e) Energy Division at the Ministry of Natural Resources in Suriname Page 8 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) Number of NEIS Planning Units able to produce energy data reports in target countries Baseline Cumulative Target Values Cumulative Results Unit of Measure YR 1 YR 2 YR 3 YR 1 YR 2 YR 3 Number 0 3 5 — 0 1 5 Intermediate Results 23. Intermediate Results Indicator One: Fully Achieved. Analysis of institutional and regulatory framework of the energy sector completed: Fully Achieved Baseline Cumulative Target Values Cumulative Results Unit of Measure YR 1 YR 2 YR 3 YR 1 YR 2 YR 3 Text No Yes Yes — Yes Yes Yes 24. Intermediate Results Indicator Two:. Energy forecast study completed. – the forecast studies for each beneficiary country are completed. Achieved. Baseline Cumulative Target Values Cumulative Results Unit of Measure YR 1 YR 2 YR 3 YR 1 YR 2 YR 3 Text No Yes Yes — No No Yes 25. Intermediate Results Indicator Three: The Grievances Mechanism was established and functional. Grievances registered related to delivery of Project benefits addressed (percent). – no Grievances have been registered so far. Achieved Baseline Cumulative Target Values Cumulative Results Unit of Measure YR 1 YR 2 YR 3 YR 1 YR 2 YR 3 Percentage 0 0 0 — 0 0 0 Overall Outcome Rating 26. The overall outcome rating is Satisfactory. The Project delivered critical support to five countries (Belize, Grenada, Guyana Jamaica and Suriname) to build their capacity to plan and manage energy statistics. The Project supported the countries to harmonize energy data, completed the analysis of the countries’ energy mix and their energy statistical, institutional, and regulatory framework, based on which a preliminary energy flow and stakeholder mapping per country and other contents was developed for launching the National Energy Page 9 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) Information Systems online. The Project also supported the development of a specific methodology, including software and hardware, which were purchased and established for each country, to gather information and manage energy data for continuous validating and updating of the information systems. Regional trainings and workshops were fully implemented to enhance statistical and planning skills, disseminate results, and create a platform to exchange experiences among the participants from the target countries. Other Outcomes and Impacts 27. The Project increased awareness among decision makers and stakeholders regarding planning and management of NEIS in the target countries. Stakeholders from the energy sector were engaged and were part of the training on energy statistics, where their role and the interaction among all parties towards the policy, decision-making and planning process were discussed. 28. The Project implementation also resulted in a deeper analysis of the energy sector of each of five beneficiary countries, and in the elaboration of manuals including energy statistics management and best practices. These are beneficial for the energy sector development in the five target countries and for other developing countries in Latin America and the Caribbean (LAC) and beyond. The following products were generated: 29. Survey on Good Practices for Energy Statistics Management: This product collects information on the status of adoption of common procedures around good statistical management in the energy sector of the countries of LAC. The survey analysis was elaborated based on the responses of the countries of the region. It covers the institutional and legal frameworks for energy statistics management, the scope and depth of data collection, and its links with other topics related to energy, the human capital of the organizations in charge of energy statistics. It also covers the internal processes handled at the national level starting from the collection, processing and analysis of information to the dissemination of energy statistics. 30. Manual for Energy Statistics Management: This product compiles the best practices of energy information management, provides guidelines regarding the necessary legal and institutional framework for correct energy statistics management, the functionality and organization of energy statistics agencies with respect to their role of providing timely information and the relevance of the users of information, recommendations on data collection procedures, quality management of energy statistics and the dissemination of information. 31. Report on Energy trade in Latin America and the Caribbean: The report presents an analysis on energy trade in the countries of LAC using the data from the BACI Database (International Trade Database at the Product-Level). 32. API Comtrade Database Implementation: This product constitutes an add-on to the NIES. It extracts data from the BACI Database and creates a tailored database with filter series of trade flows of energy products between member countries. 33. Installed Capacity of Renewable Energy: This study comprises an analysis of the situation in the Caribbean countries in relation to renewable energies, barriers to their deployment, the possible alternatives to overcome them, and emerging opportunities. The scope of the study is restricted to the electricity sector, Page 10 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) including the less conventional sources and the hydraulic ones, with greater emphasis on generation connected to the national electricity grid. The report includes the study methodology, main characteristics of the countries linked to renewable energies and main general findings of the study, barriers that would be hindering the introduction of renewable generation and the possible ways to mitigate them, presenting in more detail the opportunities detected. 34. Energy Barometer 2020 - The Challenges of the Energy Sector in the Post-Pandemic: This product analyzes the consequences of the COVID-19 health crisis in the energy sector of LAC, which has generated a series of important changes in the way of life, a significant reduction in energy consumption, and the reduction of working hours in the industrial and commercial sectors. A survey was prepared on the relationships of the pandemic with climate change in the energy sector, energy supply, impact on the energy matrix, changes in the policy to increase renewable energy, the energy transition using new technologies, obstacles to the energy transition, the use of natural gas, the incorporation of electric mobility, and the impact of the crisis on energy prices. II. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME 35. The Project faced an effectiveness delay. The Project Operations Manual was approved on November 1, 2017, the Project was declared effective by the bank on November 7, 2017, and the first disbursement became effective in the designated account on January 26, 2018. This caused a delay in the execution of activities of around four months due to the unavailability of funds. 36. The new harmonized Methodology for Energy Balances and the IRES Methodology and review by the International Energy Agency was added during implementation. This served to build the capacity of beneficiaries in the elaboration of energy balances with a new methodology, and to enhance their knowledge in energy statistics management in oil and oil products, natural gas, coal and coal products, electricity & heat, renewable and infrastructure. Also, the Energy Information Systems included this new methodology, making the beneficiary countries the first member countries with a system with the latest methodology. On the other hand, the process required additional efforts and time, leading to a longer implementation period for the Project activities than originally planned. 37. Overall, the countries have demonstrated commitment and ownership of the Project. However, the level of engagement and responsiveness varied among the countries, especially during the early stage of the Project. For example, it took longer for Grenada to set up a responsible unit for the Project and the engagement stalled for some time following staffing changes after elections. 38. The institutional framework for this Project was robust for managing a regional Project involving more than one country, thanks to the strong performance of OLADE. As the Project implementing agency, OLADE was responsible for managing, coordinating and implementing all component activities and provided necessary support to the five beneficiary countries, which are each represented by Energy Focal Points within the respective Ministries. 39. There were also initial delays in the data gathering process. The lack of personnel in each ministry, the high rotation of authorities in these entities, and the COVID-19 situation originally delayed the collection of data to be registered in each NEIS along the different dimensions established. To overcome the issue, OLADE was very Page 11 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) proactive in engaging closely with the country beneficiaries and providing additional support with five short-term consultants to the focal points for the required data collection work. As a result, key information was collected, analyzed and validated in each system and the energy balance reports are compiled as required. 40. Due to the COVID-19 pandemic and given the limited mobilities and social distancing policies, activities related to training and workshops had to be postponed to a later stage and changed to a virtual modality. However, trainings were successfully delivered to the participants and the targets were accomplished. III. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME 41. The Bank performance on this Project is assessed as Satisfactory. The original implementation time of two years was slightly ambitious given the number of countries involved and weak institutional capacity in some countries. However, the institutional arrangement, coordination with project stakeholders, and communication flows were found adequate and the decision-making process was effective. Light handed supervision by the Bank team worked well with strong implementation performance of OLADE. Any changes in the implementation of the Project were analyzed and approved by both the Project Coordinator at OLADE and the Bank TTL. A Mid Term Review mission was undertaken in January-February 2019. 42. Overall quality of M&E is assessed as High. The M&E design was Satisfactory. The PDO indicators were robust and measurable. The description of the intermediate indicator regarding the Grievance Redress Mechanism could have been slightly clearer although the result was met. The Project had a robust M&E mechanism in place. OLADE had a dedicated staff responsible for Project management and M&E activities. The Project Manager was collecting and sharing data on a continuous basis. Focal points provided data and information to the Project Manager, and monthly meetings are held between the OLADE team and OLADE’s Executive Secretary to update on Project implementation. On M&E data utilization, the Project Coordinator, with inputs from the technical team took necessary adjustments in implementation support to countries based on M&E data and feedback from the country focal points. OLADE submitted to the Bank timely and quality Project progress reports in full compliance with the Project requirements. 43. Procurement performance was satisfactory. Procurement processes have followed World Bank policies. Allocation and use of resources have been done in an effective manner. Progress reports were prepared and submitted to the Bank in due time. 44. The Project did not trigger any of the Bank’s environmental or social safeguards. 45. The Project complied with all legal requirements, including timely progress and financial reporting. An Operational Project Manual was also prepared in due time and adopted by OLADE. 46. The main risk to development outcomes is related to maintaining operation and quality of information that is to be provided to the countries’ energy information systems. The risk is due to the high rotation of staff in the responsible energy units of the ministries, which requires training in energy balance on a regular basis Page 12 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) IV. LESSONS LEARNED AND RECOMMENDATIONS 47. The Project has demonstrated the importance of having an energy information system tailored to the country’s energy matrix and its requirements. This platform has provided each Energy Unit with a tool that supports decision-making, formulation and evaluation of policies, and energy planning. Also, the use of the platform in each country has strengthened the ministries’ management, storage and processing capacities of the statistical, legal and documentary information of the energy sector. 48. The Project has increased awareness of energy statistics and information system among decision makers and stakeholders in the target countries, which would have positive impacts on sustainability of the system planning and management. Stakeholders from the energy sector were engaged and invited to attend the training on energy statistics, where their role and the interaction among all parties towards the policy, decision-making and planning process has been discussed. The implementation of the Project also confirmed the importance of an adequate management of energy statistics, which helps to enhance the quality and analytical value of the energy information in the LAC region, and to produce reliable and internationally comparable data. 49. For sustainability, a follow up with each country is recommended to validate the quality of the information to be uploaded in each energy information system. Follow up training in energy balance is needed given the high rotation of staff in each energy unit of the ministries observed during the Project implementation. . Page 13 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS A. RESULTS INDICATORS A.1 PDO Indicators Objective/Outcome: Energy Statistic Planning and Management Capacity is enhanced in Belize, Grenada, Guyana, Jamaica and Suriname Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of people trained on Number 0.00 75.00 75.00 103.00 energy statistics management/planning (of 01-Jul-2017 01-Jul-2017 16-Sep-2019 31-Dec-2020 which are women) Comments (achievements against targets): Fully Achieved. Based on the surveys made during the different workshops held during the project, the total number of staff trained on energy statistics management and planning is 103 in which 36 are women (accounting for 35%), exceeding the target of 75 people. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Enabled National Energy Number 0.00 5.00 5.00 5.00 Information Systems 01-Jul-2017 01-Jul-2017 16-Sep-2019 31-Dec-2020 Page 14 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) Comments (achievements against targets): Fully Achieved. This indicator also covers the configuration and functioning of the hardware and MIS software that enable the operation of the National Energy Information systems in the beneficiary countries. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Number of National Energy Number 0.00 5.00 5.00 5.00 Information and Planning Units able to produce energy data 01-Jul-2017 01-Jul-2017 16-Sep-2019 31-Jan-2019 reports in target countries Comments (achievements against targets): Fully Achieved. Based on the analysis of the Energy Structure of each beneficiary country, and the Capacity Building in Energy Balance given to the staff of each ministry as mentioned above, an energy balance tool was designed for each energy unit. The tools were used according to the energy flows of each country by the focal points and energy officers in charge, with the guidance of OLADE’s energy consultants. The methodology and formats for collection of necessary data were provided and trained to enable gathering of data. The reports of Energy Balance in physical and energy units have been validated. The following units are able to produce energy data reports: (a) Energy Unit at the Ministry of Public Utilities and Logistics in Belize (b) Energy Division at the Ministry of Finance, Economic Development, Physical Development, Public Utilities and Energy in Grenada (c) Energy Unit at the Guyana Energy Agency in Guyana (d) Energy Division at the Ministry of Science, Energy and Technology in Jamaica (e) Energy Division at the Ministry of Natural Resources in Suriname A.2 Intermediate Results Indicators Component: Analysis of Energy Structure and Institutional and Regulatory Framework Indicator Name Unit of Baseline Original Target Formally Revised Actual Achieved at Page 15 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) Measure Target Completion Analysis of energy institutional Yes/No N Y Y Y and regulatory framework completed 01-Jul-2017 01-Jul-2017 16-Sep-2019 31-Dec-2020 Comments (achievements against targets): Component: Strengthen Energy Statistic System and Capacity Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Energy forecast study Yes/No N N Y Y completed 01-Jul-2017 01-Jul-2017 16-Sep-2019 31-Dec-2020 Comments (achievements against targets): Component: Project Management and M&E Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Grievances registered related Percentage 0.00 0.00 0.00 0.00 to delivery of project benefits addressed (%) 01-Jul-2017 01-Jul-2017 16-Sep-2019 31-Dec-2020 Page 16 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) Comments (achievements against targets): Page 17 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) B. ORGANIZATION OF THE ASSESSMENT OF THE PDO Objective/Outcome 1 The PDO is to enhance the energy statistics and planning capacity within five Caribbean client countries: Belize, Grenada, Guyana, Jamaica, and Suriname. 1. Number of people trained on energy statistics management/planning (of which are women) Outcome Indicators 2. Enabled National Energy Information Systems 3. Number of National Energy Information and Planning Units able to produce energy data reports in target countries 1. Analysis of energy institutional and regulatory framework completed Intermediate Results Indicators 2. Energy forecast study completed 3. Grievances registered related to delivery of Project benefits addressed (percent) 1. Component 1: Stakeholders Mapping & Energy Flows 2. Component 1: Capacity Building in Human Resources Management, Energy Statistics & Planning 3. Component 2: Capacity Building in: Energy Balance Methodology Key Outputs by Component OLADE-IRES-IEA, International Recommendations for Energy Statistics, (linked to the achievement of the Objective/Outcome 1) Energy Prospective 4. Component 2: http://sieBELIZE.olade.org; http://sieGRENADA.olade.org; http://sieGUYANA.olade.org; http://sieJAMAICA.olade.org; http://sieSURINAME.olade.org 5. Component 2: Energy Forecast Study Page 18 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) . ANNEX 2. PROJECT COST BY COMPONENT Amount at Approval Actual at Project Percentage of Approval Components (US$M) Closing (US$M) (US$M) Analysis of energy structure and institutional and .12 .09 77% regulatory framework Strengthening energy .34 .37 110% statistics system and capacity Project management and .04 .03 69% M&E Total 0.50 0.49 99% Page 19 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) ANNEX 3. RECIPIENT, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS The implementing agency provided their Project Completion Report and it was used to prepare the ICR. Following are the links to the supporting documents. Annex 01 Stakeholders mapping and Energy flows Annex 02 Energy Forecast Study Annex 03 Results Framework Annex 04 Manual for Energy Statistics Management Annex 05 Statement of Sources and Uses Annex 06 Statement of Cumulative Link to the shared folder: https://nubeolade.olade.org/index.php/s/6kibMyFtAeXW7Eq Link to the video of the project (includes stakeholder’s feedback): https://youtu.be/0jzEwtSo1i4 Page 20 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) ANNEX 4. COUNTRY CONTEXT 50. Five Caribbean countries were selected for this Project: Belize, Grenada, Guyana, Jamaica and Suriname. The institutions that act as the focal point were the corresponding Energy Ministries in each country. 51. Belize has indigenous non-renewable and renewable primary energy sources. In 2005, petroleum reserves of 18.73 Mbbl were discovered. Belize Natural Energy Ltd. had its petroleum extraction operation in the northern part of Cayo District and had made some small efforts in refining to produce diesel in the past. Since 2006, most of the petroleum extracted in Belize was exported for refinement and consumption elsewhere. The major energy consumption was done in the transportation sector in the form of gasoline and other petroleum products, which are generally imported. 52. The contribution of renewable sources was very significant for electricity production, which relied mainly on hydroelectric dams and biomass. Hydroelectric dams built between 2007 and 2010, such as Hydro Maya, Vaca, Chalillo, and Morejon account for a total installed capacity of 53 MW. Also, since 2009, the sugar industries’ subsidiary had been using bagasse for power generation in a total installed capacity of 32 MW. The remaining electricity required to meet the demand had been purchased from the Comisión Federal de Electricidad of Mexico since 1983. In 2012, the Ministry of Energy, Science, and Technology and Public Utilities (MESTPU) was envisioned to strategically integrate energy, science, and technology into national development planning and decision making and improve policy and regulatory framework for public utilities to enhance service delivery and oversees the electricity and oil and gas sectors in Belize but had limited capacities at its Energy Division. 53. Grenada was devastated by Hurricane Ivan in 2004, and over the following few years, the country struggled to rebuild its decimated housing stock and to recover from the severe damage inflicted on its extensive nutmeg plantations and tourism sector. The energy sector, in particular electricity, was a key contributor to economic activity and was essential for businesses and households. About 99 percent of the electricity was generated by imported fossil fuels. The energy sector was particularly vulnerable to external shocks due to the small size of electricity systems and the almost complete reliance on imported fossil fuels from countries in the region. This dependence was a major impediment to economic development as the resulting high and volatile electricity costs reduce the competitiveness of businesses, such as tourism, increase the burden of electricity bills on vulnerable households, and contribute to macroeconomic instability. 54. Guyana is a small, sparsely populated developing country in South America. Guyana has its fame due to the hydropower potential of its falls, of 7,000 MW. Such hydropower potential had not been exploited due to the long distance between the urban area and its water sources. Such distance made it very costly to build an appropriate transmission infrastructure to satisfy the low consumption of the small population. Instead of that, fossil fuels supply the power plants, increasing the oil dependence of the country in the last four decades. Along these years, Guyana had been importing most of its hydrocarbons from Trinidad and Tobago, Suriname, and Venezuela, with an increase of imports from the latter due to the PetroCaribe Alliance. Guyana was promoting energy efficiency and the use of renewable energy sources by the deployment of projects involving photovoltaic systems, bioenergy production, wind energy, and hybrid systems to reduce the dependence on traditional fossil fuels. Page 21 of 22 The World Bank Caribbean Energy Statistics Capacity Enhancement (P155034) 55. Jamaica had a growing demand for fossil fuels as well as reliance on hydrocarbon imports, which met around 91 percent of the country’s energy needs. In 1979, the Petroleum Corporation of Jamaica was created under the Ministry of Science, Technology, Energy and Mining with the exclusive rights to explore oil for the development of Jamaica's petroleum resources, negotiation of import contracts, refining , transportation, and sale of petroleum and petroleum products. In 1982, the Government purchased the Kingston Refinery from Esso to supply refined products in Jamaica and renamed it Petrojam. Since 1983, crude oil had been supplied to the refinery by agreements with Venezuela and Mexico. Electricity generation had relied upon imported fuel oil and diesel for the last 40 years. It is worth mentioning that Jamaica had been a signatory of the PetroCaribe Alliance. To address such reliance, the share of renewables in the energy matrix was increasing from sources such as wind, hydro, firewood, bagasse, solar, and ethanol. Since 2011, new wind turbines were installed by the Jamaica Public Service Company and independent power producers. Total wind installed capacity for electricity generation had been raised to 41.7 MW. 56. Suriname’s economy was highly concentrated in the extractive industries (gold, oil, and bauxite), which played a dominant role in driving growth, employment, and Government revenues. Extraction, processing, and trading of gold, oil, and (to a lesser extent) bauxite directly accounted for about 30 percent of GDP and over 90 percent of exports[1]. Mining and quarrying have been key sources of employment, accounting for 24.4 percent of total employment in 2010, up from just 2.8 percent in 2003. Moreover, the services sector, which made up about 50 percent of GDP and was dominated by trade and transport activities, was also closely linked to developments in the extractive industry. About 10 percent of Government revenues was directly linked to gold production in the form of corporate income taxes, royalties, and dividends, especially from the Rosebel gold mine. Small-scale gold mining sector activities, through secondary spending, added further to the economic impact of the gold sector. Agriculture was also important in the economy, accounting for about 10 percent of GDP, 10 percent of exports, and employing over 17 percent of the labor force. The sector had experienced a recovery in recent years (following a long decline) but growth was below regional averages. There was also a significant informal sector, which, if accurately measured and taken into account, would likely increase current GDP estimates by about 15 percent to16 percent, according to the Bureau of Statistics. 57. Suriname's state-owned oil company, Staatsolie, started the development of the Tambaredjo oil field in 1982, having its first revenues of petroleum production recorded in 1983. In 1997, Staatsolie built the country’s sole refinery of 7,350 bbl per day to process the Saramacca crude oil. Since most of the refined oil products had been imported throughout the years, Suriname had started the construction of the new Staatsolie’s Refinery Expansion Project in 2012, which would double the current refining capacity. At the the time , there were some renewable energy projects being undertaken, such as the creation of the TapaJai hydropower plant, Staatsolie’s ethanol processing plant, and a self-producer bagasse-based power plant. Page 22 of 22