Document of The World Bank FOR OFFICIAL USE ONLY Report No: ICR00006016 IMPLEMENTATION COMPLETION AND RESULTS REPORT H884-WS ON A GRANT IN THE AMOUNT OF SDR 13.30 MILLION (US$20.00 MILLION EQUIVALENT) AND TF017563 ON A GRANT FROM THE PACIFIC REGION INFRASTRUCTURE FACILITY MULTI-DONOR TRUST FUND IN THE AMOUNT OF US$3.83 MILLION AND TF0A6371 ON A GRANT FROM THE AUSTRALIA-PACIFIC ISLAND PARTNERSHIP TRUST FUND IN THE AMOUNT OF US$5.88 MILLION TO THE INDEPENDENT STATE OF SAMOA FOR THE ENHANCED ROAD ACCESS PROJECT April 27, 2023 Transport Global Practice East Asia and Pacific Region CURRENCY EQUIVALENTS (Exchange Rate Effective, October 31, 2022) Currency Unit = Samoan Tala (WST) WST 2.79 = US$1 FISCAL YEAR July 1 - June 30 Regional Vice President: Manuela V. Ferro Country Director: Stephen N. Ndegwa Regional Director: Ranjit J. Lamech Practice Manager: Benedictus Eijbergen Task Team Leader(s): Sean David Michaels, Florentina-Alina Burlacu ICR Main Contributor: Naoki Kakuta ABBREVIATIONS AND ACRONYMS ACDMD Aid Coordination and Debt Management Division APIP Australia-Pacific Island Partnership ARAP Abbreviated Resettlement Action Plan CD Country Director CPS Country Partnership Strategy CRWCR Enhancing the Climate Resilience of the West Coast Road Project CTSSU Centralized Technical Services Support Unit DFAT Department of Foreign Affairs and Trade EIRR Economic Internal Rate of Return EMP Environmental Management Plan ERAP Enhanced Road Access Project ESMP Environmental and Social Management Plan FM Financial Management GCLS Grievance and Complaint Logging System GDP Gross Domestic Product GoA Government of Australia GoS Government of Samoa GRM Grievance Redress Mechanism ICR Implementation Completion and Results Report IDA International Development Association IFR Interim Financial Report ISR Implementation Status and Results Report LTA Land Transport Authority M&E Monitoring and Evaluation MNRE Ministry of Natural Resources and Environment MOF Ministry of Finance MWTI Ministry of Works, Transport, and Infrastructure NOLA Nuanua O Le Alofa NPV Net Present Value OHS Occupational Health and Safety PAD Project Appraisal Document PDO Project Development Objective PMC Project Management Company PMD Project Management Division PTRP Post Tsunami Reconstruction Project RPF Regional Partnership Framework PRIF Pacific Region Infrastructure Facility RVP Regional Vice President SARIP Samoa Aviation and Roads Investment Project SCRTP Samoa Climate Resilient Transport Project SIAM-1 Samoa Infrastructure Asset Management Program, Phase 1 SIAM-2 Samoa Infrastructure Asset Management Program, Phase 2 TCE Tropical Cyclone Evan TF Trust Fund TISCD Transport and Infrastructure Sector Coordination Division TTL Task Team Leader WCR West Coast Road TABLE OF CONTENTS DATA SHEET .......................................................................................................................... 1 I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES ....................................................... 6 A. CONTEXT AT APPRAISAL .........................................................................................................6 B. SIGNIFICANT CHANGES DURING IMPLEMENTATION (IF APPLICABLE) .......................................9 II. OUTCOME .................................................................................................................... 13 A. RELEVANCE OF PDOs ............................................................................................................ 13 B. ACHIEVEMENT OF PDOs (EFFICACY) ...................................................................................... 14 C. EFFICIENCY ........................................................................................................................... 19 D. JUSTIFICATION OF OVERALL OUTCOME RATING .................................................................... 20 E. OTHER OUTCOMES AND IMPACTS (IF ANY) ............................................................................ 20 III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME ................................ 22 A. KEY FACTORS DURING PREPARATION ................................................................................... 22 B. KEY FACTORS DURING IMPLEMENTATION ............................................................................. 23 IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME .. 26 A. QUALITY OF MONITORING AND EVALUATION (M&E) ............................................................ 26 B. ENVIRONMENTAL, SOCIAL, AND FIDUCIARY COMPLIANCE ..................................................... 28 C. BANK PERFORMANCE ........................................................................................................... 30 D. RISK TO DEVELOPMENT OUTCOME ....................................................................................... 31 V. LESSONS AND RECOMMENDATIONS ............................................................................. 31 ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS ........................................................... 33 ANNEX 2. BANK LENDING AND IMPLEMENTATION SUPPORT/SUPERVISION ......................... 39 ANNEX 3. PROJECT COST BY COMPONENT ........................................................................... 41 ANNEX 4. EFFICIENCY ANALYSIS ........................................................................................... 42 ANNEX 5. BORROWER, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS ... 44 ANNEX 6. SUPPORTING DOCUMENTS .................................................................................. 45 ANNEX 7. PROJECT MAP ...................................................................................................... 47 The World Bank Enhanced Road Access Project (P145545) DATA SHEET BASIC INFORMATION Product Information Project ID Project Name P145545 Enhanced Road Access Project Country Financing Instrument Samoa Investment Project Financing Original EA Category Revised EA Category Partial Assessment (B) Partial Assessment (B) Organizations Borrower Implementing Agency Samoa Land Transport Authority Project Development Objective (PDO) Original PDO To restore key road sector assets damaged by extreme weather events and enhance the climate resilience of critical roads and bridges in Samoa. Page 1 of 47 The World Bank Enhanced Road Access Project (P145545) FINANCING Original Amount (US$) Revised Amount (US$) Actual Disbursed (US$) World Bank Financing 20,000,000 20,000,000 18,041,617 IDA-H8840 6,346,000 3,756,108 3,756,108 TF-17563 5,879,008 5,873,371 5,873,371 TF-A6371 Total 32,225,008 29,629,479 27,671,096 Non-World Bank Financing 0 0 0 Borrower/Recipient 0 0 0 Total 0 0 0 Total Project Cost 32,225,008 29,629,479 27,671,096 KEY DATES Approval Effectiveness MTR Review Original Closing Actual Closing 17-Oct-2013 20-Feb-2014 08-Aug-2017 30-Apr-2019 31-Oct-2022 RESTRUCTURING AND/OR ADDITIONAL FINANCING Date(s) Amount Disbursed (US$M) Key Revisions 29-Feb-2016 5.35 Change in Results Framework Change in Components and Cost 31-May-2018 17.50 Additional Financing Change in Results Framework Change in Components and Cost Cancellation of Financing Reallocation between Disbursement Categories 25-Oct-2018 17.83 Change in Loan Closing Date(s) 22-Apr-2020 20.95 Change in Loan Closing Date(s) 20-Apr-2021 24.72 Change in Loan Closing Date(s) 27-Oct-2021 25.85 Change in Loan Closing Date(s) Page 2 of 47 The World Bank Enhanced Road Access Project (P145545) KEY RATINGS Outcome Bank Performance M&E Quality Moderately Satisfactory Satisfactory Modest RATINGS OF PROJECT PERFORMANCE IN ISRs Actual No. Date ISR Archived DO Rating IP Rating Disbursements (US$M) 01 09-Feb-2014 Satisfactory Satisfactory 0 02 22-Aug-2014 Satisfactory Moderately Satisfactory 1.00 03 16-Mar-2015 Satisfactory Moderately Satisfactory 1.10 04 21-Jul-2015 Satisfactory Moderately Satisfactory 1.10 05 23-Dec-2015 Satisfactory Moderately Satisfactory 4.08 06 29-Jun-2016 Satisfactory Moderately Satisfactory 7.56 07 05-Jan-2017 Satisfactory Moderately Satisfactory 11.07 08 23-Jun-2017 Satisfactory Moderately Satisfactory 14.79 09 30-Nov-2017 Satisfactory Moderately Satisfactory 16.25 10 09-May-2018 Moderately Satisfactory Moderately Satisfactory 17.46 11 18-Sep-2018 Moderately Satisfactory Moderately Satisfactory 17.83 12 22-Mar-2019 Moderately Satisfactory Moderately Satisfactory 18.97 13 23-Sep-2019 Moderately Satisfactory Moderately Satisfactory 19.50 14 29-Mar-2020 Moderately Satisfactory Moderately Satisfactory 20.95 15 25-Sep-2020 Moderately Satisfactory Moderately Satisfactory 22.93 16 21-May-2021 Moderately Satisfactory Moderately Satisfactory 24.72 17 02-Dec-2021 Moderately Satisfactory Moderately Satisfactory 25.85 18 25-May-2022 Moderately Satisfactory Moderately Satisfactory 26.33 19 31-Oct-2022 Satisfactory Moderately Satisfactory 27.20 Page 3 of 47 The World Bank Enhanced Road Access Project (P145545) SECTORS AND THEMES Sectors Major Sector/Sector (%) Transportation 100 Public Administration - Transportation 7 Rural and Inter-Urban Roads 93 Themes Major Theme/ Theme (Level 2)/ Theme (Level 3) (%) Finance 13 Finance for Development 13 Disaster Risk Finance 13 Urban and Rural Development 86 Rural Development 47 Rural Infrastructure and service delivery 47 Disaster Risk Management 39 Disaster Response and Recovery 13 Disaster Risk Reduction 13 Disaster Preparedness 13 Environment and Natural Resource Management 98 Climate change 98 Adaptation 98 ADM STAFF Role At Approval At ICR Regional Vice President: Axel van Trotsenburg Manuela V. Ferro Country Director: Franz R. Drees-Gross Stephen N. Ndegwa Director: John A. Roome Ranjit J. Lamech Practice Manager: Michel Kerf Benedictus Eijbergen Page 4 of 47 The World Bank Enhanced Road Access Project (P145545) Sean David Michaels, Task Team Leader(s): James A. Reichert Florentina-Alina Burlacu ICR Contributing Author: Naoki Kakuta Page 5 of 47 The World Bank Enhanced Road Access Project (P145545) I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES A. CONTEXT AT APPRAISAL Context 1. Samoa is a small and remote Pacific Island nation located approximately 3,000 km from New Zealand and 4,000 km from Hawaii and Australia. With a total land area of 2,935 km2, the country consists of the two large islands of Upolu and Savai’i, and eight smaller islands. At appraisal in 2013, Samoa was one of the wealthier and strong performing countries in the Pacific with its gross domestic product (GDP) US$4,038 per capita.1 In 2011, the country’s population was 187,820, of which 76 percent lived on Upolu and 24 percent lived on Savai’i.2 The country’s poverty rate, based on the national basic needs poverty line, was 13.4 percent of households and 18.8 percent of the population in 2013/2014.3 2. At appraisal, Samoa’s vulnerability to climate change and natural disasters was high and growing. The frequency and intensity of extreme weather and climate events (for example, heavy rainfall, strong winds, storm surges, and high sea levels) was on the rise throughout the region.4 These and other events, such as earthquakes and tsunamis, had severely damaged infrastructure and other economic assets, and adversely affected livelihoods. For example, the combination of Cyclone Ofa (1990) and Val (1991) caused 21 fatalities and widespread destruction, with total economic losses estimated as high as US$500 million,5 equivalent to four times the country’s GDP. Flooding has occurred regularly throughout Samoa’s history, particularly in built-up areas such as the capital Apia, which suffered numerous floods over the years. Samoa has also experienced high seismic activity, and on September 29, 2009, was hit by an earthquake- triggered tsunami. As a result, there were 143 reported deaths and nearly 5,300 people were affected, mainly on Upolu.6 3. The Enhanced Road Access Project (ERAP) was prepared as an emergency operation in response to the impact of Tropical Cyclone Evan (TCE), which struck Samoa on December 13 and 14, 2012. Over the two-day period, five people were killed and approximately 4,250 were temporarily displaced. The Government of Samoa (GoS)’s Damage and Loss Assessment of TCE estimated the combined physical and economic losses to transport infrastructure, houses, and tourism facilities at US$204 million, about 28 percent of the total value of goods and services produced in Samoa in 2011. Several key road sector assets were damaged, including Central Cross Island Road (a key economic artery between North and South Upolu) and Leone Bridge (which could no longer be used by vehicles and was one of two bridges capable of carrying heavy vehicles between Apia Port and the principal industrial area at Vaitele). 4. The Land Transport Authority (LTA) was established on July 1, 2009, to reform and consolidate road asset management and road use functions. Mandated by the LTA Act 2007, LTA is responsible for implementing sector policy and for planning, designing, constructing, maintaining, and supervising the country’s national roads and land transport infrastructure. It also oversees road use and is accountable for registering vehicles, issuing driver’s licenses, enforcing 1 World Bank. World Development Indicators. 2 GoS. Population and Housing Census 2011. Analytical Report. 3 GoS and United Nations Development Programme. 2016. Samoa Hardship and Poverty Report: Analysis of the 2013/2014 Household Income and Expenditure Survey. 4 Pacific Climate Change Science Program. 2011. Climate Change in the Pacific: Scientific Assessment and New Research, Volume 2: Country Reports. 5 Pacific Catastrophe Risk Assessment and Financing Initiative. 2011. Country Risk Profile: Samoa. 6 GoS. 2009. Samoa Post Disaster Needs Assessment. Following the Earthquake and Tsunami of September 29, 2009. Page 6 of 47 The World Bank Enhanced Road Access Project (P145545) vehicle load limits, and promoting road safety. LTA was the Implementing Agency for the World Bank-funded Samoa Infrastructure Asset Management Program, Phase 2 (SIAM-2, P075523); Post Tsunami Reconstruction Project (PTRP, P120594); and Enhancing the Climate Resilience of the West Coast Road Project (CRWCR, P126504). 5. Samoa’s road network remains of critical importance to the country’s economic development. At appraisal, the road system on Upolu and Savai’i consisted of about 1,150 km of classified roads (747 km on Upolu and 403 km on Savai’i) and 52 bridges (44 bridges on Upolu and 8 bridges on Savai’i). It provided connectivity that supported trade and promoted commercial activity by facilitating the movement of goods and services. It also provided safe and efficient access to social services including schools and health facilities. Nevertheless, the country’s road network was faced with a range of vulnerability issues, particularly: (i) coastal exposure to sea level rise, storm surge, and wave action during cyclones and tsunamis; (ii) inland flooding and landslips during extreme rainfall events; (iii) damage from earthquakes; and (iv) accelerated pavement deterioration due to extreme weather and rising water tables in some locations. These were exacerbated due to the majority (approximately 70 percent) of Samoa’s population living within 1 km of the coast, and critical infrastructure including roads, hospitals, schools, places of employment, port facilities, tourist facilities, power plants, and airports all being located primarily in the coastal zones. 6. As the primary artery on Upolu, the West Coast Road (WCR) provided a vital land link connecting Samoa’s capital and Apia Port with Faleolo International Airport, the Mulifanua inter-island ferry wharf (the main gateway to Savai’i), and communities and industry along the north west coast. Its preservation was critical for continued economic development as 53 percent of Samoa’s population7 and most of its industry was located along the corridor. Vaitele Street is at the eastern end of the WCR and forms a critical part of the Mulifanua to Apia Economic Corridor. It is considered the country’s most important section of road and supports heavy traffic with frequent congestion, especially from Vailoa Road to Atone Road through the industrial zone. During TCE, it played a vital role in providing access to and from affected areas and strengthening this asset’s resilience to climatic events was a priority for GoS. 7. The World Bank had historically engaged with GoS in strengthening road sector infrastructure and responding to and building resilience against natural disasters. A series of World Bank-funded projects had supported reforms in road maintenance and management arrangements, including the establishment of LTA, and major road rehabilitation works under the Samoa Infrastructure Asset Management Program, Phase 1 (SIAM-1, 1999–2003) and Phase 2 (SIAM-2, 2004–2014), PTRP (2010–2016), and CRWCR (2012–2020).8 The World Bank had worked with GoS under the Cyclone Emergency Recovery Project (2004–2008) supporting the recovery from Cyclone Heta and reducing coastal vulnerability. ERAP in support of post TCE rehabilitation was expected to continue the World Bank’s engagement with Samoa in the road sector. 8. ERAP was aligned with the World Bank Group’s Country Partnership Strategy (CPS) for Samoa FY 2012–2016 (Report No. 67194). The CPS defined the following three priorities for the World Bank’s engagement with Samoa: (i) rebuilding macro-economic resilience and encouraging inclusive growth, (ii) generating opportunities from global and regional integration, and (iii) strengthening resilience against natural disaster and climate change. The project was directly consistent with the third priority. It was also guided by the Government’s own priorities articulated in the Strategy for Development of Samoa (2012–2016), Samoa National Infrastructure Strategic Plan, and Samoa National Adaptation Program of Action. 7 This corresponds to the population of Apia Urban Area and North West Upolu in 2011, two of the four statistical regions that run through WCR. 8 PTRP also supported the rehabilitation of communities on Upolu affected by the tsunami in September 2009. Page 7 of 47 The World Bank Enhanced Road Access Project (P145545) Theory of Change (Results Chain) 9. At appraisal, there was no theory of change in the Project Appraisal Document (PAD). However, the Results Framework implied that ERAP was designed based on the theory of change presented in figure 1. Figure 1. Theory of Change at Appraisal Activities Outputs PDO/Outcomes Impact Component 1: Road and Bridge Reconstruction • 2.3 km of Vaitele Street • Widening 2.3 km of Vaitele Street widened • Repairing or replacing Leone • Leone Bridge repaired or 1 Bridge replaced PDO: Restore key road sector assets damaged by • Reconstructing other 7.7 km of • Other 7.7 km of roads and 6 extreme weather events and enhance the climate roads and 6 bridges to be bridges to be selected during Safer and more implementation reconstructed resilience of critical roads and bridges in Samoa selected during implementation efficient transport 2 • Consultancy for detailed design • Providing consultancy for services and construction supervision PDO indicators: detailed design and construction provided • Roads rehabilitated to improved standards supervision Improved reliability of • Access audits completed and • Bridges rehabilitated to improved standards • Completing access audits and road and bridge shared with design consultants • Traffic flows less disrupted sharing with design consultants infrastructure in the • Project designs informed by access audits event of a natural Component 2: disaster Technical Assistance • National road and bridge • Revising national road and bridge Increased access to standards revised standards 3 economic activities • Axle-load limit standards and • Updating axle-load limit and social services enforcement updated standards and enforcement • Road sector management • Improving road sector improved • Enabling environment strengthened for management • Priority issues addressed planning and managing the road sector and • Responding to existing or addressing sector issues emerging priority issues Component 3: • Project management support Project Management 4 provided • Project management support • Monitoring and evaluation • Monitoring and evaluation conducted Critical Assumptions 1. Contractors would have adequate capacity to rehabilitate roads and bridges to improved standards. 2. The detailed design and supervision consultants would be procured on time and fully engaged throughout the project. 3. GoS would have a strong commitment to revise/update the road and bridge standards and the axle-load limit standards. 4. The project management company would have sufficient capacity to assist with project management. Project Development Objectives (PDOs) 10. The PDO, as stated in the Financing Agreement of the project, was to “restore key road sector assets damaged by extreme weather events and enhance the climate resilience of critical roads and bridges in the Recipient’s territory.” There were no changes to the PDO during implementation. Key Expected Outcomes and Outcome Indicators Page 8 of 47 The World Bank Enhanced Road Access Project (P145545) 11. At appraisal, the PDO was expected to be measured through four indicators: (i) roads rehabilitated to improved standard, (ii) bridges rehabilitated to improved standards, (iii) reduction in disruptions in traffic flows at targeted locations,9 and (iv) instances when project designs are informed by access audits. Components 12. ERAP consisted of three components, as summarized in table 1. Table 1: Project Components and Financing Allocation at Approval Component Description Financing Allocation Component 1: To repair roads and bridges damaged by TCE and upgrade, rehabilitate, IDA financing: US$17.70 million Road and Bridge and/or reconstruct existing road sector assets to higher standards, this GoA financing: US$10.90 million Reconstruction would include: Total: US$28.60 million • Widening of 2.3 km of Vaitele Street; • Repair to or replacement of Leone Bridge; • Reconstruction of other roads and bridges to be selected during implementation based on both economic and social factors; and • Detailed design and supervision of the civil works. Component 2: To support institutional and regulatory reforms for road sector assets IDA financing: US$1.30 million Technical management and maintenance and to increase the sustainability of GoA financing: US$0.70 million Assistance sector investments, this would include: Total: US$2.00 million • Revision of standards for maintaining and constructing roads and bridges to be more climate resilient; • Update of legal, regulatory, and enforcement arrangements for enforcing axle load limits; • Strengthening of LTA’s technical capacity to effectively plan and manage the sector; and • Addressing of emerging priority issues that could have an impact on the Government’s ability to create more climate resilient road sector assets. Component 3: To support the Government in project management, this would include IDA financing: US$1.00 million Project a consulting firm to assist LTA in project implementation GoA financing: US$0.40 million Management Total: US$1.40 million Source: PAD. Note: IDA = International Development Association, GoA = Government of Australia. B. SIGNIFICANT CHANGES DURING IMPLEMENTATION (IF APPLICABLE) Revised PDOs and Outcome Targets 13. Although the PDO remained the same throughout the project lifetime, the PDO indicators and corresponding outcome targets were revised through a Level 2 restructuring and additional financing approved on May 31, 2018. Changes to the PDO indicators and corresponding targets are detailed in paragraph 14. 9 Disruptions included those associated with weather events and traffic flow due to functional capacity constraints. Page 9 of 47 The World Bank Enhanced Road Access Project (P145545) Revised PDO Indicators 14. All four original PDO indicators were dropped through the restructuring and additional financing in May 2018. Two new PDO indicators were added: (i) improved connectivity through rehabilitation or construction of the road network to improved standards (such as through raising the road elevation, strengthening the pavement, and improving the drainage capacity) and (ii) improved connectivity through rehabilitation or replacement of water crossings to improved standards (such as through single span designs, raised crossings, and scour protection).10 The target value of the first revised PDO indicator was 3.9 km, down from 10 km for the original first PDO indicator for the kilometer of roads rehabilitated to improved standards. The target value of the second revised PDO indicator was 3, down from 7 for the original second PDO indicator for the number of bridges rehabilitated to improved standards. Revised Components 15. There were no changes to the project components during implementation. However, a Level 2 restructuring in February 2016 added a new activity of ‘construction and supervision of parts of the East Coast Inland Route, including pedestrian access routes’ to Component 1. Other Changes 16. ERAP was restructured six times, including the restructuring and additional financing in May 2018. Other than the abovementioned revision of the PDO indicators and addition of a new activity under Component 1, the major changes included (i) an additional financing in a net amount of US$3.36 million provided by GoA, (ii) revision of the intermediate indicators (table 2) (both through the restructuring and additional financing in May 2018), and (iii) extension of the project’s closing date for a total of 42 months (through four restructurings in October 2018, April 2020, April 2021, and October 2021). Table 3 provides the timeline and rationale for the restructurings. Table 2. Original and Revised Intermediate Indicators Original Intermediate Indicators Revised Intermediate Indicators 1. Agreement on key roads for construction 1. Roads constructed 2. Identification of specific bridges to be improved 2. Roads rehabilitated 3. Water crossings rehabilitated or replaced 4. Reduction in disruptions in traffic flows at targeted locations 5. Instances when project designs are informed by access audits 6. Grievances registered related to delivery of project benefits that are addressed 7. Number of gender-responsive design features Table 3. Project Restructurings Restructurings/Date Reasons Level 2 restructuring To expand the scope of Component 1 to finance outstanding claims associated with the construction approved by the CD and supervision of relatively minor parts of the East Coast Inland Route, including pedestrian access on February 29, 2016 routes under PTRP.11 This restructuring also revised the end target of the second original PDO indicator on the number of ‘Bridges rehabilitated to improved standards’ from seven to six.12 10 Water crossings include bridges, fords, and culverts. 11 Although these activities fell within the objective and scope of ERAP, given that these were outstanding claims, the outcomes were accounted for under the Results Framework of PTRP. 12 This is due to the use of the estimated US$500,000 in ERAP funds for the new activity on East Coast Inland Route. Page 10 of 47 The World Bank Enhanced Road Access Project (P145545) Level 2 restructuring and To (i) provide an additional financing in a net amount of US$3.36 million provided by GoA, and (ii) additional financing restructure the project to (a) change the financing arrangements through part cancellation, (b) adjust approved by the CD the Results Framework to reflect project outputs and outcomes, and (c) revise the disbursement on May 31, 2018 estimates to account for the additional financing. The additional financing was needed to cover cost overruns for Leone Bridge and projected overruns for Mali’oli’o Bridge and support financing of the climate-resilient road network associated with the new access road for Mali’oli’o Bridge. Level 2 restructuring To extend the project’s closing date by 18 months from April 30, 2019 , to October 31, 2020. The approved by the CD extension was needed to allow sufficient time for completing primarily the civil works for Mali’oli’o on October 25, 2018 Bridge, but also for the remaining activities, including the axle-load limit reforms and construction standards, and the design and construction of Moamoa Crossing, Aia Bridge, and Nu’usuatia Bridge. Level 2 restructuring To extend the project’s closing date by six months from October 31, 202 0, to April 30, 2021. The approved by the RVP extension was needed due to major implications of the COVID-19 pandemic which Samoan road on April 22, 2020 projects were facing. It was needed to allow the civil works and other outstanding contracts to be completed. Level 2 restructuring To extend the project’s closing date by six months from April 30, 2021 , to October 29, 2021. The approved by the RVP extension was needed to finance the rectification works of the most critical road safety hazards on the on April 20, 2021 WCR financed under CRWCR and ERAP. The road safety hazards were identified through the post- construction road safety audit in March 2021. Level 2 restructuring To extend the project’s closing date by 12 months from October 29, 2021, to October 31, 2022. The approved by the RVP extension was needed to rectify road safety hazards on the WCR and enhance the safety of Mali’oli’o on October 27, 2021 Bridge, Moamoa Crossing, Aia Bridge, and Nu’usuatia Bridge, using additional project savings of around US$1.6 million identified by GoS in September 2021. Note: CD = Country Director, RVP = Regional Vice President 17. The amount of co-financing provided by GoA to ERAP was US$9.7 million, down from US$12.0 million at appraisal. The PAD noted that GoA agreed to provide a preliminary amount of up to US$12.0 million as co-financing. It also showed that ERAP was prepared with GoA’s financing of this preliminary amount. However, the extent of funding to be made available was unknown then (pending approval of GoA’s infrastructure and financing strategies). After the approval of the GoA’s strategies, the PRIF TF of US$6.35 million was formalized through the signing of the PRIF Grant Agreement in October 2014. In addition, the APIP TF of US$5.88 million was formalized following the restructuring and additional financing in May 2018, which included partial cancellation of the PRIF TF of US$2.52 million. 13 Thus, the additional financing in 2018 was in the net amount of US$3.36 (=5.88–2.52) million, as noted above. The co-financing reason was the alignment of the GoA’s infrastructure strategy for Samoa with the ERAP investments that focused on supporting more climate resilient infrastructure and improving access to economic activities and social services. There were no specific conditions of the co-financing. As with the case of the IDA grant, both TFs were used to assist in financing activities related to the project. 18. In addition to the formal changes described above, three water crossings of Moamoa, Aia, and Nu’usuatia and 1.82 km of WCR Lot 2b were added to the project.14 The rationale for these changes is provided in the following section. Rationale for Changes and Their Implication on the Original Theory of Change 19. The major changes to the project were related to the scope of the civil works, Results Framework, and the extension of the project’s closing date, which affected the original theory of change. ERAP was originally prepared as an 13This partial cancellation was due to the phasing out of the PRIF TF and its replacement with the APIP TF. 14The 12.5 km of the eastern half of the WCR consists of 6.6 km of Lot 1 between Malua and Afega and 5.9 km of Lot 2 between Afega and Saina, which is further divided into sub-Lots 2a, 2b, and 2c. Page 11 of 47 The World Bank Enhanced Road Access Project (P145545) emergency project. As a result, the project activities were not clearly defined during preparation as the extent of intervention was relatively unknown. At appraisal, Vaitele Street and Leone Bridge were the only priority investments identified for improvement during the first year of implementation. The investments in Mali’oli’o Bridge and access road were confirmed at the restructuring and additional financing in May 2018. While the PAD noted that ERAP would finance about 3 km of Central Cross Island Road, serious survey challenges were identified, and, in 2019, the Government decided to invest in the three water crossings on Upolu.15 Further, WCR Lot 2b was transferred from CRWCR to ERAP in 2020 due to budget constraint under CRWCR.16 While the PDO remained unchanged, the phased confirmation of the project scope and its associated changes to the expected outcomes and outputs affected the original Results Framework. Figure 2 presents the theory of change after the restructuring and additional financing in May 2018 (changes from the theory of change at appraisal are underlined). Figure 2. Theory of Change at Restructuring and Additional Financing in May 2018 Activities Outputs PDO/Outcomes Impact Component 1: • 2.3 km of Vaitele Street Road and Bridge Reconstruction widened • Widening 2.3 km of Vaitele Street • Mali’oli’o Bridge and 1.6 km of • Constructing Mali’oli’o Bridge and 1 access road constructed 1.6 km of access road • Leone Bridge replaced • Replacing Leone Bridge • Another bridge to be selected • Reconstructing another bridge to PDO: Restore key road sector assets damaged by during implementation extreme weather events and enhance the climate be selected during reconstructed Safer and more 2 resilience of critical roads and bridges in Samoa implementation • Consultancy for detailed design efficient transport • Providing consultancy for and construction supervision services detailed design and construction PDO indicators: provided supervision • Connectivity improved through rehabilitation or Improved reliability • Access audits completed and • Completing access audits and construction of roads to improved standards of road and bridge shared with design consultants sharing with design consultants • Connectivity improved through rehabilitation or infrastructure in the replacement of water crossings to improved event of a natural standards disaster Component 2: Technical Assistance • Revising national road and bridge • National road and bridge Increased access to standards 3 standards revised economic activities • Axle-load limit standards and • Road safety improved for roads and water • Updating axle-load limit crossings and social services standards and enforcement enforcement updated • Improving road sector • Road sector management management improved • Conducting road safety audits • Road safety audits conducted • Responding to existing or • Priority issues addressed • Enabling environment strengthened for emerging priority issues planning and managing the road sector and addressing sector issues Component 3: • Project management support 4 provided Project Management • Project management support • Monitoring and evaluation • Monitoring and evaluation conducted Critical Assumptions 1. Contractors would have adequate capacity to rehabilitate roads and bridges to improved standards. 2. The detailed design and supervision consultants would be procured on time and fully engaged throughout the project. 3. GoS would have a strong commitment to revise/update the road and bridge standards and the axle-load limit standards. 4. The project management company would have sufficient capacity to assist with project management. 15 The Central Cross Island Road is funded by the Asian Development Bank under the Central Cross Island Road Upgrading Project. 16 The budget constraint under CRWCR resulted from the Government’s decision, in November 2019, to change the WCR surfacing from chip seal to asphalt, which increased the costs of the design and supervision consultancy and the civil works contracts. Page 12 of 47 The World Bank Enhanced Road Access Project (P145545) II. OUTCOME A. RELEVANCE OF PDOs Assessment of Relevance of PDOs and Rating 20. At project closing, the ERAP PDO was consistent with the World Bank Group’s current Regional Partnership Framework (RPF) for nine Pacific Island Countries, including Samoa, for FY2017–FY2021 (Report No. 120479).17 The RPF was structured around four focus areas: (i) fully exploiting the available economic opportunities, (ii) enhancing access to economic opportunities, (iii) protecting incomes and livelihoods, and (iv) strengthening the enablers of growth and opportunities (macroeconomic management, infrastructure, and addressing knowledge gaps).18 The PDO directly supported the fourth focus area, specifically Objective 4.2 on increased access to basic services and improved connective infrastructure. The PDO also aligned well with the second and third focus areas, specifically Objectives 2.2 on addressing education and skills gap and Objective 3.1 on strengthened preparedness and resilience to natural disasters and climate change. ERAP was listed as one of the projects that would help achieve these three RPF objectives. 21. The PDO also remained fully relevant to the GoS’s current development priorities. Samoa 2040 identified a set of transformational opportunities—in tourism, agriculture and fishing, the development of a digital economy, and labor mobility—that have the potential to boost incomes and standards of living in Samoa by 2040.19 ERAP directly contributed to the investment in climate-resilient physical infrastructure, which Samoa 2040 noted as a key action to fully realize the potential of these opportunities. The Pathway for the Development of Samoa FY2021/22–FY2025/26 identified 21 key priority areas in five key strategic outcomes.20 ERAP was highly relevant to Key Priority Area 15 ‘Build Climate Resilience’ and Key Priority Area 21 ‘Consolidated Infrastructure Management’. These goals were also echoed in the Transport and Infrastructure Sector Plan 2022/23–2027/28, which sets out five goals, including ‘Goal 5: Improve connectivity, mobility, and accessibility through safe and climate-resilient road infrastructure’.21 The LTA Corporate Plan 2023–2026 set out four strategic goals to achieve the vision of “upholding resilient standards that sustain a safe, effective, and efficient national land transport network which underpins Samoa’s prosperity.”22 ERAP directly supported the “development and implementation of appropriate mechanisms for climate proofing and enhancing of all road networks,” one of the actions listed under the second goal of “improving and sustaining road transport network.” 22. Rating: Based on the above, the relevance of the PDO is rated High. 17 The World Bank Group’s Pacific Islands Systematic Country Diagnostic Update is being finalized at the time of finalizing this ICR. 18 World Bank Group, Regional Partnership Framework for Kiribati, Republic of Nauru, Republic of the Marshall Islands, Federated States of Micronesia, Republic of Palau, Independent State of Samoa, Kingdom of Tonga, Tuvalu, and Vanuatu FY2017–FY2021. 19 GoS. 2021. Samoa 2040, Transforming Samoa to a higher growth path. 20 GoS. 2022. Pathway for the Development of Samoa FY2021/22–FY2025/26. 21 GoS. 2023. Transport and Infrastructure Sector Plan 2022/2023–2027/2028 (draft). 22 LTA. Corporate Plan 2023–2026. Page 13 of 47 The World Bank Enhanced Road Access Project (P145545) B. ACHIEVEMENT OF PDOs (EFFICACY) Assessment of Achievement of Each Objective/Outcome 23. Efficacy is evaluated against both the original and revised outcome and output targets. Although the PDO remained the same,23 the length of roads and the number of bridges under Component 1 were reduced with the PDO and intermediate indicators and the associated outcome and output targets revised through the restructuring and additional financing in May 2018.24 Therefore, a split rating has been applied (see section D for further details). It should be noted that the PDO is not unpacked as, when building back better, restoring key road sector assets is an inseparable part of enhancing climate resilience. It should also be noted that revision of national road and bridge standards and axle-load limit standards were completed at the end of implementation; thus, while specifications for all ERAP works were in accordance with international standards, the standards improved under Component 2 did not feed into Component 1. 24. The project restored Leone Bridge, the vital crossing collapsed during TCE and the only ERAP investment for emergency response. The contract for the design and supervision consultant was signed in July 2014, with the initial plan to complete the design by March 2015. However, finalization of the design completion report and bid documents was delayed by several months due to the misalignment of the proposed technical solution between GoS and the World Bank and the unresponsiveness of the design consultant to comments on various aspects of the design and bidding documents. The Aide Memoire from the mission in June 2015 noted that these documents were five months overdue, adding that the following issues contributed to the delay in finalizing them: (i) lack of specialized expertise in Samoa to design, construct, and supervise a single-span superstructure made up of a pre-stressed, precast concrete hollow core beams; (ii) lack of crane for placing the beams once cast in-country; (iii) unresponsiveness of the design consultant to LTA comments; (iv) need for additional safeguards measures to manage the potential for noise and water quality impacts associated with bridge removal and reconstruction; and (v) recent turnover and continued disruption of key LTA staff working on ERAP. The Request for Bids was issued in November 2015, with the contract for the civil works signed in May 2016 and the bridge open to traffic in July 2017. 25. Of the four original PDO indicators (all of which were output-oriented), two were partly achieved (57 and 71 percent), while the other two exceeded targets (114 and 175 percent). Of the two original intermediate indicators, one was partly achieved (60 percent), while the other was almost fully achieved (83 percent). The assessment of each of these original PDO and intermediate indicators is summarized as follows: (a) Outcome 1: Length of roads rehabilitated to improved standards. At appraisal, the baseline value was 0 km, and the target value was 10 km. At closing, ERAP rehabilitated or constructed 5.72 km of the project roads, indicating 57 percent achievement of the target. This indicator was dropped, and a same indicator measuring the length of roads rehabilitated (but without the wording of ‘to improved standards’) and a similar indicator measuring the 23 The PDO formulation responds clearly to the original intent of responding to a specific disaster; however, through the life of the project, the objective to a degree transitioned towards improved connectivity through enhancing the climate resilience of critical roads and water crossings, as reflected by the revision of the PDO indicators in 2018. While the ERAP’s only emer gency works for Leone Bridge were completed by then, the PDO remained unchanged due to the country’s high and growing vulnerability to climate change and natural disasters as noted in the opening section. 24 This is partly because the original intent of “rehabilitation” was replaced by “rehabilitation and construction” for roads and “replacement” for water crossings with greater climate resilience measures, which led to an increase in costs for Leone Bridg es and Mali’oli’o Bridge and access road. Page 14 of 47 The World Bank Enhanced Road Access Project (P145545) length of roads constructed were added to the intermediate level, both at the restructuring and additional financing in May 2018. (b) Outcome 2: Number of bridges rehabilitated to improved standards. At appraisal, the baseline value was 0, and the target value was 7. At closing, the project replaced 5 water crossings, representing 71 percent achievement of the target. This indicator was dropped, and a similar indicator measuring the number of water crossings replaced or rehabilitated was added to the intermediate level, both at the restructuring and additional financing in May 2018. (c) Outcome 3: Number of locations with reduced disruptions in traffic flows. At appraisal, the baseline value was four, and the target value was zero. At closing, ERAP contributed to reducing disruptions in traffic flows at seven locations (Vaitele Street, WCR Lot 2b, Mali’oli’o Bridge and access road, Leone Bridge, Moamoa Crossing, Aia Bridge, and Nu’usuatia Bridge), indicating 175 percent achievement of the target. This indicator was dropped, and a same indicator (but with the reversed baseline of 3 and target of 4) was added to the intermediate level, both at the restructuring and additional financing in May 2018. (d) Outcome 4: Number of instances designs informed by access audits. At appraisal, the baseline was ‘Access audits not routinely carried out’, and the target was ‘seven project designs informed by access audits’. At closing, eight project designs (the seven locations noted above and Central Cross Island Road) were informed by access audits, showing 114 percent achievement of the target. This indicator was dropped, and a same indicator was added to the intermediate level, both at the restructuring and additional financing in May 2018. (e) Output 1: Agreement on key roads for reconstruction. At appraisal, the baseline was ‘No improvements’, and the target was ‘Works finished for at least five roads’. At closing, works for three roads were finished, showing 60 percent achievement of the target. This indicator was dropped at the restructuring and additional financing in May 2018. (f) Output 2: Identification of specific bridges to be improved. At appraisal, the baseline was ‘No improvements’, and the target was ‘Works finished for at least six bridges’. At closing, works for five water crossings were finished, showing 83 percent achievement of the target. This indicator was dropped at the restructuring and additional financing in May 2018. 26. The first revised PDO indicator ‘Improved connectivity through rehabilitation or construction of road network to improved standards’ was exceeded, with 5.72 km of roads (147 percent of the revised target of 3.90 km) rehabilitated or constructed to improved standards. At restructuring and additional financing in May 2018, the baseline value was 2.30 km (as Vaitele Street works were completed in 2016), and the target value was 3.90 km. At closing, ERAP rehabilitated or constructed a total of 5.72 km of roads, including the rehabilitation of 4.12 km (2.30 km of Vaitele Street and 1.82 km of WCR Lot 2b) and the construction of 1.60 km of Mali’oli’o Bridge access road to improved standards, such as through raising the road elevation, strengthening the pavement, and increasing the drainage capacity (figure 3). For example, two low spots with a combined length of 350 m within WCR Lot 2b were raised above 2.0 m mean sea level, while seven drainage outfalls (five on Vaitele Street and two on WCR Lot 2b) were installed under ERAP. The ERAP investments in the project roads enhanced road network connectivity, as demonstrated in the fourth revised intermediate indicator ‘Targeted locations where traffic flows will have reduced disruptions’. Page 15 of 47 The World Bank Enhanced Road Access Project (P145545) Figure 3. Photos of the Project Roads Vaitele Street, during ERAP Investment Vaitele Street, after ERAP Investment WCR Lot 2b, during ERAP Investment WCR Lot 2b, after ERAP Investment Mali’oli’o Bridge Access Road, during ERAP Investment Mali’oli’o Bridge Access Road, after ERAP Investment Source: LTA and World Bank. 27. The second revised PDO indicator ‘Improved connectivity through rehabilitation or replacement of water crossings to improved standards’ was also exceeded, with five water crossings (167 percent of the revised target of three water crossings) replaced to improved standards. At restructuring and additional financing in May 2018, the baseline value was one (as Leone Bridge works were completed in 2017), and the target value was three. At closing, ERAP replaced five water crossings at Leone, Mali’oli’o, Moamoa, Aia, and Nu’usuatia to improved standards, such as through single span designs, raised crossings, and scour protection (figure 4). For example, the old three-span Leone Bridge (which became impassable after TCE) was replaced by a 27m-long single-span bridge. In addition, a new 37.5m-long two-span arch plus box bridge was constructed more inland (see paragraph 28 for further details on Leone and Mali’oli’o Bridges). Further, the old 6.7m-long Aia and 10.6m-long Nu’usuatia Bridges were both replaced by a 18.2m-long single-span modular bridge and the old Moamoa crossing with three pipe culverts (hydraulic opening of 0.85m2) was replaced by a 3- cell box culverts (hydraulic opening of 8.1m2), all with scour protection. As a result, these water crossings enhanced road Page 16 of 47 The World Bank Enhanced Road Access Project (P145545) network connectivity by providing year-round access to road users and this is reflected in the fourth revised intermediate indicator ‘Targeted locations where traffic flows will have reduced disruptions’ (see paragraph 33 for further details). Figure 4. Photos of the Project Bridges Leone Bridge, before ERAP Investment Leone Bridge, after ERAP Investment Mali’oli’o Ford, before ERAP Investment Mali’oli’o Bridge, after ERAP Investment Moamoa Crossing, before ERAP Investment Moamoa Crossing, after ERAP Investment Aia Bridge, before ERAP investment Aia Bridge, after ERAP Investment Page 17 of 47 The World Bank Enhanced Road Access Project (P145545) Nu’usuatia Bridge, before ERAP investment Nu’usuatia Bridge, after ERAP Investment Source: LTA and World Bank. 28. The scope of the project revised at the restructuring and additional financing in May 2018 aimed to provide greater climate resilience to Leone and Mali’oli’o Bridges. During TCE, excessive flooding damaged Leone Bridge causing one pier to settle and the bridge deck to crack. The bridge had been closed to vehicular traffic since then. At appraisal, it was unknown whether the bridge would be rehabilitated or replaced. During design, the Government chose to fully replace the bridge with a single span design (rather than a relatively lower cost multi-span bridge) as this would offer greater climate resilience by reducing the risk of debris blockage and overtopping during severe weather events, key issues which caused structural damage during TCE. For Mali’oli’o Bridge, several alternatives were considered for the bridge replacement including designs and alignments, and the Government decided to construct a new bridge at a new location more inland. The new bridge has provided safer and more reliable access, particularly during severe weather events. It has also provided redundancy as the original ford is still in service. 29. ERAP improved road safety on the project roads and bridges through engineering measures, including sealing road shoulders; developing bus stops; installing signages; and providing thermoplastic line marking, rumble strips, and additional safety furniture such as guard rails, flexible bollards, and reflectors. 25 A post-construction road safety audit was completed under ERAP on the WCR, Mali’oli’o Bridge and access road, Moamoa Crossing, Nu’usuatia Bridge, and Aia Bridge. It indicated that some drains and driveway culverts on WCR were a high-risk safety concern.26 To address this, ERAP extended its closing date by a total of 18 months from April 30, 2021, to October 31, 2022, to allow for repair of the critical drains, culverts, and other safety hazards on the WCR, Mali’oli’o Bridge and access road, and the three c rossings. The project rectified all culvert driveway headwalls situated close to the road edge, by replacing the vertical culvert headwall on the departure side with a sloping driveable endwall, to reduce the hazard presented to vehicles that leave the road and hit the wall. 30. Of the seven revised intermediate indicators, two were fully achieved and five were exceeded, with the achievements of the targets ranging from 140 to 179 percent. See annex 1 for further details. 31. The technical assistance activities were fully completed. ERAP funded a study to review and update vehicle loading legislation and regulation, and design standards for roads and bridges in Samoa. The study recommended measures that would facilitate improved enforcement of axle-load limits by LTA. The recommended reform and drafting legislation served as an input for the institutional and governance review being carried out under SCRTP. In addition, to improve engineering testing undertaken by LTA, ERAP purchased the much-needed laboratory equipment, such as a binder content analyzer for asphalt, a light weight deflectometer for subgrade strength testing, and the California Bearing 25 These mainly follow the key recommendations from a road safety audit completed on WCR in June 2011. The recommendations were reviewed under SCRTP in 2019 and were incorporated into the detailed design for the civil works. 26 Ministry of Works, Transport, and Infrastructure. 2021. Post-Construction State Road Safety Audit Reports for the 12.5 km section of WCR, Mali’oli’o Bridge and access road, the Moamoa, Nu’usuatia, and Aia Crossings, Samoa. Page 18 of 47 The World Bank Enhanced Road Access Project (P145545) Ratio test machine. Training related to equipment repair, calibration, and introduction of a quality management system was also provided to LTA. Beyond the project’s closing date, LTA hired a laboratory manager in February 2023, as recommended by the laboratory specialist engaged under ERAP. Together, the project contributed to enhancing the sustainability of road and bridge investments through improved climate resilience measures, standards, and quality management. 32. The project’s principal beneficiaries are people who use the project roads and bridges. As ERAP financed several roads and bridges on all the four statistical regions of Apia Urban Area, North West Upolu, Rest of Upolu, and Savai’i; a large share of the entire population of Samoa of about 206,000 (of which 49 percent are female) are regarded as beneficiaries of the project.27 Restoring Leone Bridge damaged by TCE and enhancing the climate resilience of all the critical project roads and bridges made road travel safer and more reliable for users in the event of a natural disaster; provided benefits to other sectors, including tourism, agriculture, and general commerce; and provided health care, education, and social connectivity benefits. 33. ERAP had important impacts on access to market and social services, especially for rural communities. These include improved connectivity from (i) re-establishing direct routes such as the replacement of Leone Bridge, and (ii) increasing climate resilience and helping to ensure access during extreme weather events such as at the Mali’oli’o river crossing and the three water crossings on Upolu. For example, the Mali’oli’o river crossing was impassible for about ten days a year in an average wet season and the local population was cut off from basic education, health, cultural and religious services, places of employment, and centers of economic activities. Population living south of the river was unable to access the two secondary-level education facilities, which are both north of the river. On the other hand, population to the north was unable to reach the only treatment-level health facility on the island, Tavasi District Hospital, and the main economic center Salelologa without navigating about 120 km of the other way around the island. Justification of Overall Efficacy Rating 34. Rating: Based on the above, efficacy is rated Modest against the original outcome and High against the revised outcome. C. EFFICIENCY Assessment of Efficiency and Rating 35. An ex post economic analysis conducted at completion shows an economic internal rate of return (EIRR) of 18.5 percent and a net present value (NPV) of US$29.7 million, up from the EIRR of 16 percent and the NPV of US$19.7 million at appraisal and the EIRR of 15.6 percent and the NPV of US$20.0 million at the restructuring and additional financing in May 2018. It follows the same methodology used at appraisal and the restructuring and additional financing and focuses on the economic appraisal of Component 1, for which investments amounted to 90 percent of project costs at completion. The analysis was based on the actual investment costs, implementation schedule, and latest traffic. As with the case at appraisal and the restructuring and additional financing, it covers a 23-year period from 2013 to 2035 and uses a discount rate of 5 percent. The benefits quantified included the reduction of (i) vehicle operating costs, (ii) passenger time costs, and (iii) disruptions due to improved climate resilience (see annex 4 for further details). 27 Samoa Bureau of Statistics. 2022. Samoa Population and Housing Census 2021. Basic Tables. Page 19 of 47 The World Bank Enhanced Road Access Project (P145545) 36. The project had several aspects in its design and implementation which affected its efficiency. Despite the initial delays mostly attributable to slow progress of design for Leone Bridge, performance challenges of the PMC, and frequent changes in counterpart staff, all the project activities were completed before the revised closing date of October 31, 2022. GoS used additional time addressing the unexpected events such as measles outbreak (2019), election challenge (2021), and COVID-19 pandemic (2020–2022). GoS also managed to maximize the use of the project savings through the last two project restructurings, which proved more efficient than cancelling the savings and using them under SARIP, which became effective on October 4, 2022, the same month ERAP closed. As presented in Annex 3, the actual cost for Component 2 was US$1.73 million, down from the estimated cost of US$2.00 million at appraisal. Similarly, the actual cost for Component 3 was US$1.07 million, down from the estimated cost of US$1.40 million at appraisal, together indicating the efficiency of these components. 37. Rating: Based on the above, efficiency is rated Substantial. D. JUSTIFICATION OF OVERALL OUTCOME RATING 38. The split rating, as summarized in table 4, results in an overall outcome rating of Moderately Satisfactory. Table 4. Split Rating Results Without Restructuring and Additional With Restructuring and Additional Financing in May 2018 Financing in May 2018 Relevance of PDO High Efficacy Modest High Efficiency Substantial 1. Outcome ratings Moderately Unsatisfactory Highly Satisfactory 2. Numerical value of the outcome ratings 3 6 3. Disbursement US$17.50 million US$10.17 million 4. Share of disbursement 0.63 0.37 5. Weighted value of the outcome rating 3 × 0.63 = 1.89 6 × 0.37 = 2.22 6. Final outcome ratinga 1.89 + 2.22 = 4.11, rounding it to 4 or Moderately Satisfactory Note: a. Highly Satisfactory = 6; Satisfactory = 5; Moderately Satisfactory = 4; Moderately Unsatisfactory = 3; Unsatisfactory = 2; and Highly Unsatisfactory = 1. E. OTHER OUTCOMES AND IMPACTS (IF ANY) Gender 39. ERAP was gender informed, although at the time of project preparation, gender did not represent one of the Transport Global Practice’s corporate priorities. A social beneficiary survey for CRWCR and ERAP was conducted in 2014, and women were specifically consulted to ensure that their concerns could be addressed in the project design and during implementation. The survey identified that many women walked along the WCR and were dependent on public transport to travel to Apia. While many of the survey respondents focused on enhanced connectivity for women, safety was also a primary concern, particularly for pedestrians and those taking public transport. Footpaths, drains/drainages, streetlights, speed humps, pedestrian crossings, road safety signs, bus shelters, and speed limits on roads were interventions that Page 20 of 47 The World Bank Enhanced Road Access Project (P145545) were desired by many respondents.28 This resulted in specific interventions to address these concerns along the project roads. People with Disabilities 40. ERAP contributed to reducing barriers for persons with disabilities by conducting access audits and constructing the features of accessibility. Access guidelines from the Ministry of Natural Resources and Environment (MNRE) were used as a construction reference for road and bridge work to ensure that designs were inclusive of persons with disabilities and the features of accessibility such as raised sidewalks, ramps, wider pavements, and signage were considered before construction.29 As noted previously, access audits were undertaken by Nuanua O Le Alofa (NOLA), a local disability advocacy agency, to determine where improvements could be made to the designs (figure 5). NOLA also provided training to LTA on how to communicate through sign language. Figure 5. Access Audit Source: NOLA. Institutional Strengthening 41. The project has strengthened institutional capacity through the establishment of LTA Project Management Division (PMD) in 2015, which was initially set up to manage the implementation of World Bank-funded projects (ERAP and CRWCR). Its mandate was expanded in the following years to include not only the World Bank-funded SCRTP (2018– 2025) and the Samoa Aviation and Roads Investment Project (SARIP, 2022 –2029), but also other donor-funded projects under LTA’s jurisdiction, including the Project for Reconstruction of Vaisigano Bridge funded by the Japan International Cooperation Agency (2017–2020), the Project for Installation of Mabey Bridge funded by the Australian Department of Foreign Affairs and Trade (DFAT), the Vaisigano Catchment Project funded by the Green Climate Fund, and the Central Cross Island Road Upgrading Project funded by the Asian Development Bank (2020–2029). Mobilizing Private Sector Financing 42. The project did not leverage private sector financing. 28 LTA, Social Beneficiary Survey for ERAP and CRWCR, March 2015. 29 World Bank. 2017. Results Brief. Improving Access and Disaster Preparedness for Persons with Disabilities in Samoa. Page 21 of 47 The World Bank Enhanced Road Access Project (P145545) Poverty Reduction and Shared Prosperity 43. ERAP supported the World Bank Group’s twin goals of eliminating extreme poverty and boosting shared prosperity by providing a large share of Samoa’s entire population with reliable and climate-resilient transport and contributing to more efficient access to market and services, as well as safer and more affordable road transport. As indicated in the RPF, investment in public infrastructure, especially connective infrastructure, is essential for the wider economy. Improved climate resilience of critical roads and bridges on both Upolu and Savai’i helped almost all of Samoa’s population with enhanced access to market and services, as detailed in paragraph 33, and safer and more reliable road transport in the event of a natural disaster. It also helped LTA manage and maintain the roads and bridges effectively, contributing to long-term economic development in Samoa. Other Unintended Outcomes and Impacts 44. ERAP contributed to enhancing the capacity and sustainability of the local contracting industry with all the works contracts, except for Leone Bridge, awarded to local contractors. Historically, major road pavement works in Samoa were conducted by one large local contractor. To provide greater opportunities for local contractors to qualify, WCR Lot 2 was unbundled into three smaller lots. While Lots 2a and 2c were awarded under CRWCR to the same large local contractor, Lot 2b was awarded to a joint venture of three local contractors who had previously not worked on the World Bank-funded transport projects in Samoa. While the Letter of Acceptance for this contract was issued in July 2019, the works contract could not be signed until November 2019 as the joint venture had problems meeting the stringent documentation required for environmental, social, health, and safety, and financial compliance, as well as confirmation of key staff. The contractor carried out surveys and site establishment in December 2019 and physical works started in January 2020. The works on Lot 2b were completed in December 2020 as satisfactory as those on Lots 2a and 2c. III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME A. KEY FACTORS DURING PREPARATION 45. The World Bank’s successful and long-term engagement in the Samoa’s transport sector through SIAM-1, SIAM-2, PTRP, and CRWCR helped put in place the foundations for quick preparation of this emergency operation. Under these past and ongoing projects at appraisal, assistance had been extended to support the country’s strategic direction for managing road assets through financial support for works and technical assistance to formulate and carry out sector reforms. It is also worth noting that, at appraisal, Samoa had joined the Pacific Catastrophe Risk Assessment and Financing Initiative, which provides tools to support ex-ante disaster risk reduction measures, such as planning, emergency preparedness, climate change adaptation, disaster risk financing, and post disaster support such as rapid assessment. ERAP was built on the achievements and lesson learned from these projects and initiative. 46. Given the urgent need of assistance due to a natural disaster in a small state, ERAP was processed under Emergency Procedures, which contributed to a compressed preparation period. The memo to seek the CD’s approval to apply paragraph 12 of Section III of the Investment Project Financing Policy was issued on March 19, 2013, followed by the combined preparation and appraisal mission from June 11 to 27, 2013; the Decision Review meeting on July 17, 2013; and the World Bank’s Board approval on October 17, 2013. This means that the total project preparation time was seven months, which was much shorter than the average of 12–13 months in the Pacific. ERAP benefited from an expedited and simplified approval process, which shortened the overall preparation time. Page 22 of 47 The World Bank Enhanced Road Access Project (P145545) 47. The project design was simple and realistic and consisted of the activities required to achieve the PDO. It focused on ‘hard’ infrastructure investments combined with ‘soft’ transformative activities, including the update of the road and bridge standards and axle-load limit standards, improvement of the LTA laboratory through the purchase of new equipment, and provision of training to introduce a quality management system. These ‘soft’ activities provided LTA with the revised standards for designing and constructing roads and bridges to be more climate resilient, updated axle- load legislation and regulations for heavy vehicles, and institutional capacity to plan and manage the road sector more effectively. 48. Although the project’s implementation arrangements followed the successful implementation of PTRP, SIAM- 2, and CRWCR, institutional capacity risk rated ‘Moderate’ at appraisal should have been rated higher. ERAP involved activities in several different locations both on Upolu and Savai’i, which stretched Government capacity. The Ministry of Finance (MOF) was the executing agency, LTA was the implementing agency, and the Project Steering Committee oversaw the project and monitored implementation. To mitigate the institutional capacity risk, the PAD identified the need to hire a design and supervision consultant, and a private consulting firm as a Project Management Company (PMC) to assist LTA with project management, procurement, financial management (FM), and contract administration. However, the need for international advisers or additional support for safeguards was not mentioned in the PAD, implying the expectation that the PMC would provide sufficient support to LTA to implement the project. B. KEY FACTORS DURING IMPLEMENTATION (a) Factors Subject to the Control of Government and/or Implementing Entities 49. During the first years of implementation, ERAP suffered from project management issues, including performance challenges of the PMC, contract management shortcomings, procurement delays, and a concerning level of staff attrition within LTA PMD. The continuous underperformance of the PMC was highlighted as a reason to downgrade the project management component rating to Moderately Unsatisfactory in the Implementation Status and Results Report (ISR) in December 2015. The ISR also noted that there was a general lack of proactivity from the PMC in supporting implementation. The procurement documentation and semi-annual progress reports submitted to the World Bank for review typically required significant modification, and the PMC’s support in terms of effectively monitoring project indicators was limited. The high staff turnover within the LTA PMD, most notably for the project manager (LTA had three project managers over 1.5 years since March 2015) also affected implementation. To address these challenges, in May 2017, the Government prepared an action plan. FM responsibilities handled by the PMC were transitioned to MOF Aid Coordination and Debt Management Division (ACDMD), effective from June 1, 2017, to allow the PMC to increase its level of support to LTA on procurement and project and contract management. In addition, LTA hired a technical adviser in late 2016 using ERAP funds to strengthen the project management function. The contract with the PMC was expired on June 30, 2019, after which support for LTA was replaced with the new arrangements provided by MOF ACDMD, the Centralized Technical Services Support Unit (CTSSU), and the Transport and Infrastructure Sector Coordination Division (TISCD).30 50. The capacity for implementing donor-funded infrastructure projects was limited within the LTA PMD. Frequent changes in project staffing within the PMD was also a major contributor to capacity sustainability challenges. 30 CTSSU is housed within MOF and is staffed with senior specialists (that is, international consultants) tasked with providing high- level guidance, training, and hands-on support on project implementation to all agencies working on development projects in Samoa in the areas of procurement, FM, safeguards, and M&E; while TISCD is a coordination division within the Ministry of Works, Transport, and Infrastructure (MWTI) that was established and financed through SCRTP. Page 23 of 47 The World Bank Enhanced Road Access Project (P145545) This resulted in long delays in procurement of consultants and civil works contractors, document preparation (particularly procurement and safeguards documentation), and contract management such as delays in providing contract extension resulting in contracts to expire before works were completed. 51. The implementation arrangements for safeguards management were inadequate for several years but eventually strengthened over time. Although LTA was required to carry out the project in accordance with the safeguards documents, MNRE also had an integral role in providing necessary safeguards-related clearances for LTA to carry out road works. The PMC was tasked with providing day-to-day management and monitoring and implementation support to LTA. However, it was not clear who was responsible within LTA and/or the PMC for managing the safeguards process. The PMC, in part, was engaged to coordinate the activities of the agencies within the Project Steering Committee; however, the lack of effective communication between LTA and MNRE on survey and land acquisition issues resulted in significant delays. To address the safeguards capacity gap, a safeguards specialist was hired under ERAP in October 2017, and a safeguards officer was added to the LTA PMD in January 2018. This highlighted the importance of having designated environmental and social specialists in either LTA and/or the PMC. 52. The project’s focus shifted from emergency to non-emergency investments upon completion of the ERAP’s only emergency works for Leone Bridge in mid-2017. While ERAP financed the emergency works for Leone Bridge, its majority of funds were used for non-emergency works for Vaitele Street, Mali’oli’o Bridge and access road, three water crossings on Upolu, and WCR Lot 2b, all of which focused on improving their climate resilience. This led to the ERAP’s relatively long implementation period as an emergency project. 53. In 2019, the Government decided to invest in the three water crossings of Aia, Nu’usuatia, and Moamoa under ERAP based on the bridge condition assessment undertaken with the assistance from DFAT.31 The assessment used a multi-criteria analysis to rank the structures on Upolu in terms of their priority. It first established the bridges’ vulnerability based on (i) bridge condition, (ii) load rating, (iii) scour and undermining of the foundations, and (iv) climate change. The 12 most vulnerable bridges were then assessed using a second set of social/economic factors, including (i) traffic volume, (ii) alternative route (impact on connectivity), (iii) safety, and (iv) population (impact on community). Of the top five priority structures, the two highest ranked involved maintenance repairs only, while the next three — Moamoa, Nu’usuatia, and Aia—were selected for replacement under ERAP. 54. The Government’s decision to change the WCR surfacing to asphalt in November 2019 led to additional costs and time for CRWCR, which led to the transfer of WCR Lot 2b from CRWCR to ERAP. During the detailed design, the chip seal surface was selected based on technical and budget considerations. The bidding documents and civil works contracts for Lots 1 and 2 were all prepared based on this design option. However, the Government decided to switch the entire WCR surfacing from double bituminous surface to asphalt. As a result, the full width (carriageway and shoulders) of the completed sections, which already had a double bituminous surface was overlaid with an asphalt surface. While the change in pavement type contributed to improving long-term sustainability and the ride quality of the road sections, it also increased the costs of the design and supervision consultancy and the civil works contracts, and the time required to complete the works. CRWCR did not have sufficient financing for all the works, which led to a decision to transfer WCR Lot 2b from CRWCR to ERAP. 55. The newly completed Moamoa Crossing was overtopped during the severe floods in December 2020 and again after heavy rainfall in February 2022, which raised concerns about the capacity of the new crossing. In December 2018, the design consultant submitted detailed design for a new multiple box culvert to replace the old crossing of three pipe 31 DFAT. 2016. Bridge Conditions Assessment and Maintenance Design (Samoa). Completion Report. Page 24 of 47 The World Bank Enhanced Road Access Project (P145545) culverts with the diameter of 0.60m (hydraulic opening of 0.85m2). The proposed design involved construction of 5-cell, 1.8m x 1.8m culverts (hydraulic opening of 16.2m2) based on the structure passing a 1-in-100-year storm. This compared to the 2016 DFAT-funded bridge assessment that recommended 2-cell, 2.0m x 1.3m culverts (hydraulic opening of 5.2m2). The ISR in March 2019 included the over dimensioned design and costs for this crossing as one of the key issues, stating that the World Bank was critical of the unnecessarily large size and cost of the proposal, given the catchment and level of road importance. Subsequently, the project adopted 3-cell, 1.8m x 1.5m culverts (hydraulic opening of 8.1m2). According to LTA, the cause of the recent flooding was primarily due to large debris and logs that were dumped into the river channel upstream of the crossing during site clearing for residential developments in the upstream catchment area. These materials were subsequently washed downstream and blocked the culvert inlet. 56. In September 2021, GoS identified additional project savings in the amount of US$1.6 million on top of US$0.26 million identified in April 2021. This was mainly caused by (i) the variation to the CRWCR-funded WCR Lots 2a and 2c contract to add an asphalt concrete overlay (valued at about US$1.3 million) that was scheduled to be paid under ERAP but was actually paid under CRWCR to exhaust its available funds; and (ii) additional savings that were identified from technical assistance contracts. As a result, the Government proposed to use the project savings to complete the repairs of the road safety hazards on WCR and enhance the safety of the ERAP bridges, both identified in the post- construction road safety audit. As noted in the Restructuring Paper, the option of cancelling the project savings to be used for a forthcoming World Bank-funded project that could implement the needed road safety repairs was disregarded as it would prolong the time to complete the repairs, and not address the imminent risk for those using the upgraded roads and bridges. This led to a 12-month extension of the project’s closing date from October 29, 2021, to October 31, 2022. (b) Factors Subject to the Control of the World Bank 57. Implementation support was adequate. For most of the project implementation period, the project implementation support missions were carried out quarterly (rather than semi-annually), and the task team closely monitored project progress and proactively addressed problems. Opportunities for improvement were identified and acted upon, as noted in the agreed action plan at the mid-term review in August 2017, and as reflected in the restructuring and additional financing in May 2018. Overall reporting in ISRs and Aide Memoires was candid throughout. (c) Factors outside the Control of Government and/or Implementing Entities 58. The travel restrictions associated with the COVID-19 pandemic caused interruptions to the implementation when the country was recovering from a measles outbreak. In November 2019, a measles outbreak claimed 83 lives, infected around two percent of the country’s population, and had a severe economic impact on tourism and services. On March 21, 2020, the Government declared a state of emergency in response to COVID-19, locking down its international borders and imposing internal travel restrictions, social distancing measures, and limited working hours of all government ministries and state-owned enterprises staff. Until Samoa’s international borders reopened on August 1, 2022, international travel was restricted with scheduled international flights suspended except for occasional Government approved flights. These delayed the (i) import of materials for Moamoa Crossing, Nu’usuatia and Aia Bridges, (ii) travel from Upolu to the Mali’oli’o Bridge site on Savai’i, (iii) consultant’s workshop for reviewing the legislation and design standards with relevant local stakeholders, (iv) training by the laboratory specialist, and (v) finalization of the bid evaluation of Nu’usuatia and Aia Bridges. These issues led to the six-month extension of the project’s closing date from October 31, 2020, to April 30, 2021. Page 25 of 47 The World Bank Enhanced Road Access Project (P145545) IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME A. QUALITY OF MONITORING AND EVALUATION (M&E) M&E Design 59. The original M&E design was weak and did not measure project progress appropriately. The original design included several weaknesses, including no information for demonstrating the achievement of the expected outcomes and no information on what constitutes the target of all the original PDO indicators (for example, the target of 10 km was provided in the PAD’s Results Framework without specifying which roads). As a result, all the original PDO indicators (four) and intermediate indicators (two) were replaced through the restructuring and additional financing in 2018. The revised PDO indicators (two) and intermediate indicators (seven) were designed to succinctly monitor progress made toward achieving the PDO and advancing the project’s activities. They reflected the updated project scope under Component 1, and the indicators chosen were straightforward to measure, time-bound, and did not imply an additional cost of collection. However, the following three minor shortcomings were observed: (a) Misalignment of the PDO and the two revised PDO indicators. To fully align the PDO with the revised PDO indicators, the PDO could have been modified to “To improve the road network connectivity by restoring key road sector assets damaged by extreme weather events and enhancing the climate resilience of critical roads and bridges in Samoa” through the restructuring and additional financing in May 2018. (b) Limited indicators for technical assistance activities. While there were indicators related to access audits and gender-responsive design features, there were no indicators related to the update of design standards for roads and bridges and vehicle loading legislation and regulation. The Decision Note of Decision Review for the restructuring and additional financing states that ‘there would not be significant value added in including an indicator related to these activities, particularly as their measurement is not instrumental in providing evidence as to whether the project is on track to achieving the objective’. (c) Overlap of PDO and intermediate indicators. The target of the first revised PDO indicator was the sum of that of the first and second revised intermediate indicators. The same observation is applied to the second revised PDO indicator, which had the same target with the third revised intermediate indicator. The PDO indicators consider not only these intermediate indicators, but also the fourth intermediate indicator on traffic flow to show enhanced connectivity. However, the Results Framework could have been simplified by removing the first, second, and third intermediate indicators. M&E Implementation 60. The M&E reporting of the project was undertaken by the PMC up to June 30, 2019,32 and then by MOF ACDMD and TISCD in the form of semiannual project reports. However, the submission of these reports was often delayed, especially because the outgoing PMC did not prepare the semi-annual report for January 1, 2019, to June 30, 2019, creating difficulties in monitoring actual project status. While TISCD managed to prepare the report using data provided 32 No issues were identified on M&E implementation before June 2019. The M&E rating in Aide Memoires was maintained as ‘Satisfactory’ from November 2017 (when the rating commenced) to February 2020 (when the rating was decreased to ‘Moderately Satisfactory’). Page 26 of 47 The World Bank Enhanced Road Access Project (P145545) by LTA in a new template developed for SCRTP and MOF ACDMD managed to submit it to the World Bank after review and verification, the lack of handover from the PMC to MOF ACDMD and TISCD meant that there were some gaps in the project history, leading to ineffective M&E implementation. M&E Utilization 61. The M&E findings were regularly shared with various stakeholders through the World Bank’s Aide Memoires and ISRs after each implementation support mission. The M&E information influenced positive shifts in the implementation direction through the restructuring and additional financing in 2018. The M&E data were used to provide evidence of achievement of the project’s outcomes of improved connectivity both through upgrading of roads and replacement of water crossings to improved standards. In addition, the M&E arrangements under ERAP beyond July 2019 have been institutionalized, with TISCD established and providing oversight and support in M&E. 62. The restructuring in April 2020 could have been used to formally revise the target values throughout the Results Framework. The final target values for the first and second PDO indicators and the second, third, fourth, fifth, and seventh intermediate indicators were overachieved from 140 percent to 179 percent as the length of roads or the number of water crossings financed under ERAP became longer or larger compared to what was intended at the restructuring and additional financing in May 2018. The transfer of WCR Lot 2b from CRWCR to ERAP could have been reflected not only in the ERAP restructuring in April 2020, but also in the CRWCR restructuring in May 2020, given that the contract was signed in November 2019.33 It should be noted that even if this transfer were reflected in the respective restructurings, the first revised PDO and the second revised intermediate indicators would have been fully achieved. Justification of Overall Rating of Quality of M&E 63. Based on the above, the overall quality of M&E is rated Modest. 33This is in line with the CRWCR ICR, which notes that the CRWCR restructuring in May 2020 could have been used to formally revised the target values for the relevant PDO and intermediate indicators. Page 27 of 47 The World Bank Enhanced Road Access Project (P145545) B. ENVIRONMENTAL, SOCIAL, AND FIDUCIARY COMPLIANCE 64. At appraisal, ERAP triggered three World Bank safeguards policies: (i) Environmental Assessment (OP/BP 4.01), (ii) Indigenous Peoples (OP/BP 4.10), and (iii) Involuntary Resettlement (OP/BP 4.12); however, it was later decided not to typically trigger OP/BP 4.10 in the generally homogeneous island nations including Samoa and this was reflected at the restructuring and additional financing in 2018. The project was rated with an Environmental Assessment of Category B and adhered to the World Bank requirements for environmental and social safeguards. During preparation, the Environmental and Social Safeguards Assessment Framework and the Land Acquisition and Resettlement Framework were prepared and disclosed in-country on June 24, 2013, and the World Bank’s InfoShop on July 30, 2013, respectively. During implementation, the Environmental and Social Management Framework was prepared and disclosed on August 31, 2016. In addition, Environmental Management Plans (EMPs) were prepared for the Vaitele Street and Leone Bridge works, while Environmental and Social Management Plans (ESMPs) were prepared for the Mali’oli’o Bridge and Access Road, WCR Package 1 (which includes Lot 2b), Moamoa Crossing, and Aia and Nu’usuatia Bridges works. EMPs or ESMPs served as the basis for the contractor’s EMPs or contractor’s ESMPs. They were also annexed to the Preliminary Environmental Assessment Reports, which were prepared to obtain development consents from the Planning and Urban Management Agency. Further, Social Impact Assessment was prepared for the Vaitele Street works, while Abbreviated Resettlement Action Plans (ARAPs) were prepared for the Mali’oli’o Bridge and access road and WCR Package 1 works. 65. Environmental safeguards compliance was overall Satisfactory. Aside from Leone Bridge, which was built by an international contractor, all remaining civil works were completed by national contractors with mixed environmental and occupational health and safety (OHS) performance. Key issues noted in the Aide Memoires in early years of implementation included (i) not obtaining complete development consent for the Vaitele Street works before the works began, (ii) noise management for the Leone Bridge reconstruction and removal works, and (iii) quarry management and materials sourcing from closed or unregistered quarries. The third issue was a significant OHS concern under ERAP and other transport projects in Samoa with many quarries not safely established or operated. This resulted in a subsequent capacity-building intervention on quarry safety in Samoa. During the COVID-19 pandemic, LTA provided a series of drone-captured aerial photos of construction sites at Aia and Nu’usuatia Bridges. These helped identify issues, including (i) earthworks established within the stream, (ii) poor sediment control procedures, and (iii) construction machinery traversing the streams and dewatering of construction voids. This also highlighted the relatively low environmental and OHS capacity of the smaller national contractors and the need for closer oversight from the supervision engineer. OHS hazards associated with civil works were generally low; however, there were some significant risks arising during works again reflecting the low capacity of national contractors. Centerline works along WCR combined with inadequate traffic control posed a significant risk to both workers (from passing traffic) and community safety (for example, excavator swing radius encroaching into the traffic lane). A serious incident involving a crane tip over occurred during Mali’oli’o Bridge construction and it was fortunate that no worker was seriously injured or killed. The World Bank continues to provide capacity support on OHS to national contractors and to the Ministry of Commerce, Industry, and Labor, which is responsible for OHS. Notwithstanding, the Aide Memoire of February 2019 commended the Mali’oli’o Bridge contractor for its diligent approach to site OHS, including induction and management of visitors, highlighting that it is discrete high-hazard activities that need to be better managed. 66. The social safeguards management system was well established. Compensation for 13 lots affected by Mali’oli’o Bridge and access road works, as required in the ARAP, was paid before commencement of civil works. Compensation for the loss of lands and non-land assets for WCR Lot 2b was also fully disbursed by April 30, 2020. No permanent land acquisition was required for Moamoa Crossing and Aia and Nu’usuatia Bridges, as the works were Page 28 of 47 The World Bank Enhanced Road Access Project (P145545) carried out on the footprints of the crossings that were replaced. While there were temporary impacts and some loss of trees and crops and minor structures associated with diversion roads and temporary crossings for Moamoa and Nu’usuatia (not for Aia where temporary crossing was not needed), mitigation of these impacts was addressed in the ESMPs and no ARAPs were required for the three crossings. A Grievance and Complaint Logging System (GCLS) was used for all civil works contracts. The GCLS was regularly updated by the LTA’s safeguards officer. Information about accessing the CGLS webpage was included on LTA’s Facebook site and public notice boards in the project areas. The task team provided training on the GCLS to upload previous complaints into the system. Complaints received directly by the contractor were being recorded in the contractor’s register. Complaints were related to requests for information about the works schedules, boundary of the road reserve, and compensation rates for trees and crops. These were dealt with adequately. The GCLS was replaced by a simplified Excel-based grievance redress mechanism (GRM) in the last year of implementation. 67. Procurement under ERAP was carried out in accordance with the World Bank’s Procurement Guidelines, relevant provisions in the Financing Agreement, and the project’s Procurement Plan. In January 2017, procurement procedural errors (for example, not consistently submitting procurement packages for approval or review that follow the World Bank’s guidelines, resulting in the need for extensive follow-up and additional implementation support) and lengthy delays were noted as a reason to downgrade the procurement risk rating from Moderately Satisfactory to Moderately Unsatisfactory. However, the rating was increased to Moderately Satisfactory in November 2017 due to positive progress in taking measures to address capacity shortfalls and concurrent implementation progress. The project was also transitioned to using the Systematic Tracking of Exchanges in Procurement (STEP) tool. This Moderately Satisfactory rating was maintained until project closure. 68. A major issue cutting across the IDA portfolio and affecting CRWCR was the handling of contract tax liabilities. The application of taxes to project contracts previously caused delays or an inability to complete procurement for multiple contracts. In April 2017, GoS confirmed that all contracts should be inclusive of all taxes (direct and indirect), with LTA/MOF deducting tax liabilities from contract payment obligations to the Ministry of Revenue. To avoid issues and delays at contract negotiations, it was agreed that LTA/MOF would involve the Attorney General’s Office and the Tax Unit of the Revenue Division in early review of Requests for Proposals and Bidding Documents (including draft contract documents) to ensure consistency of language on taxes (including withholding tax). 69. One of the key FM issues encountered during implementation was excessive burn rate of the PMC contract compared to the rate of project progress. The PMC contract was time-based; however, invoices were raised for the maximum monthly amount with no timesheets provided showing actual time worked. This led to an Integrity Vice Presidency investigation concerning payments related to two consultant contracts (one under ERAP and the other under CRWCR). The matter was raised as questionable expenditures and investigation and analysis into all the contract invoices and payments performed, leading the World Bank to declare ineligible expenditures. On November 14, 2016, the issue was reported to MOF, which oversaw the resulting corrective actions taken. Subsequently, MOF repaid the declared ineligible expenditures. 70. In June 2017, FM responsibilities handled by the PMC were transferred to MOF ACDMD. In January 2017, the increasing frequency of late submission of financial reports, lack of adequate information in the financial reports, and declared ineligible expenditures were noted as reasons to downgrade the FM rating from Moderately Satisfactory to Moderately Unsatisfactory. However, in August 2017, the rating was increased to Moderately Satisfactory due to the improved quality of the audited financial statements and unaudited interim financial reports (IFRs) to include adequate Page 29 of 47 The World Bank Enhanced Road Access Project (P145545) information, improved timeliness of submission of IFRs, action and resolution of the declared ineligible expenditures, and the Designated Account being active. This shows that the change in FM arrangements helped lead to improved governance. This Moderately Satisfactory rating was maintained until the project closure. 71. An acceptable FM system was maintained throughout implementation; however, identification of additional project savings in September 2021 led to the 12-month extension of the project’s closing date to October 31, 2022. All IFRs up to the quarter ending December 31, 2022, have been submitted and accepted. All required audited project financial statements up to the year ending June 30, 2022, have been submitted and accepted. The audits were conducted in compliance with International Standards on Auditing, providing opinion on the project financial statements, such as Statement of Cash Receipts and Payments and Statement of Comparison of Actual and Budget, along with the relevant notes to the financial statements. The auditor provided unqualified (clean) opinions for them. The auditors recommended MOF to perform value added goods and services tax reconciliation for all payments made to the WCR supervision consultant, and results will be reported in the final project audit, which will cover eight-month period (including the four-month grace period) from July 1, 2022, to February 28, 2023, and will be due on December 31, 2023. C. BANK PERFORMANCE Quality at Entry 72. The task team considered lessons learned from SIAM-2, PTRP, and CRWCR including (i) designing structural investments to incorporate the natural hazards and climate risks they will face and not merely to previous standards, (ii) using proven and familiar technologies for designs and procedures for civil works, (iii) closely coordinating with other donors for delivering assistance efficiency and effectively, and (iv) providing intensive implementation support for emergency operations. The team adopted a systematic approach by integrating infrastructure investments with complementary technical assistance activities. Although the project was prepared under emergency procedures, it was strategically relevant to GoS development priorities and aligned with the World Bank’s guiding documents at the time of preparation. As noted in paragraph 48, the ‘Moderate’ institutional capacity risk at appraisal was considered low; however, overall, the team properly identified the risks of implementing a large transport infrastructure project and prepared appropriate mitigation measures. The project’s preparation was overseen on the World Bank side by one task team leader (TTL) who had worked on projects in similar contexts, including CRWCR. Quality of Supervision 73. The task team conducted 22 implementation support missions, including the launch mission in June 2014 and the mid-term review mission in August 2017. For most of the project implementation period, the team conducted project implementation support missions quarterly rather than semiannually. TTLs were changed three times during its nine years of implementation, which could have meant some loss of ‘institutional knowledge’ or history of the project. This was mitigated through (i) the incoming TTL working as co-TTL with the outgoing TTL for a period in the first instance, (ii) the outgoing TTL and co-TTL continuing as TTL and co-TTL for SCRTP in the second instance, and (iii) the incoming TTL being the former TTL for ERAP with the same co-TTL maintained in the third instance. The Borrower’s draft ICR was provided on October 6, 2022; however, the revised version is still pending at the time of finalizing this ICR. 74. The task team and the Country Management Unit worked proactively with the GoS counterpart to respond to the evolving needs of the country’s transport sector throughout implementation. The six project restructurings, Page 30 of 47 The World Bank Enhanced Road Access Project (P145545) synergies with other World Bank-funded projects, change in implementation modality, and frequent missions are all signs that the team mobilized and brought constructive solutions to move the project forward. It should also be noted that, despite the challenges flagged with implementation, safeguards, the need to modify the Results Framework, and the need to extend the project’s closing date four times; the progress towards achieving the PDO and Overall Implementation Progress were rated as either Satisfactory or Moderately Satisfactory in the ISRs through the project lifetime. The team should be commended for its continuous high level of commitment to the project. Justification of Overall Rating of Bank Performance 75. Based on the above, the overall Bank performance is rated Satisfactory. D. RISK TO DEVELOPMENT OUTCOME 76. At completion, the risk to development outcome is considered Substantial due to frequent severe weather events in Samoa. ERAP substantially improved the climate resilience of the project roads and bridges and made a transformative impact in enhancing local capacity to develop a more climate-resilient road network. Natural hazards and climate risks continue to pose threats to the sustainability of the investments. The likelihood of future severe weather events in Samoa is almost certain, and the impact of these events could potentially be catastrophic. The design of climate resilient infrastructure investments under ERAP was guided by the Vulnerability Assessment and Climate Resilient Road Strategy prepared under CRWCR. The upgraded roads and bridges are covered under the Government- funded area-based annual routine maintenance. However, with the increasing frequency and intensity of extreme weather and climate events, there is still a substantial risk that the segment of the project roads and bridges upgraded through ERAP could be affected within its lifespan, as already witnessed at Moamoa Crossing. V. LESSONS AND RECOMMENDATIONS 77. In smaller and highly exposed economies, a thematically structured yet flexible design in terms of PDO (as ERAP had) may be better to accommodate likely changes. While the guidance is for the scope of the PDO to be specific, having a broader PDO can provide the flexibility to accommodate emerging needs, which may only become apparent during implementation. In this case, it was possible to add the Mali’oli’o Bridge and access road, three water crossings on Upolu, and WCR Lot 2b to ERAP during implementation. This was possible as the PDO for ERAP was not too restrictive by focusing on “critical roads and bridges in Samoa.” This ERAP design feature has been replicated under the subsequent SCRTP and SARIP. 78. Intensive implementation support and careful expectation management are required for an emergency operation. The World Bank’s longstanding engagement in the Samoa’s transport sector helped put in place the foundations for quick preparation of this emergency project. However, it took 45 months from the Board approval in October 2013 to the opening of Leone Bridge, the only ERAP investment for emergency response, in July 2017, due mainly to slow progress of design, performance challenges of the PMC, and the frequent changes in counterpart staff. The proactivity and efforts made by the team show that for a major infrastructure project such as ERAP, intensive implementation support is required, and sufficient budgets need to be allocated to make it happen. This is particularly the case for an emergency project that is put together over a shorter period and as a result, some details are left to be defined during implementation. Managing expectation from both internal and external stakeholders is also key due to the possible perception that an emergency project can be implemented quicker and not so much extension of the Page 31 of 47 The World Bank Enhanced Road Access Project (P145545) project’s closing date is required. These were not applied to ERAP as the project included both the emergency and non- emergency investments and the objective transitioned from responding to a specific disaster to enhanced connectivity through improved climate resilience after its only emergency works for Leone Bridge were completed in mid-2017. 79. A design-phase road safety audit is critical to avoid extra cost and time for rectifying some road safety deficiencies that may be identified after construction. In March 2021, the post-construction road safety audit identified that culvert driveways headwalls on WCR were a high-risk safety concern. As a result, ERAP extended its closing date to replace the vertical culvert headwall on the departure side with a sloping driveable endwall. While this contributed to improving road safety on WCR, it also led to rectification works in the amount of US$0.49 million and extension of the closing date by 18 months. It is recommended that a road safety audit be conducted at baseline, concept design, detailed design, and post-construction phases wherever possible, ensuring that climate resilience measures also address road safety and do not pose risks for road users. 80. It is important to conduct an economic analysis to justify investments that are identified during implementation. During design, hydraulic opening of Moamoa Crossing was reduced by half from the consultant’s initial recommendation of 16.2m2 to 8.1m2. While the design modification was based on the then available cost, catchment size, and level of road importance, it was not based on a robust cost-benefit analysis, which was noted in the PAD as one of the four factors to be considered when selecting roads and bridges for improvement under ERAP. To justify investments, economic analysis is critical, and this is especially the case for the Moamoa Crossing investment, which yields the highest EIRR among all the seven investments due mainly to the relatively higher traffic of 6,831 vehicles per day (which affects benefits) and the smallest cost of investments (see annex 4 for further details). 81. The achievement of the project outcomes directly depends on the project management support. In weak capacity environments, this is always a challenge—even more so when several donor-funded projects compete for the limited number of consultants who can perform these roles—hence utilization of the same PMC for CRWCR and ERAP and creation of centralized support arrangements under SCRTP. In addition, as illustrated in the theory of change, the project assumed that the PMC would have sufficient capacity to assist with project management. However, this was not the case and the PMC’s performance challenges led to poor outcomes, while also resulted in the high number of missions (exceeding the requirements of two implementation support missions per year) and additional capacity support not envisaged during preparation. It is also important to design an outcome-focused Results Framework from the outset for a better project implementation monitoring and evaluation at completion. 82. Dedicated safeguards personnel should be in place to allow for effective facilitation and coordination throughout preparation and implementation phases. ERAP required substantial safeguards input. Some safeguards issues were exacerbated due to weak project management and lack of safeguard counterparts within LTA. Although a consulting firm was initially hired to assist LTA during implementation, it was not specifically tasked with safeguards responsibilities. While the situation improved once a safeguards specialist was appointed, this was only after the mid- term review. Further, safeguards staff within LTA PMD and TISCD, as well as the high-level specialist under CTSSU were only involved in the project at a later stage. Safeguards personnel dedicated to the project should be part of the project from the beginning to ensure design optimization, reduce land requirements, and facilitate effective community . consultations and documentation. . Page 32 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS A. RESULTS INDICATORS A.1 PDO Indicators Objective/Outcome: Improved connectivity through rehabilitation or construction of roads to improved standards Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Improved connectivity Kilometers 2.30 3.90 5.72 through rehabilitation or construction of roads to 31-May-2018 31-Oct-2021 31-Oct-2022 improved standards Comments (achievements against targets): Target exceeded (147 percent). This new indicator was added in the restructuring and additional financing in May 2018. Of the original target of 3.90 km, 2.30 km of Vaitele Street was rehabilitated and 1.60 km of Mali’oli’o Bridge access road was constructed to improved standards, such as through raising the road elevation, strengthening the pavement, and increasing the drainage capacity, under ERAP. In addition, 1.82 km of WCR Lot 2b, which was transferred from CRWCR to ERAP, was rehabilitated to improved standards under ERAP. Further, the ERAP investments in the project roads enhanced road network connectivity, as demonstrated in the fourth revised intermediate indicator ‘Targeted locations where traffic flows will have reduced disruptions’. Objective/Outcome: Improved connectivity through rehabilitation or replacement of water crossings to improved standards Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Page 33 of 47 The World Bank Enhanced Road Access Project (P145545) Improved connectivity Number 1.00 3.00 5.00 through rehabilitation or replacement of water 31-May-2018 31-Oct-2021 31-Oct-2022 crossings to improved standards Comments (achievements against targets): Target exceeded (167 percent). This new indicator was added in the restructuring and additional financing in May 2018. Water crossings at Leone, Mali’oli’o, Moamoa, Aia, and Nuusuatia were replaced to improved standards, such as through single span designs, raised crossings, and scour protection, under ERAP. These water crossings enhanced road network connectivity by providing year-round access to road users and this is reflected in the fourth revised intermediate indicator ‘Targeted locations where traffic flows will have reduced disruptions’. A.2 Intermediate Results Indicators Component: Road and Bridge Reconstruction Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Roads constructed Kilometers 0.00 1.60 1.60 31-May-2018 31-Oct-2021 31-Oct-2022 Comments (achievements against targets): Target fully achieved (100 percent). This new indicator was added in the restructuring and additional financing in May 2018. As per the original target, 1.60 km of Mali’oli’o Bridge access road was constructed under ERAP. Page 34 of 47 The World Bank Enhanced Road Access Project (P145545) Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Roads rehablitated Kilometers 2.30 2.30 4.12 31-May-2018 31-Oct-2021 31-Oct-2022 Comments (achievements against targets): Target exceeded (179 percent). This new indicator was added in the restructuring and additional financing in May 2018. In addition to the original target of 2.30 km (which represents the length of Vaitele Street already rehabilitated prior to the restructuring and additional financing in May 2018), 1.82 km of WCR Lot 2b was also rehabilitated under ERAP. Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Water crossings replaced or Number 1.00 3.00 5.00 rehabilitated 31-May-2018 31-Oct-2021 31-Oct-2022 Comments (achievements against targets): Target exceeded (167 percent). This new indicator was added in the restructuring and additional financing in May 2018. Water crossings at Leone, Mali’oli’o, Moamoa, Aia, and Nuusuatia were replaced to improved standards under ERAP. Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Page 35 of 47 The World Bank Enhanced Road Access Project (P145545) Targeted locations where Number 3.00 4.00 7.00 traffic flows will have reduced disruptions 31-May-2018 31-Oct-2021 31-Oct-2022 Comments (achievements against targets): Target exceeded (175 percent). This new indicator was added in the restructuring and additional financing in May 2018. In addition to the original target of four locations, traffic flows have reduced disruptions at the additional three locations where the ERAP investments were made. Component: Technical Assistance Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Instances when project Number 4.00 5.00 8.00 designs are informed by access audits 31-May-2018 31-Oct-2021 31-Oct-2022 Comments (achievements against targets): Target exceeded (160 percent). This new indicator was added in the restructuring and additional financing in May 2018. Designs of Leone Bridge, Central Cross Island Road, Vaitele Street, Mali’oli’o Bridge and access road, WCR Lot 2b, Moamoa Crossing, Aia Bridge, and Nuusuatia Bridge were informed by access audits. Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Grievances registered related Percentage 100.00 100.00 100.00 Page 36 of 47 The World Bank Enhanced Road Access Project (P145545) to delivery of project 31-May-2018 31-Oct-2021 31-Oct-2022 benefits that are addressed Comments (achievements against targets): Fully achieved (100 percent). This new indicator was added in the restructuring and additional financing in May 2018. LTA uploaded complaints onto the Grievance Complaints Logging System (until the last year of implementation) and an simplified excel-based GRM (in the last year of implementation). Complaints were dealt with adequately. Formally Revised Actual Achieved at Indicator Name Unit of Measure Baseline Original Target Target Completion Number of gender Number 5.00 5.00 7.00 responsive design features 31-May-2018 31-Oct-2021 31-Oct-2022 Comments (achievements against targets): Target exceeded (140 percent). This new indicator was added in the restructuring and additional financing in May 2018. Gender responsive design features were incorporated into the designs of Central Cross Island Road, Vaitele Street, Leone Bridge, Mali’oli’o Bridge and access road, Moamoa Crossing, Aia Bridge, and Nuusuatia Bridge. Page 37 of 47 The World Bank Enhanced Road Access Project (P145545) B. KEY OUTPUTS BY COMPONENT Objective/Outcome 1: Restore key road sector assets damaged by extreme weather events and enhance the climate resilience of critical roads and bridges in Samoa 1. Improved connectivity through rehabilitation or construction of roads to improved standards Outcome Indicators 2. Improved connectivity through rehabilitation or replacement of water crossings to improved standards Component 1 1. Roads constructed 2. Roads rehabilitated 3. Water crossings replaced or rehabilitated 4. Targeted locations where traffic flows will have reduced disruptions Intermediate Results Indicators 5. Instances when project designs are informed by access audits Citizen engagement 6. Grievances registered related to delivery of project benefits that are addressed Gender inclusion 7. Number of gender-responsive design features Component 1 1. 1.60 km of a road constructed 2. 4.12 km of roads rehabilitated 3. Five water crossings replaced or rehabilitated 4. Traffic flows at seven locations less disrupted Key Outputs by Component 5. Eight designs for Leone Bridge, Central Cross Island Road, Vaitele Street, Mali’oli’o Bridge and access (linked to the achievement of road, WCR Lot 2b, Moamoa Crossing, Aia Bridge, and Nu’usuatia Bridge informed by access audits the Objective/Outcome 1) Citizen engagement 6. 100 percent of grievances registered related to delivery of project benefits addressed Gender inclusion 7. Gender-responsive design features incorporated into seven designs for Central Cross Island Road, Vaitele Street, Leone Bridge, Mali’oli’o Bridge and access road, Moamoa Crossing, Aia Bridge, and Nu’usuatia Bridge Page 38 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 2. BANK LENDING AND IMPLEMENTATION SUPPORT/SUPERVISION A. TASK TEAM MEMBERS Name Role Preparation James Reichert Task Team Leader Sean David Michaels Team Member Miriam Witana Procurement Specialist Stephen Paul Hartung Financial Management Specialist Victoria Lazaro Social Specialist Gerardo Parco Environmental Specialist Isabella Micali Drossos Senior Counsel Marjorie Mpundu Senior Counsel Kuana Tupu Team Member Shruti Pandya Team Member MacKenzie Fillow Legal Support Consultant John Lowsby Civil Engineering Consultant Supervision/ICR Sean David Michaels Task Team Leader (2016–2019, 2022–2023) Rodrigo Archondo-Callao Task Team Leader (2019–2021) James Reichert Task Team Leader (2014–2016) Senior Transport Sector Adviser (2022) Florentina-Alina Burlacu Co-Task Team Leader (2020–2023) Keelye Hanmer Co-Task Team Leader (2019) Oliver Whalley Co-Task Team Leader (2017–2018) Eric Leonard Blackburn Procurement Specialist Janet Virginia Gamarra Rupa Financial Management Specialist Thomas John Callander Social Specialist Craig Andrew Clark Social Specialist Nicholas John Valentine Environmental Specialist Rosemary Alexandra Davey Environmental Specialist Nikolai Alexei Sviedrys Wittich Procurement Team Nicholas Gerard Williams Procurement Team Maeva Batham Vaai Liaison Officer Lynn Ioana Malolua Team Member John Lowsby Civil Engineering Consultant Page 39 of 47 The World Bank Enhanced Road Access Project (P145545) B. STAFF TIME AND COST Staff Time and Cost Stage of Project Cycle No. of staff weeks US$ (including travel and consultant costs) Preparation FY13 4.725 19,310.55 FY14 6.512 69,939.62 FY15 1.150 3,115.47 FY16 0 0.00 Total 12.39 92,365.64 Supervision/ICR FY14 0 10,905.60 FY15 10.191 98,627.34 FY16 18.743 95,414.51 FY17 23.290 108,465.47 FY18 23.672 153,171.86 FY19 19.916 167,545.50 FY20 11.141 152,195.69 FY21 21.179 154,245.23 FY22 9.397 73,408.96 FY23 16.115 108,967.83 Total 153.64 1,122,947.99 Page 40 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 3. PROJECT COST BY COMPONENT Amount at Approvala Actual at Project Closing Percentage of Approval (%) Components (US$, million) (US$, million) IDA GoAb Total IDA GoA Total IDA GoA Total Component 1: Road and Bridge 17.70 10.90c 28.60 16.21 8.65 24.87 92 79 87 Reconstruction Component 2: 1.30 0.70 2.00 1.13 0.60 1.73 87 86 87 Technical Assistance Component 3: Project 1.00 0.40 1.40 0.70 0.37 1.07 70 93 76 Management Total 20.00 12.00 32.00 18.04 9.63 27.67 90 80 86 Source: a. PAD Notes: b. The GoA contribution after the restructuring and additional financing in May 2018 became US$9.71 million, which consisted of US$8.61 million for Component 1, US$0.70 million for Component 2, and US$0.40 million for Component 3 (see paragraph 17 for further details); and c. In addition, GoA directly funded the supply of modular bridges for Aia and Nu’usuatia in the amount of US$1.07 million. Page 41 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 4. EFFICIENCY ANALYSIS 1. An ex post economic analysis conducted at completion shows an EIRR of 18.5 percent and a NPV of US$29.7 million, up from the EIRR of 16 percent and NPV of US$19.7 million at appraisal and the EIRR of 15.6 percent and NPV of US$20.0 million at the restructuring and additional financing in May 2018. It follows the same methodology used at appraisal and the restructuring and additional financing and focuses on the economic appraisal of Component 1, for which investments amounted to 90 percent of project costs at completion. The analysis based on the actual investment costs, implementation schedule, and latest traffic. As with the case at appraisal and the restructuring and additional financing, it covers a 23-year period from 2013 to 2035 and uses a discount rate of 5 percent. The benefits quantified included the reduction of (i) vehicle operating costs, (ii) passenger time costs, and (iii) disruptions due to improved climate resilience.34 2. The analysis was based on observed data and informed assumptions on the abovementioned economic benefits for with and without project scenarios. the key differences between the economic analysis at appraisal and the restructuring and additional financing and that at completion include (i) the addition of WCR Lot 2b, Nu’usuatia Bridge, Aia Bridge, and Moamoa Crossing to the project scope; (ii) the change to the investment schedule from the period of 2014 to 2016 to 2015 to 2022; and (iii) lower actual investment costs for Vaitele Street, Leone Bridge, and Mali’oli’o Bridge and access road than estimated at the restructuring and additional financing, as presented in table 4.1. Table 4.1. Cost Comparison by Investment (US$, thousand) Investment Appraisal Restructuring and Completion (2013) Additional Financing (2022) (2018) Vaitele Street 9,500 9,020 7,745 Leone Bridge 3,000 4,376 3,890 Mali’oli’o Bridge and access road 3,000 4,500 3,550 Subtotal 15,500 17,896 15,186 WCR Lot 2b — — 2,340 Nu’usuatia Bridge — — 1,330 Aia Bridge — — 1,285 Moamoa Crossing — — 739 Total 15,500 17,896 20,879 Source: PAD, Restructuring Paper, and IFR for Q4 2022. Note: The costs of Nu’usuatia and Aia Bridges include those for supplying modular bridges in the amount of US$1.07 million, which was procured separately from the civil works contract. 3. Traffic counts were conducted under ERAP from August to October 2021 at 80 stations on Upolu and in February 2022 at 20 stations on Savai’i. For each station, traffic was counted for 24 hours over seven days. Table 4.2 presents the average daily traffic from the traffic counts for each ERAP investment location. 34 Although not quantified, it is considered that ERAP had a benefit from improved road safety through engineering measures. Page 42 of 47 The World Bank Enhanced Road Access Project (P145545) Table 4.2. Average Daily Traffic from 2021/2022 Traffic Counts Investments Average Daily Traffic Note Vaitele Street 17,912 Traffic in 2021. Average daily off-peak traffic of 16,613 (92.7 percent of the average daily traffic) was used for the analysis to be consistent with the earlier analyses. Leone Bridge 5,774 Traffic in 2021. Mali’oli’o Bridge and access road 851 Traffic in 2022. WCR Lot 2b 9,009 Traffic in 2021. Nu’usuatia Bridge 1,379 Traffic in 2021. Aia Bridge 597 Traffic in 2021. Moamoa Crossing 6,831 Traffic in 2021. 4. Total EIRR was 20.1 percent for the three priority investments and 18.5 percent for the seven investments at completion. These increased from the EIRR of 16 percent at appraisal and 15.6 percent at the restructuring and additional financing (table 4.3). Table 4.3. EIRR Comparison by Investment (%) Investment Appraisal Restructuring and Completion (2013) Additional Financing (2022) (2018) Vaitele Street 10 10.3 12.4 Leone Bridge 49 35.2 41.7 Mali’oli’o Bridge and access road 4 2.3 7.7 Subtotal 16 15.6 20.1 WCR Lot 2b — — 7.0 Nu’usuatia Bridge — — 8.2 Aia Bridge — — 3.6 Moamoa Crossing — — 48.8 Total 16 15.6 18.5 Page 43 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 5. BORROWER, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS 1. The ICR was shared with GoS and DFAT for review and comments on March 28, 2023. The following comments were received from MOF on April 14, 2023, while no comments were received from DFAT: Please find attached MOF’s comments on the ICR report received. We made note of the progress and findings, our comments are specifically on the role of MOF especially the ACDMD in the project’s implementation and monitoring oversight. It is very important for the Bank to note for future reporting as well, that the roles perform and expected of the division is integrated/incorporated in any assessments and reports. Given the limited number of staff in the division that manage/monitor the Aid Portfolio including the Bank’s portfolio. Comments To consider the changes made when the PMC contract completed and transitioned to the MOF ACDMD and TISCD to continue the roles previously performed by the PMC. This change impacted on the progress/results on FM, procurement and M & E in later part of the project and the ICR. The changes whilst positively impacted on the project’s progress to completion, it also impacted on the capacity of the ACDMD, where limited number of trained/experienced staff supported the functions and had implications on performance on other projects in the Aid portfolio. The ACDMD is directly responsible to perform the responsibilities require of MOF as the EA for this project and all other funded projects. Reflect the ACDMD MOF support – FM, M & E verification and submissions etc. MOF ACDMD is also part of this M & E process. The progress reports prepared and submitted by the TISCD were reviewed and verified by MOF (including changes/clarifications sought on progress from the TISCD and IAs) and MOF submits to the Bank. The bidders (consultants/contractors) are obligated to do their own due diligence and research on the applicable laws of Samoa. Including the tax obligations and treatment of taxes. Only withholding taxes were deducted directly by MOF, and ONLY for the claims that were processed through the Government financial management systems as per requirement of the tax laws. The funds deducted were transferred directly to the Revenue accounts. Page 44 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 6. SUPPORTING DOCUMENTS Government of Samoa. 2022. Pathway for the Development of Samoa FY2021/22–FY2025/26. https://www.mof.gov.ws/wp-content/uploads/2022/03/MOF_PATHWAY-DEVELOPMENT-SAMOA.pdf. Government of Samoa. Population and Housing Census 2011. Analytical Report. Government of Samoa. 2021. Samoa 2040, Transforming Samoa to a higher growth path. https://www.mof.gov.ws/wp-content/uploads/2021/03/Samoa-2040-Final.pdf. Government of Samoa. 2023. Transport and Infrastructure Sector Plan 2022/2023–2027/2028 (draft). Government of Samoa and United Nations Development Programme. 2016. Samoa Hardship and Poverty Report: Analysis of the 2013/2014 Household Income and Expenditure Survey. https://www.undp.org/samoa/publications/samoa-hardship-and-poverty-report. Land Transport Authority. 2015. Social Beneficiary Survey for ERAP and CRWCR. Land Transport Authority. Corporate Plan 2023–2026. https://lta.gov.ws/wp-content/uploads/2023/01/Corporate-Plan-2023-2026.pdf. Pacific Catastrophe Risk Assessment and Financing Initiative. 2011. Country Risk Profile: Samoa. Pacific Climate Change Science Program. 2011. Climate Change in the Pacific: Scientific Assessment and New Research, Volume 2: Country Reports. Samoa: Strategic Program for Climate Resilience prepared for the Pilot Program for Climate Resilience. 2011. World Bank. Aide Memoires for ERAP. World Bank. Implementation Status and Results Reports for ERAP. World Bank. 2013. Financing Agreement for ERAP. https://documents1.worldbank.org/curated/en/693631468303589712/pdf/RAD1267186163.pdf. World Bank. 2013. Project Appraisal Document for ERAP. Report No: 78411-WS. https://documents1.worldbank.org/curated/en/142021468304469637/pdf/784110PAD0Samo0100OUO0900Box 379843B.pdf. World Bank. 2016. Restructuring Paper on a Proposed Project Restructuring of ERAP. Report No: RES22088. World Bank. 2017. Results Brief. Improving Access and Disaster Preparedness for Persons with Disabilities in Samoa. https://www.worldbank.org/en/results/2017/12/01/improving-access-and-disaster-preparedness-for-persons- with-disabilities-in-samoa. Page 45 of 47 The World Bank Enhanced Road Access Project (P145545) World Bank. 2018. Project Paper on a Proposed Restructuring and Additional Financing of ERAP. Report No: PAD2699. World Bank. 2018. Restructuring Paper on a Proposed Project Restructuring of ERAP. Report No: RES29944. https://documents1.worldbank.org/curated/en/180851540519074344/pdf/Disclosable-Restructuring-Paper- Enhanced-Road-Access-Project-P145545.pdf. World Bank. 2020. Restructuring Paper on a Proposed Project Restructuring of ERAP. Report No: RES41313. https://documents1.worldbank.org/curated/en/800501587594617131/pdf/Disclosable-Restructuring-Paper- Enhanced-Road-Access-Project-P145545.pdf. World Bank. 2021. Implementation Completion and Results Report for CRWCR. Report No. ICR00005112. https://documents1.worldbank.org/curated/en/122611624539758002/pdf/Samoa-Enhancing-the-Climate- Resilience-of-the-West-Coast-Road-Project.pdf. World Bank. 2021. Restructuring Paper on a Proposed Project Restructuring of ERAP. Report No: RES46284. https://documents1.worldbank.org/curated/en/955081618929252469/pdf/Disclosable-Restructuring-Paper- Enhanced-Road-Access-Project-P145545.pdf. World Bank. 2021. Restructuring Paper on a Proposed Project Restructuring of ERAP. Report No: RES48641. https://documents1.worldbank.org/curated/en/377381635307572143/pdf/Disclosable-Restructuring-Paper- Enhanced-Road-Access-Project-P145545.pdf. World Bank Group. Country Partnership Strategy for Samoa FY2012–FY2016. Report No: 67194. https://documents1.worldbank.org/curated/en/518881468306858961/pdf/671940CAS0P1300Official0Use0Only 090.pdf. World Bank Group. Regional Partnership Framework for Kiribati, Republic of Nauru, Republic of the Marshall Islands, Federated States of Micronesia, Republic of Palau, Independent State of Samoa, Kingdom of Tonga, Tuvalu, and Vanuatu FY2017–FY2021. https://openknowledge.worldbank.org/handle/10986/28546. Page 46 of 47 The World Bank Enhanced Road Access Project (P145545) ANNEX 7. PROJECT MAP Page 47 of 47