Document of The World Bank FOR OFFICIAL USE ONLY Report No: ICR00004946 IMPLEMENTATION COMPLETION AND RESULTS REPORT TF0A3457 ON A SMALL GRANT IN THE AMOUNT OF US$0.5 MILLION TO THE Republic of Namibia FOR Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) June 8, 2021 Poverty And Equity Global Practice Eastern and Southern Africa Region ABBREVIATIONS AND ACRONYMS CAPI Computer-Assisted Personal Interviewing ICR Implementation Completion Results Report ISR Implementation Status & Results Report NFIS Namibia Financial Inclusion Survey NHIES Namibia Household Income and Expenditure Survey NPC National Planning Commission NQAFS Namibia Quality Assurance Framework for Statistics NSA Namibia Statistics Agency NSS National Statistical System PDO Project Development Objective TFSCB Trust Fund for Statistical Capacity Building Regional Vice President: Hafez M. H. Ghanem Country Director: Marie Francoise Marie-Nelly Regional Director: Asad Alam Practice Manager: Pierella Paci Task Team Leader(s): Victor Sulla, Precious Zikhali ICR Main Contributors: Precious Zikhali, Anahit Poghosyan TABLE OF CONTENTS DATA SHEET ....................................................................... ERROR! BOOKMARK NOT DEFINED. I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES ....................................................... 3 II. OUTCOME ...................................................................................................................... 7 III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME ................................ 10 IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME .. 11 V. LESSONS LEARNED AND RECOMMENDATIONS .............................................................. 11 ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS ........................................................... 12 ANNEX 2. PROJECT COST BY COMPONENT ........................................................................... 19 ANNEX 3. RECIPIENT, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS ...... 20 ANNEX 4. SUPPORTING DOCUMENTS (IF ANY) ..................................................................... 21 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) DATA SHEET BASIC INFORMATION Product Information Project ID Project Name Collection, Analysis and Dissemination of Household P159953 Survey Data in Namibia Country Financing Instrument Namibia Investment Project Financing Original EA Category Revised EA Category Not Required (C) Not Required (C) Organizations Borrower Implementing Agency Republic of Namibia Namibia Statistics Agency Project Development Objective (PDO) Original PDO To improve the collection, analysis, and dissemination of household survey data in Namibia. FINANCING FINANCE_TBL Original Amount (US$) Revised Amount (US$) Actual Disbursed (US$) Donor Financing TF-A3457 500,000 500,000 500,000 Total 500,000 500,000 500,000 Total Project Cost 500,000 500,000 500,000 Page 1 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) KEY DATES Approval Effectiveness Original Closing Actual Closing 12-Sep-2016 23-Feb-2017 30-Jun-2018 30-Jun-2019 RESTRUCTURING AND/OR ADDITIONAL FINANCING Date(s) Amount Disbursed (US$M) Key Revisions 19-Jun-2018 0.39 Change in Results Framework Change in Loan Closing Date(s) Change in Implementation Schedule KEY RATINGS Outcome Bank Performance M&E Quality Satisfactory Satisfactory Substantial RATINGS OF PROJECT PERFORMANCE IN ISRs Actual No. Date ISR Archived DO Rating IP Rating Disbursements (US$M) 01 01-Jun-2018 Moderately Satisfactory Moderately Satisfactory 0.34 ADM STAFF Role At Approval At ICR Regional Vice President: Makhtar Diop Hafez M. H. Ghanem Country Director: Guangzhe Chen Marie Francoise Marie-Nelly Director: Ana L. Revenga Asad Alam Practice Manager: Pablo Fajnzylber Pierella Paci Task Team Leader(s): Victor Sulla, Precious Zikhali Victor Sulla, Precious Zikhali ICR Contributing Author: Precious Zikhali Page 2 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES Context 1. The Namibia Statistics Agency (NSA) has the responsibility to provide official statistics in Namibia. The Statistics Act of 2011, Act No 9 has established the NSA as an autonomous public office assigning it the mandate to provide official demographic, social and economic statistics and to coordinate statistical activities within the National Statistical System (NSS). NSA seeks to continuously strengthen its capacity to respond to many requests from government departments and agencies to address specific topics in a more detailed manner. In the context of this grant, the NSA was asked to collect more detailed information on the extent and implications of household indebtedness as well as financial inclusion. In addition, the NSA was receiving requests from line departments and other government agencies for training on the use and analysis of data that the NSA collects. 2. In response to government’s request for financial assistance, the World Bank, through a Multi Donor Trust Fund for Statistical Capacity Building (TFSCB) provided financial and technical assistance to the NSA for the collection and analysis of household survey data. The project was in line with the 2014/17 Namibia Country Partnership Strategy which had a program in the state capacity building pillar to improve the collection and use of statistics for evidence- based policy making. Broadly, the CPS, in line with the NDP4, aimed to improve execution of development plans by strengthening the national statistics system in order to enhance statistical quality, tighten linkages between budgets and NDPs, and improve systems for reporting, monitoring, and evaluation of NDP4 performance. Project Development Objectives (PDOs) 3. The broad development objective of this project was to improve the collection, analysis, and dissemination of household survey data in Namibia. The specific objectives of the grant were threefold: (i) to introduce and pilot a Household Indebtedness and Financial Inclusion survey, (ii) to conduct quality assessment, validation, and evaluation of the 2015/16 NHIES data, including post-field assessment/evaluation of the implementation of the survey, (iii) to build and enhance the agency’s analytical capacity through technical assistance and training to analyze NHIES data. Key Expected Outcomes and Outcome Indicators 4. The main expected outcomes of the project were timely availability of the pilot Household Indebtedness and Financial Inclusion Survey data. In addition, a report on the Namibia Quality Assurance Framework for Statistics (NQAFS) was to be produced, along with an assessment of the adequacy of the current design of the NHIES with the aim of making recommendations. The project aimed to achieve improved capacity by the NSA not only to design, collect, and process household surveys in a timely and cost-effective manner, but also to produce analytical outputs using the household survey data that they collect. 5. Key Project Results included: a. Timely availability of Pilot Household Indebtedness and Financial Inclusion Survey data. The project would ensure the NSA adopts best practices that support more cost-effective survey design, implementation, and data collection. The project would ensure that data from these household surveys are published in a timeous manner. Specifically, full documentation of the survey was to be compiled, and the electronic micro-data sets disseminated within 12 months of the completion of the surveys, in line with best practices. b. A Household Indebtedness and Financial Inclusion report. Linked to the first specific objective, a report would be produced from the data and this will measure the levels of household indebtedness and financial inclusion; Page 3 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) describing the type of financial products and services used by individuals that are financially included; identifying the factors that drive or constrain household indebtedness and the usage of financial products and services; and examining the impact of poverty on household indebtedness and financial inclusion and vice versa, that is, the extent to which indebtedness and financial inclusion impact poverty. It was envisaged that the report will contribute to policy dialogues around public and private sector interventions to deal with challenges of household indebtedness as well as to increase and deepen financial inclusion with the strategic objective to reducing poverty and inequality. c. A Data Quality Assessment and Validation report for the 2015/16 NHIES. Linked to the second objective, the report would summarize findings of the 2015/16 data quality assessment, identify data gaps and best practices in the current NHIES and propose various recommendations, in line with current international best practices, on ways to improve the quality of the data as well as the breadth of indicators or information collected through the NHIES. The report would assess the extent to which the NHIES meets the standards set by the Data Quality Assessment Framework, the Data Collection Processing and Dissemination Policy and Practice as well as the Code of Practice: Professional and Ethical Standards Applicable to Statistics Producers issued by the NSA in January 2015 in the Government Gazette. d. A Survey Methodology and Administrative report for the 2015/16 NHIES. Linked to the second objective, the report would document how the implementation of the survey was done in all stages of the survey from planning, field operations, data processing (including data management), data analysis and report writing. It was to provide recommendations on areas that need improvement and adjustment for the next NHIES that is planned to take place during the 2018/19 financial year. e. Production and dissemination of analytical outputs based on the 2015/16 NHIES data. A report would be produced which will present the key findings on poverty and inequality in Namibia. In addition, the report would discuss the development of the poverty lines, the design and implementation of the 2015/16 NHIES. Additional analytical outputs were to include a poverty and inequality assessment report which examines the state of poverty and inequality in the country, and identifies the drivers and barriers to poverty and inequality reduction; a report on multidimensional poverty in Namibia; a poverty map of Namibia; a child grant assessment report in response to a request by the Ministry of Gender Equality and Child Welfare; and an assessment of the distributional impacts of policies. National and regional (largely SADC) workshops with universities, researchers and policy makers working in the area of poverty and inequality will be used, amongst others, as dissemination platforms. 6. The achievement of key results was monitored through the following PDO indicators: • Cost effective design, implementation and data collection of a Household Indebtedness and Financial Inclusion Survey and indicators of data quality. • Availability and public accessibility to key statistics and Household Indebtedness and Financial Inclusion survey data in a timely manner. • Development of a robust system for data verification and quality assurance for the NHIES. • Full and timely implementation of the planned capacity building activities, including analytical outputs. Page 4 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) Components 7. The project was structured along three main components: (i) Survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey, (ii) Assessment and evaluation of the 2015/16 NHIES, and (iii) Statistical analysis and training. The details of the activities are as follows: 8. Component 1. Survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey ($260,000). This component constituted the bulk of planned activities. The independent pilot survey was planned to collect information on both household indebtedness and the extent to which the financial system is inclusive. Activities under this component included technical assistance on survey design and preparation as well as data collection. The component activities were to strengthen the NSA’s capacity to prepare and implement new and specialized surveys in response to demands from stakeholders. This component consisted of two sub-components: a. Technical assistance on survey design and preparation. The goal of this activity was to bring in knowledge, expertise, and skills on sampling, questionnaire design, field work organization, supervision, data entry, and data collection. This sub-component also provided training on the use of the Computer-Assisted Personal Interviewing (CAPI) tool. A system of data quality assurance was built into the sub-component, along with data dissemination. b. Data collection. This sub-component provided technical assistance to conduct the field work for the two surveys. Activities included training of interviewers and support in piloting the surveys. 9. Component 2. Assessment and evaluation of the 2015/16 NHIES ($60,000). This component was designed to assess the 2015/16 NHIES for its quality of the data as well as processes around the survey implementation, due to differences with previous surveys. It was important to assess whether the 2015/16 NHIES meets the standards outlined in the Data Quality Assessment Framework, the Data Collection Processing and Dissemination Policy and Practice as well as the Code of Practice: Professional and Ethical Standards Applicable to Statistics Producers issued by the NSA in January 2015 in the Government Gazette. These standards are aimed at guiding the statistics producers in the NSS in Namibia in the production of quality, relevant, and timely data and statistics. This component included the following activities: a. Post-field assessment and evaluation of the implementation of the 2015/16 NHIES. The Surveys and Field Operation division under Demography and Social statistics Department was expected to coordinate the production of a Survey Methodology and Administrative Report for the 2015/16 NHIES. This report would document how the implementation of the survey was done in all stages of the survey from planning, field operations, data processing (including data management), data analysis and report writing. The assessment would provide recommendations on areas that need improvement and adjustment for the next NHIES that is planned to take place during the 2018/19 financial year. b. Quality assessment and evaluation of the 2015/16 NHIES data. This activity was to assess the quality and validity of the NHIES data with a view to make recommendations to the Statistician General. 10. Component 3. Statistical analysis and training ($180,000). This component was comprised of two sub- components: a. Analysis of survey data, largely the 2015/16 NHIES data. This sub-component included an estimation and validation of poverty lines; an assessment of poverty and inequality in Namibia which entailed an examination of the state of poverty and inequality in the country, and an identification of the drivers and barriers to poverty and inequality reduction; an assessment of multidimensional poverty in Namibia; a poverty mapping exercise; technical support to the Ministry of Gender Equality and Child Welfare which had requested the NSA for support Page 5 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) in conducting a study on the impact of child grants on the wellbeing of children in Namibia; and an assessment of the distributional impacts of policies. b. Training of NSA staff. Other sub-activities in this component included training on poverty analysis together with training on the use of Automated DEC Poverty Tables (ADePT) and Stata software. Dissemination of findings as well as exchange of knowledge would be supported via funding for study tours, conferences and workshops. Significant Changes During Implementation 11. The project underwent a restructuring on June 15, 2018 to extend the project closing date by 12 months. Results indicators were updated to reflect the new closing date. Page 6 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) II. OUTCOME Assessment of Achievement of Each Objective/Outcome 12. The project’s achievements are assessed against the outcomes of the PDO: improve (i) collection, (ii) analysis and (iii) dissemination of the household survey data, as well as three components of the PDOs: (i) Survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey, (ii) Assessment and evaluation of the 2015/16 NHIES, and (iii) Statistical analysis and training. Theory of Change (Results Chain) 13. The Project Paper did not describe a Theory of Change (ToC). For this Implementation Completion and Results Report (ICR), the team has reconstructed the ToC and retrofitted it from the Project Paper and the project Results Framework and its detailed description. Figure 1 presents project activities, outputs, and outcomes, and its long- term expected impact. Figure 1: Results Chain (reconstructed ex-post) Page 7 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) (i) Survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey 14. Survey preparation, design, implementation and data collection of the 2017 Namibia Financial Inclusion Survey (NFIS) was achieved. The survey was the fourth of its kind to be conducted in Namibia, however, the first to be conducted by NSA. The first three financial inclusion surveys were conducted in 2004, 2007 and 2011 respectively, through the FinScope survey of FinMark Trust, an independent trust based in South Africa. A total of 1,863 persons were interviewed and the data was administered through CAPI. The data collected was weighted to reflect the adult/eligible population (that is aged 16 years or older) in Namibia. 15. The survey report was launched on August 13, 2018. In addition, the micro-data has been made publicly available on NSA’s website. 16. This outcome is directly linked to PDO Outcome for Improved Data Collection objective of the PDO. (ii) Assessment and evaluation of the 2015/16 Namibia Household Income and Expenditure Survey (NHIES) 17. The NQAFS report was produced. The report presents the Data Quality Assurance Framework and the development of the quality assessment guideline and templates (one for the self-evaluation template and another for the assessment of statistics) for designating statistics as official statistics. In addition, a workshop was held to assess the adequacy of the current design of the NHIES with the aim of making recommendations for further improvements. 18. This outcome is directly linked to PDO Outcome for Improved Data Collection objective of the PDO. (iii) Statistical analysis and training 19. Analytical products based on analysis of the 2015/16 NHIES data were produced. In addition, NSA staff received training in various areas. 20. Analytical products based on analysis of the 2015/16 NHIES data were produced with heavy involvement of NSA officials. This includes, among others, a report on the methodology of poverty and inequality measurement in Namibia, production of the Basic Report of the NHIES 2015/16, analysis of multidimensional poverty in Namibia, an inception report on the impact of child grants on child welfare outcomes, and a report on the Quality Assurance Framework. In addition, a report that presents and discusses the recent trends in poverty and inequality in Namibia, and an identification of the drivers of poverty and inequality reduction was finalized. 21. The training received by NSA staff can be summarized as follows: a. Financial management and procurement training. A financial management and procurement training workshop were held by the World Bank financial management and procurement specialists. This was to address the challenge that NSA staff initially had limited to no experience in using the information system with World Bank procedures on disbursement, interim reporting, annual audit reporting, and procurement rules and procedures. In addition, through consistent and regular support was provided by the Bank specialists, and this further enhanced capacity. b. Poverty and inequality measurement. This included training workshops on the methodology of poverty measurement in Namibia, structured to cover both the conceptual framework around poverty measurement (including international best practices) as well as hands on training using Stata software. Data cleaning and Page 8 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) analysis of main indicators was part of the engagement. Strengthened capacity was evident as NSA officials adopted Stata software as their default software for poverty analysis (they previously used Statistical Package for the Social Sciences (SPSS)) and were subsequently able to finalize poverty and inequality estimates using the 2015/16 NHIES. c. Poverty mapping (using small area estimation techniques). NSA officials participated in a training workshop on poverty mapping. The workshop was hands-on and was tailor-made for NSA. The objective of the workshop was to introduce poverty mapping methodology to participants and equip them with knowledge on how to create poverty maps using Census and household survey data as well as interpretation of the results. The hands-on training poverty mapping training used the 2011 Population and Housing Census and the 2009/10 NHIES. d. Sample weight calibration. Four NSA staff attended training on weights calibration organized by a World Bank team. The objective of the training was to train NSA officials to calibrate household weights using R package and replicating results of the NHIES calibration. e. Informal economy statistics. Two officials attended training at the ILO Training Centre in Turin (Italy) on the informal economy. The training is key to enhancing the capacity of NSA in gathering and disseminating data on the informal economy. 22. In addition to the analytical work and training, 15 laptops for the staff of NHIES and Data Processing division were purchased. A software application for the 2021 Population and Housing Census was also purchased. This outcome is linked to the Improved Data Analysis and Improved Data Dissemination outcomes of the PDO. Overall Outcome Rating 23. The overall outcome rating is Satisfactory. This adjustment from the moderately satisfactory rating in the last Implementation Status & Results Report (ISR) reflects improvements made to make up for initial project preparation delays, thanks to an additional year extension. The disbursement rate is 100 percent. 24. Key outcomes of the PDO were substantially achieved. The project contributed to improved collection of household survey data because the survey was successfully conducted, using CAPI – an indicator of innovation to data collection by NSA. Improved analysis of household survey data was also substantially achieved as the NSA, together with other relevant stakeholders, successfully produced analytical products using largely NHIES data which was accompanied by targeted training on statistical analysis. Lastly, improved dissemination of household survey data was also achieved because data was made publicly available in a timely manner and results/findings from analysis of data was also shared with relevant stakeholders, and in some cases, the public. 25. For the component of the PDO, “survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey�, the survey was conducted, the survey report produced, and the micro-data made publicly available. This means the PDO indicators “availability and public accessibility to key statistics and Household Indebtedness and Financial Inclusion survey data in a timely manner� and “cost effective design, implementation and data collection of a Household Indebtedness and Financial Inclusion Survey and indicators of data quality� were met. 26. The second component “assessment and evaluation of the 2015/16 Namibia Household Income and Expenditure Survey (NHIES)� was achieved with the production of a report on the NQAFS which provides a system for data Page 9 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) verification and quality assurance. In addition, a workshop was held to assess the adequacy of the current design of the NHIES with the aim of making recommendations for further improvements. This means the PDO indicator “development of a robust system for data verification and quality assurance for the NHIES� was met. 27. For the third component “statistical analysis and training�, several analytical products were produced based largely on the NHIES. In addition, several trainings on analysis of microdata were conducted or attended by NSA staff. In general, and considering the initial delays in project preparation, the PDO indicator “full and timely implementation of the planned capacity building activities, including analytical outputs� was met. Other Outcomes and Impacts 28. The project contributed to strengthening the capacity of the NSA staff and the institution as a whole at various levels. In addition, it also provided an opportunity for the counterparts to get to know the World Bank and modalities of working with the World Bank. 29. The preparation, design and implementation of the 2017 NFIS involved a range of stakeholders through syndicate membership to enrich the entire survey process through cross-cutting learning, sharing of information, and to facilitate the extended utilization of the final data. In particular, the survey benefited from several engagements between the NSA, Bank of Namibia and FinMark Trust. These partners, together with the World Bank, provided technical assistance on survey design and implementation. Thanks to co-financing from Bank of Namibia, a full survey rather than a pilot, was conducted. 30. The localization of the survey was a significant step towards ensuring sustainably of conducting the survey, funded by government and conducted by the agency that has the mandate to collect national data for policy making and development planning purposes in Namibia. Overall, the successful implementation of the survey by NSA indicated strengthened capacity to prepare and implement new and specialized surveys in response to demands from stakeholders. 31. The purchase of laptops for the staff of NHIES and Data Processing division, as well as, a software application for the 2021 Population and Housing Census, is important as these will be used for data processing and future trainings. III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME 32. The project experienced initial delays in project preparation and implementation. This was due to first, delays in the signing of the grant agreement and second, challenges and delays in the client’s access to Client Connection. Relevant orientation, training and support was provided to overcome the challenges, constant support from the World Bank financial management and procurement specialists. 33. It was clear that to allow for completion of activities a project extension was required. The government requested the project’s closing date extension through the Ministry of Finance, which was accepted by the World Bank and the project was then restructured with a new closing date of to June 30, 2019 (a change from June 30, 2018). Page 10 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) 34. About two months after the project was restructured, the main focal person for the project resigned. This affected the timely delivery of some of the outputs and meant a renewed focus on building relationships had to be made. 35. Challenges in identification of good consultants for some of the analytical work and reports affected the pace and quantity of delivery. This is especially the case for the work on the impact of child grants on children’s welfare outcomes and as multidimensional poverty analysis. IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME 36. Overall, the World Bank’s performance has been satisfactory. Since the signing of the agreement, the World Bank team carried out implementation support missions and provided extensive implementation support via emails and telephone. 37. The financial management performance of the project was satisfactory throughout the implementation period. This was mainly attributed to involvement of suitably qualified officials to serve in the financial management role as well as regular and timely support from the World Bank team. 38. Overall, the technical assistance and training contributed to strengthening the NSA’s capacity to prepare and implement new and specialized surveys in response to demands from stakeholders, as well as capacity to analyze micro-data. V. LESSONS LEARNED AND RECOMMENDATIONS 39. The Bank did not have an active operations portfolio in Namibia at the start of the project. This meant the counterparts as well as the Bank did not have a good understanding of either party’s operational rules, procedures and processes. This contributed to the late start of spending from the project. Although, it was on paper that the grant was approved, however, for several months, access to the grant was not feasible due to delays in disbursement as NSA staff could not access the World Bank Grant Client Connection and Disbursements system. It is therefore important to make allowance for dialogue and strong engagement on modalities of working together. 40. Understanding the local market for research consultants is key. While use of local consultants is commendable, delays were encountered in getting suitable consultants to lead research in selected areas, specifically on the assessment of the impact of child welfare grants. A good initial assessment of the local labor market particularly regarding the subject matter would have pointed to the need to cast the net wider to include other countries in the subregion and beyond. 41. To ensure timely delivery and overall better time management, it would have helped for the Bank team to work closely with NSA officials to review all deliverables before the final submission. In fact, closer engagement from the first draft is important to help identify challenges early and agree on remedial actions. 42. To broaden the impact of the project and improve sustainability, it would have been beneficial if active engagement was made from the start to also include and mobilize involvement of government departments including . the National Planning Commission (NPC). This is important as they are the users of data. Page 11 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS A. RESULTS INDICATORS A.1 PDO Indicators Objective/Outcome: Improved Collection of the Household Survey Data Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Cost effective design, Yes/No N Y Y Y implementation and data collection of a Household 16-Oct-2017 30-Jun-2018 30-Jun-2018 30-Jun-2018 Indebtedness and Financial Inclusion Survey and indicators of data quality. Comments (achievements against targets): Target fully achieved. Survey implemented in cost effective manner. Objective/Outcome: Improved analysis of the household survey data Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Development of a robust Yes/No N Y Y Y system for data verification and quality assurance for the 01-Mar-2017 30-Jun-2018 30-Jun-2019 30-Jun-2019 Page 12 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) NHIES. Comments (achievements against targets): Achieved. Report produced on the NQAFS which provides a system for data verification and quality assurance. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Full and timely implementation Yes/No N Y Y Y of the planned capacity building activities, including 04-Apr-2017 30-Jun-2018 30-Jun-2019 30-Jun-2019 analytical outputs. Comments (achievements against targets): Achieved. Several analytical products were produced based largely on the NHIES. In addition, several trainings on analysis of microdata were conducted or attended by NSA staff. Objective/Outcome: Improved dissemination of the household survey data Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Full and timely implementation Yes/No N Y Y Y of the planned capacity building activities, including 04-Apr-2017 30-Jun-2018 30-Jun-2019 30-Jun-2019 analytical outputs. Comments (achievements against targets): Achieved. Several analytical products were produced based largely on the NHIES. In addition, several trainings on analysis of microdata were conducted or attended by NSA staff. Page 13 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) Unlinked Indicators Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Availability and public Yes/No N Y Y Y accessibility to key statistics and Household Indebtedness 07-Jun-2017 30-Jun-2018 30-Jun-2018 30-Jun-2018 and Financial Inclusion survey data in a timely manner. Comments (achievements against targets): Target fully achieved. Survey data was made publicly available in a timely manner and results/findings from analysis of data was also shared with relevant stakeholders, and in some cases, with public. A.2 Intermediate Results Indicators Component: Component 1. Survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion A Household Indebtedness and Yes/No N Y Y Y Financial Inclusion report 24-Oct-2017 30-Jun-2018 30-Jun-2019 30-Jun-2019 Comments (achievements against targets): Achieved. Report was produced. Indicator Name Unit of Baseline Original Target Formally Revised Actual Achieved at Page 14 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) Measure Target Completion A Data Quality Assessment and Yes/No N Y Y Y Validation report for the 2015/16 NHIES 20-Sep-2017 30-Jun-2018 30-Jun-2019 30-Jun-2019 Comments (achievements against targets): Achieved. Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion Testing of Computer Assisted Yes/No N Y Y Y Personal Interviewing (CAPI) 10-Oct-2017 30-Jun-2018 30-Jun-2019 30-Jun-2019 Comments (achievements against targets): Achieved. Survey was successfully conducted, using CAPI. Component: Component 2. Assessment and evaluation of the 2015/16 Namibia Household Income and Expenditure Survey (NHIES) Unit of Formally Revised Actual Achieved at Indicator Name Baseline Original Target Measure Target Completion A Survey Methodology and Yes/No N Y Y Y Administrative report for the 2015/16 NHIES 21-Jul-2016 30-Jun-2018 30-Jun-2018 30-Jun-2018 Comments (achievements against targets): Achieved. Page 15 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) Page 16 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) B. ORGANIZATION OF THE ASSESSMENT OF THE PDO Objective/Outcome 1: Improved Collection of the Household Survey Data 1. Cost effective design, implementation and data collection of a Household Outcome Indicators Indebtedness and Financial Inclusion Survey and indicators of data quality Intermediate Results Indicators 1. Testing of Computer Assisted Personal Interviewing (CAPI) Component 1: Survey preparation, design, implementation and data collection of a pilot Household Indebtedness and Financial Inclusion Survey Key Outputs by Component 1. The 2017 Namibia Financial Inclusion Survey (NFIS) completed, and data collection (linked to the achievement of the Objective/Outcome 1) conducted via CAPI 2. The micro-data has been made publicly available on NSA’s website Objective/Outcome 2: Improved analysis of the household survey data 1. Development of a robust system for data verification and quality assurance for the Outcome Indicators NHIES 1. A Data Quality Assessment and Validation report for the 2015/16 NHIES. Intermediate Results Indicators 2. A Survey Methodology and Administrative report for the 2015/16 NHIES Component 2. Assessment and evaluation of the 2015/16 NHIES Key Outputs by Component 1. A report on the Namibia Quality Assurance Framework for Statistics (NQAFS) (linked to the achievement of the Objective/Outcome 2) produced 2. The NHIES questionnaire revised Objective/Outcome 3: Improved dissemination of the household survey data 1. Availability and public accessibility to key statistics and Household Indebtedness and Financial Inclusion survey data in a timely manner Outcome Indicators 2. Full and timely implementation of the planned capacity building activities, including analytical outputs. Page 17 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) 1. Household Indebtedness and Financial Inclusion report Intermediate Results Indicators 2. A Survey Methodology and Administrative report for the 2015/16 NHIES Component 2. Assessment and evaluation of the 2015/16 NHIES Analytical products based on analysis of the 2015/16 Namibia Households Income and Expenditure Survey (NHIES) data produced, including, among others: 1. Methodology of poverty and inequality measurement in Namibia 2. The Basic Report of the NHIES 2015/2016 3. Analysis of multidimensional poverty in Namibia 4. Inception report on the impact of child grants on child welfare outcomes 5. Data Quality Assurance Framework and the quality assessment guideline and Key Outputs by Component for designating statistics as official statistics (linked to the achievement of the Objective/Outcome 3) 6. Poverty and inequality update note Component 3. Statistical analysis and training The training received by NSA staff included, among others: 1. Financial management and procurement 2. Poverty and inequality measurement 3. Poverty mapping using small area estimation techniques 4. Sample weight calibration 5. Informal economy statistics Page 18 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) . ANNEX 2. PROJECT COST BY COMPONENT Amount at Approval Actual at Project Percentage of Approval Components (US$) Closing (US$) (US$) Survey preparation, design, implementation and data collection of a pilot 260,000 176,268 68% Household Indebtedness and Financial Inclusion Survey Assessment and evaluation of the 2015/16 Namibia 60,000 48,420 81% Household Income and Expenditure Survey (NHIES) Statistical analysis and training (incl. equipment and 180,000 275,315 153% software) Total 500,000 500,003 100% Page 19 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) ANNEX 3. RECIPIENT, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS Comments received from the Namibia Statistics Agency The greatest impacts of the project can be classified into two: (i) successful implementation of the Namibia Financial Inclusion Survey specifically, and (ii) staff development broadly. The project contributed to improving the capacity of many NSA officials in several areas. 1. Namibia Financial Inclusion Survey For the first time, NSA statisticians successfully led the implementation of the Namibia Financial Inclusion Survey (NFIS), in response to demands from stakeholders. The preparation and implementation of the survey provided a lot of opportunities for development of staff, including both the technical and partnership aspects. This built and strengthened capacity within the NSA, something that is important for sustainability in conducting future financial inclusion surveys. In addition, the survey was administered via Survey-To-Go Computer-Assisted Personal Interviewing (CAPI) application, consistent with the ongoing process of modernization of NSA surveys. 2. Assessment and evaluation of the 2015/16 Namibia Household Income and Expenditure Survey (NHIES) The Data Quality Assurance Framework together with the Quality Assessment guideline aimed at designating statistics as official statistics were developed. In addition, a workshop was held to assess the adequacy of the current design of the NHIES with the aim of making recommendations for further improvements. 3. Analysis of micro-data Analysis of micro-data was enhanced through the activities of the grant. This includes, among others, a report on the methodology of poverty and inequality measurement in Namibia; production of the Basic Report of the NHIES 2015/2016; analysis of multidimensional poverty in Namibia, and an inception report on the impact of child grants on child welfare outcomes. In addition, a draft report which presents and discusses the recent trends in poverty and inequality in Namibia has been produced, with an identification of the drivers of poverty and inequality reduction. 4. Poverty mapping Training on poverty mapping (based on small area estimation techniques) has contributed to strengthened capacity in the analysis of micro-data at the NSA. While the training was based on the 2015/16 NHIES and the 2011 Population and Housing Census, the team will use the acquired skills to produce a poverty map based on the next Census and NHIES. 5. Other training NSA staff received training on financial management and procurement; poverty and inequality measurement; poverty analysis; use of Stata software; sample weight calibration, and informal economy statistics. Page 20 of 20 The World Bank Collection, Analysis and Dissemination of Household Survey Data in Namibia (P159953) ANNEX 4. SUPPORTING DOCUMENTS (IF ANY) Component Activity Supporting document Technical assistance on survey Component 1: Survey design and preparation, including preparation, design, training on the use of the Survey- 2017 Namibia Financial Inclusion Survey implementation and data To-Go CAPI application. (NFIS) report collection of a pilot Household Indebtedness and Data collection Financial Inclusion Survey Post-field assessment and Report on the Data Quality Assurance Component 2: Assessment evaluation of the implementation Framework and evaluation of the of the 2015/16 Namibia 2015/16 Namibia Household Household Income and Income and Expenditure Expenditure Survey (NHIES) Survey (NHIES) Quality assessment and evaluation NHIES 2015/16 questionnaire review of the 2015/16 NHIES data Analysis of survey data, largely the • A report on the methodology of poverty 2015/16 NHIES data and inequality measurement in Namibia • Basic Report of the NHIES 2015/2016 • Unpublished report on multidimensional poverty in Namibia Component 3: Statistical • Inception report on the impact of child analysis and training grants on child welfare outcomes • Draft poverty and inequality update note Training of NSA staff Training reports on: • Stata training • Measuring economic welfare • Poverty mapping • NHIES 2015/16 questionnaire review Page 21 of 20