Monitoring the State of Statistical Operations under the COVID-19 Pandemic August 2020 Highlights from the second round of a global COVID-19 survey of National Statistical Offices Key Messages • Since the last survey in May, most NSOs have gradually moved towards office reopen- ing and returning to face-to-face data collection, but working from home has become the new normal for many. New protocols are needed for operating more efficiently under this new environment, and some of the best practices and lessons learned should be scaled up. • Remote work, training, data collection, and data storage are vital for NSOs to operate during the pandemic but many, particularly in low and middle-income countries, are constrained by inadequate ICT equipment and infrastructure. This calls for more deci- sive investments in digital technology. • Short-term statistical production, which heavily rely on traditional face-to-face methods, continues to be affected, with low and middle-income countries impacted the most. Reliance on alterative data sources requires smart investments to build the right spectrum of skill sets amongst NSO’s staff and NSS data producers. • National and international coordination in the collection of data on the COVID-19 pandemic has been inadequate in some cases, especially in sub-Saharan Africa. New institutions, or repurposing of existing institutions, with strong local ownership, may be needed to address these coordination problems and enhance effectiveness of individual efforts. Overview This report presents the results of the second round of a global survey on the impacts of the COVID-19 pandemic on the operation of National Statistical Offices (NSOs). Compared to the first round1 that provided a snapshot of the situation in May 2020, shedding light on office closures, disruptions to data collection and statistical reporting, and the readiness of national statistical agencies to respond to the increasing demand for data, the second round of the survey looks at the extent to which restrictions and disruptions have receded or become more widespread. In doing so, this report presents a closer look at concrete support needs and how they may best be addressed. A comparison of the response rate of the two survey rounds is available in the box below. Survey coverage and response rate A total of 122 NSOs responded to the first COVID-19 Survey to National Statistical Offices took place in May, while 112 responded to the second round in July. Ninety-three NSOs have participated in both rounds, while 29 participat- ed in only the first round and 19 participated in only the second round. Broken down by geographic region, survey participation has been as follows: Central and Southern Asia (6 offices in Round 1 and 8 in Round 2), Eastern and South-Eastern Asia (12 and 12), Europe and Northern America (39 and 34), Latin America and the Caribbean (17 and 16), Northern Africa and Western Asia (14 and 17), Oceania ( 4 and 3), sub-Saharan Africa (30 and 22). 1 https://unstats.un.org/unsd/covid19-response/covid19-nso-survey-report.pdf 1 While many offices have reopened, the majority still operate in emergency mode with some or all of their staff working from home As a consequence of the COVID-19 pandemic: Is your main office currently closed? Is staff instructed to work from home? 100 100 10 10 35 35 72 33 80 80 Percent Percent 72 60 60 64 40 50 40 52 20 25 20 26 15 15 0 3 0 May July May July Office is not closed Yes, ALL Yes, SOME No Office is closed only to non-essential staff Office is closed to ALL staff In July, when the second round of this survey took place, a large majority of NSOs (72 per- cent) was allowing at least some staff to physically access their premises, with only 3 percent of having their main office building closed to all staff. This has been a great improvement from May 2020, when only 35 percent of the office premises were fully open and 15 percent were restricting access to all their staff. Regionally, the gradual opening of NSO main office building to staffs was noted in 2 out of every 3 NSOs in Central and Southern Asia. In contrast, NSO buildings in about 1 in every 4 countries in Europe and Northern America and in Latin America and the Caribbean (23 and 25 percent, respectively), and in one third of countries in Northern Africa and Western Asia, have remained partially closed to staff between May and July 2020. In May 2020 the vast majority of NSOs (90 percent) were instructing at least some of their staff to work from home. Two months later, operations are still far from returning to normali- ty with still two-thirds of NSOs instructing some or all their staff to work from home. 2 Fieldwork data collection is also gradually resuming. The percentage of offices reporting they had fully halted face-to-face data collection went down from 69 percent in May to 31 in July. In addition, 28 percent of the NSOs indicated that they had no restrictions in place for field data collection, against just 4 percent two months earlier. The trend is clearly one of easing of restrictions, reopening of offices and a gradual return to face-to-face data collection. While approximately half the respondents reported that their offices were planning to restart normal field data collection operations within the next 6 months, the other half still were uncertain and not able to indicate an estimated timeline for the full resumption of face-to- face interviews. Stopped face-to-face data collection When do you expect to be able to resume face-to-face interviews in full? 100 4 90 12% 28 80 27 70 53% 22% Percent 60 50 41 40 69 8% 4% 30 20 31 Within 1 month Within 3 months 10 Within 6 months Longer than 6 months 0 Stopped in May Still stopped in July Hard to say Yes, fully Yes, partly No 3 For 15 to 20 percent of offices, working from home is constrained by inadequate ICT equip- ment or infrastructure The survey also investigated the readiness for working from home in National Statistical Offices. Between 13 and 25 percent of offices signaled inadequate equipment, software and IT infrastructure impeding efficient working from home, with the most common issues being around access to cloud computing services for data storage and exchange, the suitability of facilities for remote training, and the availability of adequate computers for staff to perform home-based work. ICT readiness during the COVID-19 pandemic Adequate ICT facilities for remote 7 18 14 47 15 training of staff and enumerators 4 19 15 44 28 Adequate ICT facilities and software for remote data collection Provisions in for staff to securely 6 14 13 39 28 access data remotely Adequate cloud computing services 10 15 19 37 19 for remote data storage Adequate facilities to conduct video 3 12 6 44 35 conferences Staff are provided adequate platforms for remote collaborative work 10 15 19 37 19 Staff have adequate internet access at home to work remotely 6 7 18 36 26 7 Staff working from home have 5 16 17 26 28 8 adequate computers to perform their work 0 20 40 60 80 100 Percent Strongly disagree Disagree Neutral Agree Strongly agree Not applicable There are, however, marked differences across income levels and regions. Issues around cloud computing for data storage and exchange are more pronounced in low-income and middle-income countries, where around 3 in 10 NSOs reported inadequate access. This is the case for 45 percent of offices in Eastern and South-Eastern Asia and 38 percent in Central and Southern Asia. 4 The office has access to adequate cloud computing services for remote data storage and data exchange Total 10 15 19 37 19 Low and lower-middle income 12 18 35 29 6 Upper middle income 10 19 6 42 23 High income 9 9 16 40 26 0 20 40 60 80 100 Percent Strongly disagree Disagree Neutral Agree Strongly agree Total 10 15 19 37 19 Sub-Saharan Africa 27 5 32 32 5 Oceania 33 33 33 Northern Africa and Western Asia 19 19 56 6 Latin America and the Caribbean 6 25 31 38 Europe and Northern America 6 6 13 53 22 Eastern and South-Eastern Asia 9 36 27 27 Central and Southern Asia 13 25 38 13 13 0 20 40 60 80 100 Percent Strongly disagree Disagree Neutral Agree Strongly agree In addition, infrastructure for remote training of staff and enumerators is considered inad- equate primarily by respondents from offices in low and lower-middle income countries (47 percent) as well as in sub-Saharan Africa (54 percent). 5 The office has adequate ICT facilities for remote training of staff and enumerators Total 7 18 14 47 15 Sub-Saharan Africa 18 36 9 32 5 Oceania 33 67 Northern Africa and Western Asia 25 13 56 6 Latin America and the Caribbean 13 13 62 13 Europe and Northern America 6 6 6 55 26 Eastern and South-Eastern Asia 9 45 36 9 Central and Southern Asia 25 25 38 13 0 20 40 60 80 100 Percent Strongly disagree Disagree Neutral Agree Strongly agree 7 18 14 47 15 Total 15 32 9 41 3 Low and lower-middle income 3 16 23 35 23 Upper middle income High income 2 7 12 60 19 0 20 40 60 80 100 Percent Strongly disagree Disagree Neutral Agree Strongly agree In spite of these infrastructural issues, remote training of NSO staff has become widespread in countries of all income levels, although low and lower-middle income countries lagged somewhat behind. 6 Did NSO staff participate in remote trainings amidst the COVID-19 crisis covering any of the following topics? Data collection Data processing Data dissemination / communication Data analysis Other (please specify) 0 20 40 60 80 Percent Low and lower-middle income Upper middle income High income Short-term statistical production continues to be affected, with low and middle-income countries impacted the most Half of the responding countries reported that their production of monthly or quarterly statistics has been affected for at least one domain category. Household sector and labor market statistics were the most affected domains, as one-third of the respondents noted that the pandemic had affected their ability to produce this type of short-term statistics. Proportion of countries where the current COVID-19 pandemic is affecting NSO’s ability to produce essential monthly/quarterly statistics, by type of statistics Household sector Labor market National accounts Production and turnover Prices Economic sentiment indications External sector Real estate market Other (please specify) 0 10 20 30 40 50 60 7 Percent Low and lower-middle income Upper middle income High income The ability to produce short-term statistics was most affected in low and lower-middle in- come countries. Three in four countries in that income group reported that their production of monthly/quarterly statistics had been affected for at least one domain, while one in five countries recorded that production was affected in six or more domains. In contrast, two thirds of the respondents in high-income countries reflected that the production of short- term statistics remained completely unaffected. Proportion of countries reporting production of monthly and quarterly statistics being affected, by number of domains Low and lower-middle income 24 24 32 21 Upper middle income 44 22 28 6 High income 64 12 14 10 0 20 40 60 80 100 Percent None 1 or 2 3 to 5 6 or more As a result of the COVID-19 pandemic, NSOs have improved their emergency preparedness. Before the pandemic, less than a third of offices (27 percent) had a crisis management plan in place. In July 2020, the situation had reversed, as only 29 percent of national statistical offic- es either did not have or were not preparing their own crisis management plan. Does your office have a crisis management plan? 29% 27% 14% 29% Yes - plan was in place before the COVID-19 crisis Yes - plan was developed after the COVID-19 crisis began Plan is currently being developed No 8 NSOs are playing a major role in governments’ COVID-19 response NSOs have been playing a major role in government response, both by participating in government committees (57 percent of responding offices) and by producing data through COVID-19 pandemic-related surveys (63 percent). The proportion of NSOs that implemented COVID-19 surveys is highest in sub-Saharan Africa (86 percent) and among low and low- er-middle income countries (69 percent). Proportion of NSOs serving on a government committee managing the crisis and implementing a COVID-19 pandemic-related survey Has your office been called to serve on a Is your office currently implementing any government crisis response group or survey on COVID-19 and its impacts? advisory committee at the national level due to COVID-19? 43% 57% 37% 63% Yes No Yes No More than three quarters of the COVID-19 surveys implemented by NSOs measure the socio-economic impact on households and businesses. This is the prevalent focus of these surveys in countries across all income levels. Less common objectives of national COVID-19 surveys include identifying population at risk, measuring access to health services, determin- ing the impact on physical and mental health and examining access to COVID-19 testing, as well as monitoring COVID-19 infections, fatalities and recovery. 9 What is the focus of the survey on COVID-19 and its impacts? (by income group) Socio-Economic impact at household level Impact on businesses/firms Identification of population at risk Availability of / access to health infrastructure and services General physical and mental health impact on the population Monitoring of COVID-19 infections, fatalities and recovery rates Access to COVID-19 testing Other (please specify) 0 10 20 30 40 50 60 70 80 90 100 Percent Low and lower-middle income Upper middle income High income Other players are also involved in COVID-19 data collection efforts In three quarters of countries in the sample of this survey, additional COVID-19 data collec- tion efforts outside of NSOs were identified. In the countries where COVID-19 data collection efforts are taking place outside of the NSO, these are predominantly led by other govern- ment agencies, although academic and research institutions also play an important role. The international community or donors have also been leading COVID-19 surveys in one third of lower or lower-middle income countries.2 Is there any other COVID-19 related data collection efforts in your country being led by institutions other than your office? 15% 10% 75% Yes No Don’t know 2 More information on how the international community works with countries on COVID-19 surveys is available at https://unstats.un.org/iswghs/ task-forces/covid-19-and-household-surveys/COVID-19-impact-surveys/ 10 Who is leading other COVID-19 related data collection efforts? National government agencies Academic / research institutions Local governments Private businesses International community / donors Civil society 0 20 40 60 80 100 Percent Low and lower-middle income Upper middle income High income In about 60 percent of cases, NSOs are to some extent involved in national data collection efforts led by other organizations, and plan to use their results. However, a coordinated national statistical system for COVID-19 pandemic-related data collection has been lacking in some regions. A well-coordinated national statistical system is crucial for harmonized concepts and defi- nitions across different data sources within a country and for efficient data collection and dissemination to meet the needs of policymakers. In 15 percent of the countries surveyed, NSOs did not know whether there were any other COVID-19 pandemic-related data collec- tion efforts in the country. This percentage was much higher for sub-Saharan African coun- tries, at about 30 percent. 11 Is there any other COVID-19 related data collection efforts in your country being led by institutions other than your office? Total 75 10 15 Sub-Saharan Africa 67 5 29 Oceania 100 Northern Africa and Western Africa 69 19 13 Latin America and the Caribbean 69 13 19 Europe and Northern America 82 6 12 Eastern and South-Eastern Asia 80 20 Central and Southern Asia 75 13 13 0 20 40 60 80 100 Percent Yes No Don’t know Even when NSOs were aware of COVID-19 data collection activities outside of their offices, only about 61 percent indicated that they were involved in data collection; and 67 percent indicated that they would use the results of COVID-19 pandemic-related data collected by other agencies. Is your office involved in any of these Are you using or planning to use the results of any of data collection efforts? these other COVID-19 related data collection efforts for your reporting purposes? 39% 61% 33% 67% Yes No Yes No When asked about the overall sentiment on whether survey efforts on COVID-19 were well coordinated within the country, around half of the NSOs responded positively (agree and strongly agree); and 16 percent reported poor coordination (disagree and strongly disagree). Coordination seemed to be more challenging in Oceania and sub-Saharan Africa, where only around one third of the reporting countries showed satisfaction with the current level of coordination. 12 Current efforts to collect data on COVID-19 and its impact in my country are well coordinated Total 4 12 35 38 11 Sub-Saharan Africa 10 24 38 29 Oceania 33 33 33 Northern Africa and Western Africa 6 13 25 50 6 Latin America and the Caribbean 13 44 38 6 Europe and Northern America 9 30 36 24 Eastern and South-Eastern Asia 10 20 60 10 Central and Southern Asia 63 25 13 0 20 40 60 80 100 Percent Strongly disagree Disagree Neutral Agree Strongly agree To improve the coordination of efforts to collect data on COVID-19 and its impact, NSOs offered a number of suggestions. These include: • Establishing a coordinating technical committee on COVID-19 at a higher level to work with all relevant government offices and holding regular meetings for coordinated efforts; • Making all data collection efforts transparent and carrying out mapping exercises of all data collection activities to avoid duplication; • Involving key private sector players as well as local governments for countries with a decentralized system; • Improving collaboration among government agencies for better access to administra- tive data; • Investing, both financially and technically, in the NSOs to improve their capacity in quickly responding to crisis. Technical areas that were highlighted as requiring assis- tance included non-person-to-person survey methods and data storage; • Encouraging all other stakeholders to consult with NSOs for any data collection to ensure that the data collected are fit for purpose and followed proper anonymization processes to protect the confidentiality of individuals; • Investing in an overall data storage structure and data dissemination platform for COVID-19. 13 Countries in different income groups reported receiving different types of support Almost half of low and lower-middle income countries received financial support (44 per- cent), followed by technical assistance (38 percent). Upper-middle income countries most often received support in the form of technical assistance (44 percent), followed by training (34 percent). Proportion of countries where NSO is currently receiving support from international organizations/partners to face the challenges posed by the COVID-19 pandemic? Technical assistance Training Financial support Equipment / infrastructure ! Other support 10 10 20 30 40 50 Percent Low and lower-middle income Upper middle income High income 14 While international organizations and partners have provided technical or financial support to many countries, more assistance is needed to help mitigate the challenges of COVID-19 pandemic. More than half of the countries indicated that more assistance is greatly needed for each type of support – financial, technical, training and infrastructure. There was a significant difference by income group in terms of the extent and type of support needed. Whereas few high-income countries were in need of any kind of support, two-thirds or more of upper mid- dle-income countries reported that they required technical assistance, training and financial support. For low and lower-middle income countries, most voiced a stronger need for every type of support. Financial support, equipment and infrastructure support, and technical assistance were the most needed types of support in countries in this income group. Need for additional support to Need for additional support to face the challenges posed by the face the challenges posed by the COVID-19 pandemic: COVID-19 pandemic: Low and lower middle income Upper middle income countries countries Technical 23 23 55 Technical 28 53 19 assistance assistance Training 19 32 48 Training 22 56 22 Financial Financial support 22 16 63 support 31 34 34 Equipment / 16 28 56 Equipment / 41 38 22 infrastructure infrastructure Other support 45 23 32 Other support 53 33 13 0 20 40 60 80 100 0 20 40 60 80 100 Percent Percent Need for additional support to face the challenges posed by the COVID-19 pandemic: High income countries Technical 71 19 10 assistance Not needed Training 77 16 7 Financial Moderately support 69 19 12 needed Equipment / 84 9 7 infrastructure Greatly needed Other support 93 52 0 20 40 60 80 100 Percent 15 Respondents in sub-Saharan Africa revealed a lack of support systems more than any other region. At least three out of four respondents in that region reported that both technical assistance and training were greatly needed, and two thirds expressed great need for finan- cial support and equipment and infrastructure. Need for additional support to face the challenges posed by the COVID-19 pandemic: Sub-Saharan Africa Technical assistance 19 81 Training 14 14 76 Financial support 14 19 67 14 19 Equipment / infrastructure 30 30 65 Other support 35 35 25 25 40 0 20 40 60 80 100 Percent Not Moderately Greatly needed needed needed 16 The COVID-19 survey of NSOs - Round 2 • Mode: Computer Assisted Web Interviewing (CAWI), programmed in Survey Solutions • Launched on 7 July, questionnaire accepted through 25 July 2020 • Questionnaires sent to 195 NSOs, 112 responses received • Sections: Monitoring of operations under COVID-19; COVID-19 Response and coordination • This work was carried out under the aegis of the United Nations Statistical Division (UNSD), in partnership with World Bank’s Development Data Group and in coordination with the UN Regional Commissions. The Team who worked on the survey and the report was led by Francesca Perucci (UNSD) and Gero Carletto (World Bank), and consisted of Faryal Ahmed, Daniel Eshetie, Jonathan Gessendorfer, Luis G. González Morales and Habibur Khan (UNSD), Haoyi Chen (Inter-secretariat Working Group on Household Surveys) and Ivette Maria Contreras Gonzalez, Sergiy Radyakin, Zurab Sajaia, Philip Wollburg and Alberto Zezza (World Bank).