WORLD BANK GROUP PLANET FORUM REGIONAL DAY SAES2 1 4 F E B R U A R Y 2 0 2 5 Jose Cuesta SSIDR WHAT DOES THE SCORECARD MEAN TO ME IN SOCIAL? Scorecard and, more generally, an outcome culture is not a fashion likely to pass Invest in a 3600 understanding Scorecard demands to measure the unmeasurable, but open opportunities (for us) to measure the invisible 2 SD PROJECT LEVEL CORE INDICATORS INITIATIVE The objective: One SD indicator for SC, 5 indicators for Data360, 10 core indicators for TTLS > But a core indicator for what? The process: uncoordinated stock takings, GL ≠ TL priority areas, need for criteria > SD consensus core indicators 3 SD PROJECT LEVEL CORE INDICATORS INITIATIVE The results: Social Sustainability project level Database 1,500 indicators from 74 active SD-led projects 60% CLD, 14% CC, 14% women empowerment, 9% CESA, 3% other Proposed core indicators 16 indicators (40 with similar wordings) 8 CLD, 4 CC, 3 WE, 1 CESA* 4 SD PROJECT LEVEL CORE INDICATORS INITIATIVE The results: Social Sustainability project level Database 1,500 indicators from 74 active SD-led projects 60% CLD, 14% CC, 14% women empowerment, 9% CESA, 3% other Proposed core indicators 16 indicators (40 with similar wordings) 8 CLD, 4 CC*, 3 WE*, 1 CESA* 5 What have we learned? We do not have a common or integrated strategy when it comes to indicators Stock take exercises ad hoc and do not match Different priorization strategies Alignment with SC not a critical issue in our minds yet Yet, successful episodes happen SDCC indicators developed for locally led climate action aligned with SC and following the established process Without 360 understanding and investment in indicator “production�, tracking, and reporting, no systematic success Deliberate investments in dissemination, training, communication flows – a busy FP approach will not do it 6 IDA21 SCORECARD 7 Comparing IDA20 and IDA21 IDA 20 IDA 21 M&E No scorecard type of M&E IDA21 Scorecard consistent with CSC SD policy commitments A specific disability inclusion Disability and other VGs as part policy commitment (out of 40) of the outcome disaggregation IDA 21 Delivering Impact with Aim IDA 20 Building Back Better Urgency and Ambition 8 MEASURING THE INVISIBLE Clarify what needs to be measured Measuring global share of people excluded or at risk of exclusion Global poverty and exclusion estimates 2017 METHOD Macro-accounting approach Define VGs based on identity, circumstances and socioeconomic status, consistent with WBG Avoid double-counting directive using best available estimates at country, Quantify the global count for vulnerable groups regional or global level (women, children, victims of GBV, persons being trafficked, other (eg a girl with disabilities being forcefully displaced populations, ethnic minorities, PWDs, LGBTI, counted three times) religious minorities) An annual global estimate of people excluded PRODUCT or at risk of social exclusion A global and regional estimate that is A disaggregation of such comparable with global estimates for global rates by vulnerable monetary and multidimensional poverty population group Cuesta J, Lopez-Noval B, Niño-Zarazua M (2024) Social exclusion Concepts, Measurement, and a global estimate. PLoS ONE 19(2): e0298085. produced by the Bank 9 MEASURING THE INVISIBLE use innovative methods when data is weak Measuring GBV in conflict country w/o updated figures The impact of conflict on GBV rates in conflict METHOD Synthetic control country X on last year of DHS available Set relevant criteria that characterize Construct a “synthetic country� the country of interest composed of different pieces (e.g., levels of GDP, poverty, geographical location, (with different weights) that “mimics� demographics, ethnic composition, political/civic 30% liberties status, etc.) the real country "Excess" physical violence Select comparable countries which Use the information available for the closely resemble the country in countries that compose that synthetic question in several of these criteria country to define the trends, the role 15 % of certain characteristics and so forth. PRODUCT Synthetic Country X Country X New measures on the synthetic country filling evidence gaps on the country of interest E.g. Updated GBV rates in a country for which new DHS data is not available 10 MEASURING THE INVISIBLE (Planning to) make visible the effects of policies TOC for M&E system for mitigation measures against SOGI discrimination laws M&E “EFFECT� M&E produces real time evidence on Timely resolution of grievances in Adopt intervention the implementation of mitigation Bank projects and increased aiming at reducing measures and periodic information awareness of benefits of exclusion (quarterly) on the effects of those inclusion measures M&E CHAIN INPUTS INTERMEDIATE OUTCOMES Input and process indicators Intermediate outcome indicators Outcome indicators planned ensuring the M&E is in place, on grievance resolution, change in perceptions and working, and monitoring the satisfaction, awareness and behaviors toward inclusion adequate implementation of acceptance of inclusion mitigation measures 11 Key challenges for measuring the invisible HOW DO WE INVEST WISELY? Do we invest in more basic data on vulnerable groups or on better measurement & tracking methods for data we already have? HOW DO WE REALLY USE INNOVATION EFFECTIVELY? Can we detect reliable vs unreliable innovative methods in the same way than (un)reliable data? HOW DO WE PREPARE FOR NEW DEMANDS? How can we sustainably handle more pressing demands on measurement with tighter deadlines and fewer resources? 12 WORLD BANK GROUP Thank you! T H A N K Y O U