Implementing World Bank Jobs Agenda in
                 Agriculture Projects

                                      October 12, 2022




IEG’s Learning Engagements are a structured series of activities aimed to support World Bank
Group staff and clients in absorbing and applying evaluative evidence and knowledge.
Learning Engagements are undertaken in collaboration with Bank Group staff and are
designed to maximize learning from existing evidence. They allow for early course correction
by identifying and filling knowledge gaps, and can thereby help achieve higher performance
and better outcomes. The guidance offered by Learning Engagements is not mandatory and it
complements other available guidance for Bank Group staff and clients.
Contents
1.     Jobs are instrumental to both economic development, and the Bank’s twin goals of poverty reduction
       and shared prosperity ..................................................................................................................................................................1

2.     Agricultural value chain development from farm to fork sustains the JET agenda ............................................... 2

3.     What jobs outcomes are supported in Bank agricultural projects? ............................................................................ 5

4.     Identifying jobs outcomes during Bank-supported agricultural projects project preparation .......................... 7

5.     Measuring and monitoring jobs outcomes ......................................................................................................................... 8

6.       Conclusion.................................................................................................................................................................................... 13

References.............................................................................................................................................................................................. 14



Boxes
Box 1: What does it mean to be working informally?........................................................................................... 5
Box 2: Challenges in measuring “Jobs Created” in a value chain project - The Cote d’Ivoire Cashew
Competitiveness Project ............................................................................................................................................... 11


Figures
Figure 1: How economic transformation leads to shared prosperity .............................................................. 3


Tables
Table 1: Identifying and Monitoring Jobs Outcomes of Crop Agriculture Projects.................................. 15



                                                                             Acknowledgments
In close collaboration with the Agriculture and Food Global Practice, this IEG-HSP Learning Engagement
Note was written by Louise Fox (https://www.brookings.edu/experts/louise-fox/) under the co-TTLship
of Soniya Carvalho and Raian Divanbeigi, and the guidance and direction of Galina Sotirova (Manager,
IEGHC), Oscar Calvo-Gonzalez (Director, IEGHE), David Ian Walker (Manager, HSPJB), and Michal
Rutkowski (Global Director, HSJDR). The Note benefitted greatly from discussions with Parmesh Shah,
Madhur Gautam, Vivek Prasad, Julian A. Lampietti, Luc Christiaensen, Shobha Shetty, Chakib Jenane,
Nora Kaoues, Holger A. Kray, Vismay Bharat Parikh, Anders Jensen, and Karen Brooks, and IEG
colleagues, specifically, Christopher David Nelson, Bekele Ambaye Shiferaw, Lauren Kelly, and April
Connelly. For the purposes of this Note, agricultural sector projects are Bank-supported projects which
focus primarily on crop agriculture productivity or crop agriculture value chain upgrading, and are
implemented in IDA or IDA blend countries (e.g., LICs or LMICs).
 Implementing World Bank Jobs Agenda in Agriculture Projects

                                             Highlights

     •   Agricultural value chains provide a large majority of the employment opportunities in low-
         and lower-middle-income countries, so Bank-supported agricultural projects are
         instrumental in supporting client country and Bank jobs agendas.
     •   This role has often not been explicitly recognized in Bank-supported agricultural projects,
         especially those focused on raising productivity in on-farm economic activities. As a result,
         the potential contribution of these projects to improving jobs outcomes - a key driver of
         economic transformation, poverty reduction, and shared prosperity - is not recognized and
         may not be maximized.
     •   Measuring and monitoring the effects of Bank-supported agricultural projects on the
         quantity and quality of jobs is not difficult, although challenges exist. The Bank has
         developed a set of tools which TTLs, Project Management Units, and contractors can use
         at all stages of project preparation and implementation.
     •   This note discusses why focusing explicitly on employment outcomes is important, and
         provides suggestions on how this focus can be made operational.




1.    Jobs are instrumental to both economic development, and the Bank’s twin goals of
poverty reduction and shared prosperity
World Bank projects support country economic development through shared prosperity – a
sustainable reduction in poverty and improvement in welfare for the poorest half of the population.
Increases in earned incomes from employment is the main channel through which this happens. In
most cases, poor households work themselves out of poverty, as labor is the most important asset
of the poor. Better employment opportunities are, therefore, a desired outcome of most economic
development program and project interventions.
The link between employment opportunities and shared prosperity is recognized in multiple
strategies and commitments at the Bank. Job creation and improvement has become a corporate
priority recognized through a Corporate Results Indicator: Number of project beneficiaries reached by
jobs-focused WBG interventions. The Bank’s commitment to creating better employment
opportunities was strengthened through the Jobs and Economic Transformation (JET) framework
for IDA19, and is supported institutionally by the Jobs Group. Importantly, the JET framework
recognizes the particular importance of improving opportunities in poor countries where, owing to
nascent economic transformation, most of the labor force has to be engaged in self- and family
employment on and off the farm (Fox & Gandhi, 2021; Townsend et. al, 2017).
Bank-supported agricultural projects play an important role in supporting country progress toward
shared prosperity through increased income from employment, especially in low- and lower-income
countries owing to the large share of employment found within agricultural value chains. According
to Townsend et al., (2017), the food system employs the majority of people in developing countries,
and “will continue to do so during the time period set to achieve the Sustainable Development Goals
and thereafter” (p.4). In West Africa, agricultural value chains accounted for about two-thirds of
total employment (Allen et al., 2018). While most food system employment is found on the farm in
low-income countries, agro-processing enterprises deliver a significant share of manufacturing
output and employment.
Support is provided through three main types of projects.
            1. Projects targeting on-farm productivity - projects designed to improve the volume and
               value of production by farmers, usually through a combination of research, development,
               and extension/capacity building, as well as improvements in rural infrastructure
               (transportation, irrigation, storage, and logistics, etc.). The main outcome sought from
               these projects is an increase in land productivity (volume produced per hectare).
            2. Value chain projects - projects designed to deepen agribusiness value chains through
               enhancing the competitiveness of value addition activities that either process agricultural
               sector production or provide services and inputs needed to increase the productivity of
               agricultural sector activities (often called supply and demand-side projects). The main
               outcomes sought from these projects is both an increase in volume and quality of
               agricultural products suitable for processing per hectare and/or export, and an increase
               in the value-added post-harvest of key crops (e.g., roasted cashews, packaged
               vegetables, pressed oilseeds).
            3. Projects which help targeted groups (e.g., refugees, youth) enter farming as an economic
               activity. The Bank does few of these projects; the main outcome sought is often
               resettlement, including access to land and inputs.
All types of projects to contribute to the Bank’s Jobs agenda by improving key jobs outcomes –
earnings and employment quality - for beneficiaries. But often these contributions are not adequately
recognized, measured, and monitored. This is an issue for country strategy and the CPF, as project
contributions to better employment opportunities - a key link in the strategic theory of change
leading to shared prosperity – are not tracked effectively. But more importantly, client countries,
especially in Africa where the labor force is growing rapidly, have their own jobs agendas (which the
Bank is keen to support) and they need to measure and monitor progress toward creating better
employment opportunities.
The purpose of this Note is to support task managers in addressing these jobs issues within their
crop agricultural projects. 1 This Note covers:
           (i) the channels through which growth and development in crop agriculture affect jobs
           outcomes and why these are important for both sector and national economic development;
           (ii) the possible types of jobs outcomes and how these are realized and measured in the
           agricultural sector;
           (iii) how these job outcomes can be identified monitored throughout project development
           and implementation.

2.         Agricultural value chain development from farm to fork sustains the JET agenda
It is widely agreed that the expansion of better income earning opportunities depends on progress
in economic transformation. Economic transformation refers to two linked development processes:
(i) structural transformation – the shift of workers and resources from low-productivity, low-earning
sectors such as traditional agriculture to higher-productivity sectors through the more rapid entry
and growth of firms in the higher-productivity sectors; and (ii) sectoral transformation – the growth

1
    This note does not cover Jobs issues and outcomes in livestock projects.


                                                           2
of productivity within sectors, especially the lower-productivity ones. Growth of labor productivity on
family farms (sectoral transformation) is thus an essential element of economic transformation.
Economic transformation reflects both the use of new technology (e.g., biological, mechanical,
digital, and management technology) to lower the costs of production and to increase the diversity
and the sophistication of what is produced, and improved allocation of resources (physical
resources, including land, human, and financial resources) to higher productivity uses within the
economy. Bank country programs support economic transformation by helping client governments
stimulate private investment in productive capacity – on the farm, off the farm as part of an
integrated value chain, and in nonfarm sectors such as manufacturing, construction, and services.
Economic transformation means that a higher share of production takes place in firms, and a lower
share in production by households. It also means that both firms and household production become
more productive, and in the case of family farming, more commercialized. Economic transformation
enables the growth of labor earnings in the economy (including in on-farm activities) as well as
employment transformation: a shift in the share of employment from self- and family-employment in
household farms and microbusinesses to wage employment in private firms (or the public sector).
This shift occurs when wage jobs grow faster than the labor force, pulling new entrants and others in
the labor force into these jobs. Formal wage jobs are preferred by most in the labor force, as they
have a lower level of income risk than self- and family-employment on family farms and in the
nonfarm informal sector, and usually offer access to social protection (ILO, 2021). Job-creating
private investment is therefore a desired and expected outcome of many World Bank productive
sector development projects. It should be noted, however, that even as economic transformation is
taking place, the absolute size of informal employment, including agricultural employment, will
increase for quite some time. 2 Farm earnings, therefore, need to continue to grow throughout the
transformation process to achieve shared prosperity.

Figure 1: How economic transformation leads to shared prosperity

       Economic transformation                     Employment
                                                  transformation                         Reduced
       Structural transformation
                                                                                         poverty

        Sectoral transformation                   Inclusive growth                       Shared
                                                       of labor                         prosperity
                                                      earnings


Although economic transformation means that the agricultural the share of output and employment
contributed by on farm production will decline, labor and total factor productivity improvements in
the agricultural sector are nonetheless critical for economic and employment transformation. In
most low- and lower-middle income countries the absolute number of people working on the farm
will continue to rise, even as agriculture’s share of employment hours worked declines. This is
especially true in Africa, where a sluggish demographic transition is expected to result in strong labor
force growth for decades (Fox and Gandhi, 2021). This labor force growth – which will be mostly
young people - cannot all be absorbed by the nonagricultural sectors, as there is simply not enough



2
    See Timmer, (1988), for a discussion.


                                                   3
demand. 3 Many of these youth will need to work at farming. This means that raising on-farm labor
productivity and earnings is critical. 4
In poor countries still in their early stages of transformation, increasing output and earnings in
agriculture accelerates transformation. More than four decades ago, Johnston and Mellor (1961)
described how this comes about: improvements in agricultural productivity release resources to
other sectors, raise the nutritional status of workers, lower the costs of raw materials for industry,
earn foreign exchange, and increase the demand for other sectors’ outputs. More recent research
has confirmed that raising farm incomes through increased agricultural productivity creates
purchasing power that stimulates employment and output growth in non-farm sectors, especially in
value-added food chains and non-tradable goods and services (Christiaensen et al., 2011). Because of
these widely shared income and employment effects, output and productivity growth in agriculture
has reduced poverty more so than growth in other economic sectors in the earlier stages of
economic transformation (Ivanic & Martin, 2018; Beegle and Christiaensen, 2019), which is why
support for increased productivity in on-farm activities has long been a core part of Bank group
activities.
Recent research has identified the importance of robust value chains as critical to the process of
economic transformation. A value chain describes the “full range of activities required to bring a
good or service from conception, through different stages of production, to delivery to consumers
and finally, to disposal after use”. 5 It reflects the interdependence of innovation, design, production,
and distribution activities in an economy. A value chain approach has proved particularly important in
promoting the transformation of the agricultural sector, because bottlenecks in one part of the value
chain (e.g., input supply, transportation, distribution, or sales) can frustrate efforts to improve on-
farm productivity and earnings, and slow down rural transformation. Farmers know that supply does
not create its own demand – the journey from farm to fork can be a long one. Development of value
chains is recognized as the link between competitiveness and productivity on one hand, and
employment and earnings opportunities on the other – in other words, the link between dynamism
in primary production and shared prosperity.
In sum, LICs and LMICs, especially in Africa, need both agribusiness value chain interventions to
create new off-farm employment opportunities in the formal and informal sectors, as well as
projects to increase earnings on the farm, to realize the twin goals of poverty reduction and shared
prosperity.




3
  See, for example the analysis in Merotto, D., Jobs Strategy for Inclusive Growth in Uganda. World Bank
4
  Other key actions to support youth employment in agriculture in Africa include strengthening land markets. See
Chapter 4 in Filmer and Fox (2014).
5
  See https://www.jobsanddevelopment.org/wp-content/uploads/2018/07/Value-Chain-Guideance-Note.pdf


                                                        4
    Box 1: What does it mean to be working informally?
    The ILO has issued clear criteria (statistical standards) to identify informality as an employment outcome.
    These standards have two parts (i) people who are in informal production units (the informal sector); a
    production-unit based concept; and (ii) people who are employed informally, in either a formal or an
    informal production unit; a job-based concept.
            (i) The informal sector consists of production units that are not constituted as separate legal entities
            independently of their owners (they do business in the owners’ name, and usually do not have a
            separate bank account for the business). They are owned by individual household members or
            several members of the same or different households. Typically, they operate at a low level of
            organization and on a small scale. Earnings depend on income after costs of production; they are
            commonly called “nonwage earnings” or gross profits. They may be farm or nonfarm production
            units.
            (ii) Informal employment includes employees (people who work for a wage for someone who is not
            a member of their family) who (legally or illegally) are not subject to national labor protection
            legislation, income taxation, social protection, or entitled to certain employment benefits (advance
            notice of dismissal, severance pay, paid annual or sick leave, etc.). In some countries, farm wage
            workers are exempt from labor protection legislation, so they would be legally informally
            employed. On the other hand, owners of large and small businesses often illegally employ wage
            workers informally, as they do not want to conform to national labor legislation.
    As countries get richer, the share of employment in the informal sector declines. This happens mostly by the
    creation and growth of new modern firms. Rarely do informal production units formalize. As family farms
    commercialize, they may take on more of the characteristics of a formal firm; particularly in the agricultural
    sector informality/formality is a spectrum, not two exclusive categories.
    Informal employment is an important source of household income in most Bank client countries. It is very
    unusual to find formal wage employment constituting more than 50 percent of total employment in low and
    lower-middle income countries (Fox and Kaul, 2019).


3.         What jobs outcomes are supported in Bank agricultural projects?
Bank-supported agricultural projects support two main types of jobs outcomes within agricultural
value chains:
      •    New employment creation. This could be on the farm (a young person enters the labor force
           and starts farming), or off the farm, through an expansion production capability (a new
           processing business starts and hires labor, or more workers are hired at an existing product
           storage facility).
       •   Increases in the quality of existing employment. This could be (i) an increase in earnings from
           existing work on the farm through the use of new technology or increase in the value of
           production per hectare through enhanced use of irrigation (allowing more productive
           months of work per year); (ii) an increase in the stability of earnings through adoption of
           climate risk insurance or new, weather-resilient crop varieties or the increased use of formal
           labor contracts in wage employment; or (iii) increased health and safety on the job.
Bank-supported agricultural projects often indirectly support both outcomes outside of agricultural
value chains as well. An example would be the introduction of technology allowing family labor to
reduce their time in on-farm work and increase their time in rural non-farm activities such as retail
trade in household necessities or the provision of personal services such as hair dressing. 6

6
    See World Bank, (2017), for a discussion on the linkages between the farm and nonfarm economies.


                                                           5
Owing to the dominance of self-and family employment throughout agricultural value chains, and
across the production spectrum in rural areas and town, identifying these direct and indirect
outcomes within a project setting can be challenging. However, recent improvements in statistical
tools for measuring employment outcomes, as well as in national statistical capacity in low-income
countries, has increased the options available to Bank project design and supervision teams and
national project management units (PMUs).
In World Bank terms, a “job” is defined as an activity that generates actual income, monetary or in
kind, and that does not violate fundamental rights and principles at work (WDR 2013). In mental
models, a job is often associated with formal wage employment. But in middle- and low-income
countries other types of jobs are most common, including informal wage employment, farm-related
work, or own-account nonfarm work.
The Bank has developed a set of definitions and tools for identifying, measuring, monitoring, and
evaluating jobs outcomes in projects. These are based on the statistical standards set by UN agencies
for measuring and monitoring employment outcomes. A summary is provided below, for more
information see the Bank’s Jobs Monitoring Framework.
       •   Employment. In statistical terms, someone is employed if they are engaged in an economic
           activity that produces a good or service designated for sale.
       •   Unemployment. If someone is not employed, they may be actively looking for work, and in
           this case they are unemployed. 7
       •   Labor force participation (LFP). The labor force consists of people employed or unemployed.
           Anyone who is neither employed nor unemployed is out of the labor force (OLF) – a
           nonparticipant.
       •   Earnings is pay or profit, in cash or in kind, from work (per hour, day, or month). It is one
           measure of job quality.
       •   Other dimensions of job quality: (i) a formal contract (providing earnings stability and
           security); (ii) access to work-related social protection (such as unemployment insurance or a
           pension); (iii) protection from health and safety issues at work; and (iv) protection from
           forced labor, harassment, or discrimination.8
       •   Underemployment is working fewer hours than desired and available. In the agricultural sector
           seasonal inactivity is common. Underemployment may also reflect involuntary part-time
           work in nonfarm parts of the value chain.
Employment is conventionally defined over a one-week period. Thus, a farmer who harvests one
week, sells output the next, and then stops working for two weeks or more as the season is over
would be considered OLF during the post-harvest, post-sale period unless they were actively seeking
another employment opportunity. In rural areas, offseason employment opportunities may be
scarce. Thus, underemployment is chronic in farm households without investments that allow
economic activity all year. Examples of such investments would be: (i) irrigation, greenhouses, etc.,
which permit more crop seasons, or (ii) adding livestock, which is a year around activity. Farm
households often invest in a nonfarm business which they operate primarily in the off season – a
phenomenon known as “pluriactivity” or “multiple livelihoods”.
Some people may be OLF more permanently (e.g., all year). Many people who are OLF actually want
to work, but face constraints. Often women and youth do not participate in the labor force at all


7
    Note that unemployment requires an active job search, not just inactivity.
8
    These measures of job quality are often referred to as “decent work”. See ILO (2021).


                                                           6
because they cannot access employment opportunities so they do not actively seek work.
Constraints to LFP for women include the burden of household chores, subsistence food production,
and caring for others, or an inability to access land or capital to engage in productive self-
employment. Projects can help alleviate these constraints.
The ultimate goal of World Bank agricultural projects is to increase value creation on and off the
farm. As noted above, this almost always results in an employment outcome.
    •   On the farm, value creation is enhanced by increasing the productivity of the factors of
        production used on the farm. While most of the focus in project design is on increasing land
        productivity – because in most countries land is the scarce resource – the ultimate goal is to
        increase farmer earnings. Whatever non-labor production inputs the project is promoting
        (seeds, fertilizer or other inputs, irrigation or other methods of water management,
        mechanization, new farming methods), if these do not result in higher farmer earnings, they
        will not be adopted and the project will not be a success. This is recognized in the economic
        and financial analysis conducted as part of project design and appraisal.
    •   Post-harvest, value creation is enhanced through investments in storage and/or processing
        as well as technology transfer supported by the project, often complemented by
        infrastructure investments such as rural roads (to lower transport costs).
Job outcomes are therefore critical to the success of Bank-supported agricultural projects project
interventions. Individuals and households who are direct or indirect beneficiaries of World Bank
agricultural projects may experience positive or negative jobs outcomes as a result of project
interventions. It is important that these be identified at early stages of project preparation so that
they can monitored.
To track jobs outcomes, the Bank has developed the category of “Jobs Operations”. A “Jobs
Operation” is a WB lending activity that has an explicitly stated and substantive link to creating jobs,
improving the quality of existing jobs, and helping individuals connect to jobs or move to better jobs.
This means that activities are selected or designed with a focus on jobs or on addressing a jobs
challenge. Not all agricultural projects are jobs operations, but a most are, and designating them as
such would help the Bank track progress on this key priority.

4.    Identifying jobs outcomes during Bank-supported agricultural projects project
preparation
Given the importance of jobs outcomes to both higher level objectives within Bank’s country
strategy – the Country Partnership Framework – and to transformation of the agricultural sector,
jobs outcomes opportunities and targets should be considered, identified, explicitly stated, refined,
and measured at all stages of project preparation: sector and problem diagnosis, analysis and
selection of intervention options (project design), economic and financial analysis of intervention
costs and benefits (with disaggregation by beneficiary type), and implementation planning including
monitoring and evaluation. They should be specified in both the theory of change and the PDO
(including indicators). This is good practice, and will allow tracking outcomes through to project
completion.
Current practice with respect to farm-level interventions is to implicitly identify project jobs outcomes
in Theories of Change as productivity, and measure productivity gains only as land productivity (yields
per hectare). Earnings or income gains from increased labor productivity are often mentioned as an
ultimate (higher level) outcome. The implicit assumption is that more output per unit of land will
produce more income for the farmer. Following current practice, in these projects PDOs usually


                                                    7
include as a results indicator land productivity (yields per hectare), and number of farmers
benefitting from the project interventions 9 but they omit the key outcome of higher earnings (job
quality). However, the reason land productivity matters is that famer labor productivity and earnings
are low, resulting in poor higher level outcomes (impacts) – high rural poverty, low economic
welfare, lagging economic transformation. Alternatively, if project interventions do raise land yields
but do not result in increased labor productivity and earnings for the farmer, the results will not be
sustainable, and therefore will not contribute to the higher-level indicators.10 For this reason,
expected changes in farm earnings (net revenues per unit of time) from project interventions for the
crops supported are estimated as part of the project financial analysis. But they should be stated
tracked throughout the project.
Project PDOs and Theories of Change in value chain projects also tend to omit job outcomes at the
farm level, but increasingly they highlight the new off-farm jobs expected from project-supported
investments in downstream value addition. Good practice would be to track both jobs outcomes on
the farm and off-farm directly attributable to the project. Note that there could be negative and
positive jobs outcomes if jobs in informal processing activities (not supported by the project) are
eliminated – as a direct result of project-financed investments in more productive processing plants.
Both types of outcomes need to be tracked (see below).
Explicitly identifying and estimating jobs outcomes during project preparation helps to strengthen
project economic analysis. Economic analysis aims to estimate the development outcomes and
impact to justify a public sector involvement. Improved jobs outcomes (e.g., higher earnings) are a
development outcome which can be highlighted in the analysis. They have externalities in the
economy, which justifies a public sector involvement. 11
Most projects do not track employment outcomes in activities unrelated to agricultural value chains
– for example, starting a new nonfarm business activity. Although indirect, these outcomes are often
a direct result of project activities, as increased on-farm labor productivity may free up family labor
for other income producing activities. It is not recommended that possible indirect jobs outcomes be
included in the PDO and tracked with PDO indicators. However, these outcomes may be recognized
within the Theories of Change and results chain as part of the causal mechanism leading to the
higher-level outcome of reduce rural poverty. 12
Table 1 identifies the types of job outcomes attributable to interventions in Bank-supported
agricultural projects by type of intervention, and provides sample PDOs that explicitly identify these
outcomes. It also identifies suggested monitoring indicators, a topic to which we now turn.

5.      Measuring and monitoring jobs outcomes
Some sector specialists may find job outcome measurement daunting, especially with respect to on-
farm outcomes. However, tools have been developed and tested within the World Bank to measure
jobs outcomes which can be used as part of a monitoring program. These tools can be applied at the



9
  This measure is used for a Corporate Results Indicator – number of farmers adopting new technologies.
10
   Reasons why increased yields might not translate into increased labor productivity or earnings include the cost
of the new technology, lack of market for the product, causing a price fall, and the labor intensity of the
technology (resulting in lower labor productivity).
11
   For a further discussion and methodological guidance, see Economic Analysis of Jobs Investment Projects.
12
   See World Bank (IEG, 2017) for a discussion.


                                                         8
household/farm level (for farm outcomes) or at the business/sectoral level (for value chain jobs
outcomes).
In defining which job outcomes to measure and monitor in a project, understanding underlying
heterogeneity is key. Most agricultural projects already disaggregate outputs and outcomes by
gender in results monitoring frameworks; some also disaggregate by age (youth vs. older adults). In
some cases, poorer farmers are targeted in the project and the effectiveness of the targeting is
monitored as well. Access to employment and earnings opportunities are often not equal within the
household. As a result, it is important to consider and track employment outcomes in a
disaggregated manner for individuals in the household who may be direct or indirect beneficiaries of
Bank projects.
Projects may also target small and medium enterprises (SMEs), or micro and household enterprises
(e.g., microfinance clients). It would be helpful for sector-specific considerations to drive these
decisions. However, it is important to recognize that all other things being equal, larger formal
businesses tend to create better jobs.
Measuring farm level job outcomes
Most Bank client countries regularly collect data at the farm level for the purposes of tracking sector
progress, and diagnosing challenges. Measuring farm level outcomes is generally done through
sample surveys, either national household income and expenditure surveys, or specialized farm
surveys such as agricultural censuses. These data should contain information on job-related
outcomes. National data are usually used during project preparation, for sector diagnosis (as
described in the sector and institutional context section of the PAD), as well as for the required
technical, economic, and financial analysis. Additional, specialized data may also be collected during
project preparation, using trust funds, PPFs or other funding sources.
Bank agricultural projects regularly monitor on-farm outcomes (e.g., yields per hectare), usually at
baseline, midterm, and project end. It is critical that baseline indicator measurement is done before the
project begins. Measure of employment outcomes, such as hours worked and earnings, can be done
at the same time as baseline indicators are collected on yields per hectare.
    •   Collecting data on LFP and employment. Individuals in farm households often undertake
        different employment activities at different times of the year. It is helpful to collect data on
        the labor calendar of individuals – data on the extent of participation, employment, and
        underemployment. Full Time Equivalent (FTE) is a useful measure – it recognizes that hours
        vary substantially, and allows aggregation over the year and across individuals. Qualitative
        information on what drives the labor calendar of individuals and why it shifts is important,
        and can be gathered at baseline and project end. For example, Bank research discovered that
        a land registration project in Ghana allowed women to devote more time to higher-earning
        non-farm activities (Agyei-Holmes, 2020).
    •   Collecting data on labor earnings. Farm households may have multiple income sources
        (including unearned income such as transfers from urban relatives, repayments of loans to
        family or friends, etc.). Projects do not need to track all these sources. The key variable
        should be earnings from the crop agriculture activity(s) the project is promoting (divided by
        hours worked growing the crop or crops). Ideally, this would be the value of sales of each
        crop less the cost of inputs, divided by the labor input of the farmer (output per unit of
        labor). If a farm has multiple plots and crops, it could be difficult to collect these data. Project
        teams can explore using substitutes such as revenue per plot (using average farmgate price)
        divided by average hours worked per plot.


                                                     9
     •   Collecting data on job quality. Measuring beneficiary satisfaction using qualitative surveys is a
         regular part of Bank project monitoring. This data collection can include measures of
         perceived job quality among beneficiaries, including income stability and risk, satisfaction
         with earnings gains (if any) and with overall opportunities.
Measuring concepts such as farm labor input and net revenues per plot requires specialized
instruments. The Bank’s Living Standards Measurement (LSMS) Team has devoted much of the last
ten years to survey research to identify effective techniques to do this. 13 These techniques are now in
use by many national statistics offices (NSOs) in Bank client countries. A review of what data
collection instruments are already in use in country – using local languages and terminology, with
survey manuals adapted to local settings, can be done early in project preparation. It is sometimes
possible to work with NSOs to incorporate needed project monitoring into national statistical
programs. If consultants are hired to collect additional data, working with instruments tested and
validated by NSOs is advisable.
Finally, project monitoring plans are expected to set targets (at the minimum, for endline results
analysis). These can be estimated during the economic and financial analysis based on the farm
modeling techniques used. However, qualitative research to detect underlying behavioral trends and
preferences, (e.g., focus groups) may be needed at midterm to check the validity of the assumptions
underlying the models guide any necessary revisions of monitoring indicators.
Measuring value chain project outcomes
The starting point for the design of a value chain project is the value chain survey, which measures
and maps the value added at each processing stage, from raw material to consumer. This involves
use of farm and firm (enterprise) survey data, as well as conducting specialized surveys of firms in
the sector. This background work should help uncover, for each production stage off-farm: (i)
industry structure - how many firms there are, what is the cost structure of the firms, and how
competitive they are (including a distribution of productivity); and (ii) where the jobs are, compared
to the value added. The Bank’s Trade and Competitiveness (T & C) GP is the lead unit supporting
these types of studies. Together with the Jobs Group, they have developed toolkits for this analysis,
including a toolkit on measuring baseline employment by demographic and occupation. This toolkit
includes simplified instruments for collecting employment data from enterprises as well as
commercial farms.
Depending upon the industry, value chain survey data may be collected on only a sample of firms in
the industry, or on all firms. For industries with a large number of SME wholesalers and processors,
collecting data on a sample of firms is necessary, but this can be challenging as the total universe of
firms may not be known. It may be necessary to combine enterprise data collected by the national
statistics office, with household survey which includes a nonfarm enterprise module to get a
statistical picture of the relevant subsector.




13
  See https://www.worldbank.org/en/programs/lsms/initiatives/lsms-ISA, as well as these reference materials
available on the site: https://documents1.worldbank.org/curated/en/658231560260668780/pdf/Employment-
Data-in-Household-Surveys-Taking-Stock-Looking-Ahead.pdf?deliveryName=DM120829 and
https://documents1.worldbank.org/curated/en/336141630489348107/pdf/Employment-and-Own-Use-
Production-in-Household-Surveys-A-Practical-Guide-for-Measuring-Labor.pdf?deliveryName=DM120829. Survey
instruments and resources are also available on the website of the 50 x 20320 project (the Bank is a partner).


                                                       10
Even if detailed data are only collected on a sample of firms, it is important to collect and monitor
baseline and endline data on total employment, at all value chain stages, for the following reasons. 14
     •    In a dynamic and growing industry, existing firms may grow sales and employment, shrink
          sales and employment, or even exit the industry entirely. New firms may enter. The result of
          this process could be an increase or decrease in the number of firms, with a positive,
          negative, or zero effect on employment.
     •    If the industry has low labor productivity at the outset, the needed intervention could be
          substituting capital for labor (or simply adding capital). This intervention would increase
          competitiveness but not create any jobs directly; indeed jobs could be lost.
     •    The project may not include all firms in the industry. Project beneficiary firms might increase
          sales and employment, but mostly by taking business away from firms not participating in
          the project. If the project only monitors employment outcomes in the firms benefitting
          from the project, project outcome data could end up overestimating employment
          outcomes.
When collecting and aggregating employment data for each stage of the value chain, it is good practice
to use the FTE concept (described above). Wage jobs within the off-farm parts of the value chain may
be as seasonal as the harvest itself is. Unless a processor is storing the production of, for example, a
tree crop which has only one harvest a year (e.g., fruits or nuts), newly created processing jobs in
factories supported by the project would not provide year-around employment. 15 The quality of jobs
created would therefore be lower.
Manufacturing (including agro-processing) has become more capital intensive over time as machines
are invented which perform tasks more consistently than workers. Export manufacturing industries,
as well as import-competing ones, have to adopt this technology in order to meet consumers’ quality
standards. As a result, it is possible that a value chain intervention could result in negative
employment outcomes at the processing stage (while substantially benefitting small-holder farmers
supplying the raw material). Projects need to consider the possibility of such negative employment
outcomes at the design stage. If either a mass-layoff event or factory closure appears likely or even
possible in the industry, project design would need to include measures to mitigate some of the
negative effects on existing employees (e.g., severance pay, job search assistance).

 Box 2: Challenges in measuring “Jobs Created” in a value chain project - The Cote d’Ivoire Cashew
 Competitiveness Project
 A final point on measuring jobs outcomes – reporting bias. It is not uncommon for value chain
 projects to depend on the financial intermediaries providing credit for new investments to collect
 employment data, or the PMU itself to request these data from participating firms and collate it.
 When beneficiary firms know that creating jobs is a key objective of a project, they will report this
 outcome- or over-report it. In his analysis of the outcomes of the Nigerian business plan
 competition, David McKenzie (2015) surveyed winning firms on a number of variables, including
 employment creation. He compared the amounts reported on his survey with the amounts firms
 reported to program administrators in the forms the filed to receive tranche payments. Based on
 his survey data, he concluded that the winning firms would have no trouble meeting the job

14
   Sources for data on total employment include enterprise surveys (done by the World Bank or the NSO), social
security or labor tax administrative data, often reported in published national statistics (useful when most
employment is formal), or labor force surveys.
15
   Processing and storage facilities may provide post-harvest, off-season jobs for farmers, however, reducing their
underemployment and adding to total income. This issue can be investigated during preparation.


                                                         11
creation triggers for payment, as these triggers were set pretty low. However, despite this, 75
percent of the winning firms he surveyed reported more employees to the program than they did
in his survey. This suggests that using an independent contractor to collect data on jobs created -
as part of a detailed survey of beneficiary firms – might be warranted.
The Cote d’Ivoire Cashew Competitiveness Project (P158810) was approved in March 2018, and
was cited in the IDA19 JET framework paper as a positive example of a whole-of WBG approach to
realizing jobs objectives. The JET framework paper notes that 12,000 direct jobs are expected to
be created in a new domestic processing sector to be developed under the project.
The project finances (through a dedicated loan financing facility) four new cashew processing
platforms (sectoral industrial parks). The cashew processing platforms include: (i) warehouses for
storage of raw cashew nuts; (ii) cashew processing plants (to remove shells and package the
roasted nuts for export, and to roast cashew nuts for local consumption); and (iii) plants to extract
cashew nutshell liquid and process cashew nutshell cake (byproducts used for animal feed and
other purposes). As these platforms would contain entirely new processing facilities, it can be
assumed that the bulk of the new jobs created would be found in these new, modern facilities at
the processing platforms.
Project documentation notes that at the start of the project, existing processors had high
processing costs and low labor productivity, with less than 50 percent of installed cashew
processing capacity being used (PAD, page 3). These processors, as well as existing wholesale
traders (engaged in farm-level purchasing, sorting, storage, and transport to processors) will be
able to benefit from a dedicated financing facility (loans or grants depending on firm size) to help
them upgrade their facilities in order to compete with the new processing platforms.
The off-farm jobs outcome (for jobs in the processing facilities) is included in the results
framework as an intermediate indicator:
    •   Number of jobs created within the cashew processing platform, with a baseline of zero and an
        endline target of 12,000, of which 50 percent should go to women.
It is difficult to judge the feasibility of the 12,000 new jobs estimate. The PAD contains a detailed
financial analysis for both the storage/warehouse level and the processing level of the value chain
which does not explicitly state expected employment numbers or wage costs. However, the PAD
quotes a UNIDO estimate that cashew processing in Cote D’Ivoire could eventually employ over
400,000 people. As a net new jobs estimate, 12,000 over the project period could therefore be
high or low.
No data are provided on the number of jobs in existing processors (for comparison). Certainly if
the current plants have excess capacity, they could process more cashew without hiring many
more workers. However, they might also be forced to close if they cannot compete with newer
plants supported by the project (even after investments in upgraded facilities which could be
supported by the project).
There is no discussion of the expected quality of the potential new jobs (e.g., seasonal or full-time;
wage and skill levels, social protection benefits, etc.).
Overall, the project (as detailed in the PAD) is a good example of how successful bank-supported
agricultural value chain projects can support ambitious JET agendas in client countries. While it is
commendable that this project plan included a jobs outcome indicator (and that the jobs and
livelihood aspects were highlighted throughout the PAD), a clearer focus on job quality



                                                  12
 throughout the value chain, including in existing processors in the project areas, could lead to a
 more complete monitoring and evaluation plan with respect to jobs outcomes.
 For example:
     •   a baseline warehouse and industry jobs estimate would have been helpful;
     •   as a monitoring indicator, a sector or subsector-wide net jobs measure would have
         provided more information on the intervention’s actual jobs results;
     •   the target of 50% female employment on the platform is commendable, but it could be
         helpful to know whether the female jobs would have the same average pay as the male
         jobs;
     •   it could be helpful if job quality in enterprises supported by the project could be monitored
         as well as number of jobs; and
     •   it would be helpful if farm-level earnings from cashew orchards were estimated at
         baseline, monitored during the project, and evaluated at completion.



6.       Conclusion
Bank-supported agricultural projects crop agriculture projects have implicitly supported a JET
framework approach to sector growth and development. The reasons are obvious - agricultural value
chains provide employment opportunities to the majority of the labor force in low and lower-middle
income countries. Yet Bank-supported agricultural projects have not always recognized, identified,
and tracked these outcomes, despite their importance to project beneficiaries and governments.
This note discusses why focusing explicitly on employment outcomes is important to Bank and
country goals and strategies as well as the success of crop agriculture projects, and provides
suggestions on how this focus can be made operational.




                                                  13
References
Allen, T., Heinrigs, P., & Heo, I. (2018). “Agriculture, Food, and Jobs in West Africa.” West African
Papers, No. 14, OECD Publishing, Paris, https://doi.org/10.1787/dc152bc0-en.
Agyei-Holmes, A., Buehren, N., Goldstein, M., Osei, R., Osei-Akoto, I., & Udry, C. (2020). “The Effects
of Land Title Registration on Tenure Security, Investment and the Allocation of Productive
Resources: Evidence from Ghana.” Policy Research Working Paper WPS 9376. Washington DC: World
Bank Group.
Beegle, K., & Christiaensen, L. (2019). Accelerating poverty reduction in Africa. Washington, DC: World
Bank Publications.
Christiaensen, L., Demery, L., & Kuhl, J. (2011). The (evolving) role of agriculture in poverty reduction:
An empirical perspective. Journal of Development Economics 96(2), 239–254
Fox, L. & Gandhi, D. (2021). Youth employment in Africa: Progress and prospects (Africa Growth
Initiative Working Paper No. 28). Brookings Institution.
Fox, L., and Kaul, U. (2018). “The Evidence Is In: How Should Youth Employment Programs in Low-
Income Countries Be Designed?” Policy Research Working Paper WPS 8500. Washington DC: World
Bank Group.
ILO. (2021). “Measuring Decent Work.” https://www.ilo.org/integration/themes/mdw/lang--
en/index.htm.
Ivanic, M., & Martin, W. (2018). Sectoral productivity growth and poverty reduction: National and
global impacts. World Development 109 (September), 429–39.
Johnston, B. F. & Mellor, J. W. (1961). The role of agriculture in economic development. The American
Economic Review 51(4), 566–593.
McKenzie, D. (2017). Identifying and Spurring High-Growth Entrepreneurship: Experimental Evidence
from a Business Plan Competition. American Economic Review, 107 (8): 2278-2307. DOI:
10.1257/aer.20151404
Merotto, D. 2019. “Uganda: Jobs Strategy for Inclusive Growth.” World Bank, Washington, DC.
Timmer, C. P. (1988). “The agricultural transformation.” In Chenery, H. & Srinivasan, T. N. (Eds),
Handbook of Development Economics, (Vol. 1, pp. 275–331).
Townsend, Robert, Benfica, Rui Manuel, Prasann, Ashesh, Lee, Maria (2017). Future of Food: Shaping
the Food System to Deliver Jobs. Washington D.C.: The World Bank.
https://openknowledge.worldbank.org/handle/10986/26506

World Bank (2013). World Development Report 2013: Jobs. Washington D.C.: The World Bank.
World Bank (Independent Evaluation Group), (2017). Growing the Rural Nonfarm Economy to Alleviate
Poverty – An Evaluation Contribution of the World Bank Group. Washington D.C.: The World Bank.




                                                    14
Table 1: Identifying and Monitoring Jobs Outcomes of Crop Agriculture Projects
Type of project/intervention           PDO examples                                                Possible Jobs               Job-related PDO Indicators       Challenges           Resources
                                                                                                   outcomes                    (examples)
1. Projects designed to improve        Current:                                                    Improved job quality:                                        •   Seasonality in   Survey measurement
on-farm land and/or labor              -to increase agricultural productivity of smallholder       -increased earnings per     -revenue per hectare                 employment       guidance and model
productivity, usually through a        farmers in targeted areas                                   unit of land                                                     activities       instruments:
combination of research, direct                                                                    -reduction in seasonal      -time spent on the farm over     •   Estimating       (1)
provision/financing of inputs, and     Recommended:                                                underemployment             the year or number of crop           crop income      https://www.worldbank
extension/capacity building, as well   -to increase on farm labor and land productivity of         -increased earnings         seasons per year (FTE)                                .org/en/programs/lsms
as improvements in rural               smallholder farmers in targeted areas.                      stability                                                                         /initiatives/lsms-ISA
infrastructure (transportation,                                                                                                                                                      (2)
irrigation, storage, and logistics,                                                                                                                                                  https://www.50x2030.o
etc.).                                                                                                                                                                               rg/resources/survey-
                                                                                                                                                                                     instruments
2. Improve access to farming           Current:                                                    Labor force participation   -share of adults in household    As above
opportunities (e.g., for refugees,     -to improve access of poor and vulnerable households                                    employed
youth, vulnerable groups) through      in selected communities to financial services,              Improved job quality (as
access to land (or more secure land    opportunities for generating income                         above)                      -revenue per hectare
tenure), knowledge, inputs
                                       Recommended:                                                                            -time spent on the farm over
                                       -to increase labor earnings of poor and vulnerable                                      the year or number of crop
                                       households                                                                              seasons per year (FTE)

3.Value Chain projects, which          Current                                                     New employment created      -total jobs in processing of x    • Universe of       Jobs in Value Chain
increase post-harvest value addition   -to increase the number of farmers benefitting from                                     commodity, with and without         firms engaged     survey toolkit:
by enhancing the competitiveness       commercial agricultural value chains.                                                   contracts                           in post-          https://documents1.wo
post-harvest of value addition         Recommended:                                                                            -total (FTE) hours worked in        harvest value     rldbank.org/curated/en
activities or strengthening the        -to increase the number and earnings of farmers selling                                 processing plants                   addition          /53517153383128385
upstream supply chain                  the production through commercial agricultural value                                                                        activities may    4/pdf/129350-WP-
                                       chains                                                      Improved Job quality        -earnings per hour in               not be known      Jobs-in-value-chains-
                                                                                                   -earnings                   processing plant                  • Recent data       survey-toolkit-
                                       Or                                                                                      - revenue per hectare               on                PUBLIC.pdf
                                                                                                                                                                   employment
                                       Current:                                                    -safety                     -labor-related injuries in          in sector or
                                       -to increase productivity, quality and value-added,                                     processing plant                    sub-sector
                                       benefiting smallholder farmers and the processing                                                                           may not be
                                       industry.                                                                                                                   available
                                       Recommended:                                                                                                                (Labor Force
                                       --to increase productivity, quality and value-added (in x   -job satisfaction           -workers able to work as            survey data
                                       crops), raising the earnings of smallholder farmers and                                 many hours as they want             may not be
                                       increasing output and employment in the processing                                                                          collected
                                       industry.                                                                                                                   regularly)




                                                                                                       15