Introduction
Over the past five decades, the government of the United States, through the U.S. Agency for International Development (USAID), has invested limited funds in international agricultural research to enhance global food security. Some funds have been invested in the Consultative Group on International Agricultural Research. Other funds have been used to link researchers in the U.S. university community, the Department of Agriculture, and the private sector with counterparts in low- and middle-income nations with an aim to increase food system performance by improving crop, livestock, fisheries, and natural resource productivity. One of the most important vehicles for USAID’s international efforts has been the Collaborative Research Support Program (CRSP) which originated in 1978 and rebranded in 2012 as the Feed the Future Innovation Labs (FtFIL).
Investment in agricultural research, and the development of novel innovations, is widely acknowledged as an important strategy to promote food security and economic development in low-income countries. Technological innovation increases agricultural productivity, enhances resilience of local food supply, and stimulates production of greater surpluses thereby freeing labor, capital, and additional resources for usage in other areas of the economy (Hayami and Ruttan, Reference Hayami and Ruttan.1985; Mellor, Reference Mellor2017). However, the path from research investment to innovation and impact is not always successful. Scientific inquiry can lead to a dead end, or novel innovations are not always adopted because of behavioral, economic, or resource barriers. These challenges and barriers make investment in agricultural research risky. Nor, even when successful, are all research investments likely to have similar levels of economic or poverty impact. This will depend on their nature, scale of diffusion, and who adopts them.
Increasingly, research managers, donors (and their constituents), and scientists are demanding evidence of the value of investment in agricultural research in order to evaluate funding allocation decisions. Previous studies have found large variation in returns among specific research projects, although returns have been high on average. Alston et al. (Reference Alston, Marra, Pardey and Wyatt.2002) reviewed the benefits and costs of agricultural research from 289 studies from around the world and found an average internal rate of return of 54% per year. A more recent review of 492 studies (Rao, Hurley, and Pardey, Reference Rao, Hurley and Pardey.2019) found that agricultural research has earned similar average rates of return in developing and developed countries, and average returns have remained high over time. Even in relatively austere agroecological environments, returns to agricultural research have often been high. Zereyesus and Dalton (Reference Zereyesus and Dalton.2017) estimated an annual rate of return between 54–76% on a narrower set of innovations targeting sorghum and millet in semi-arid areas of the world. As far as USAID’s investment in the CRSP and FtFIL system, there have been a few studies that have evaluated the impacts of individual projects, and recently, Glauber, Kraybill, and Mercier (Reference Glauber, Kraybill and Mercier.2019) reviewed evidence on how these projects may sometimes produce reciprocal economic benefits for the United States. However, there has been no review of the documented returns and economic impact of USAID investment in the CRSP and FtFIL system in developing countries. The purpose of this study is to contribute to filling this void.
While the CRSP and FtFIL programs have existed for more than 40 years, evidence on the impact of these investments on global agricultural development is lacking. The program continues to pursue multiple objectives that include human and institutional development, technological innovation, public policy support, nutritional improvement, and natural resource management, among others (USAID, 2012). Focal areas and programmatic content have changed over time. As such, evaluation of the program presents several challenges. We approach this challenge by conducting a meta-analysis of published impact studies conducted by various programs and innovation labs. As such, this is not a comprehensive evaluation of all research and development activities conducted throughout the history of CRSP and FtFIL. It is opportunistic and relies upon the past initiatives of programs to document their activities, outputs, and impacts. This meta-analysis is compared against historical investment patterns in CRSP and FtFIL to suggest that despite having a limited number of studies that evaluated impacts from past R&D projects (certainly not a comprehensive perspective), these studies document societal benefits that are 5.2–8.5 times greater than the total investment by USAID over the life of these programs. Moreover, it is highly likely that most of these impacts led directly to higher incomes and less poverty among households at the lowest end of the income strata.
Background on U.S. Investment through the CRSPs and Innovation Labs
The CRSP was authorized by a Congressional Amendment to the Foreign Service Act in 1975 and formally launched in 1977. The program, created under Title XII of the Act, provided the primary vehicle for university linkages with foreign collaborators in agricultural, nutritional, and natural resource management research. The primary objectives of the Congressional authorization, again renewed in 2000, sought to “achieve the mutual goals among nations of ensuring food security, human health, agricultural growth, trade expansion, and the wise use of natural resources” through the mobilization of “the capacities of the United States land-grant universities, other eligible universities, and public and private partners in the United States and other countries” (22 U.S.C 2220). Foundational to the Act was the emphasis on multiple objectives of research, teaching, and extension, common with the 1862 Morrill Act establishing the land-grant university system (22 U.S.C. 2220a Section 297 of Public Law 94-161). More recently, in 2016, the Global Food Security Act was signed into law with bipartisan support thereby reaffirming Federal government’s commitment to international agricultural research and development consistent with the original mandate. This Act was reauthorized into law in 2018 for an additional 5 years (PL 114-195).
Annual funding allocations since 1978 to the CRSP program and Innovation Labs, in constant 2016 dollars, are presented in Figure 1. The annual investment in research and development is highly variable over time with three distinct points in time worth mentioning. After inauguration of the CRSP mechanism in 1977 and as new programs were formed, there was a large increase in funding towards long-term training for several institution-building programs at foreign universities and agricultural research institutes. A little more than a decade later, USAID nearly exited agricultural development and CRSP funding fell to its lowest level in nearly 20 years. Funding recovered at the end of the century and then trended lower until the launch of the Feed the Future Initiative in 2010. Funding increased to a new high where it has remained since the passage of the Global Food Security Act of 2016. Overall, USAID invested approximately US$1.24 billion in the CRSP and FtFIL programs between 1978 and 2018.Footnote 1
CRSP and Innovation Lab investment from 1978–2018 (US$ 2016).
During the Feed the Future phase of the program, numerous new Innovation Labs were commissioned and labs that date to the CRSP era were reorganized. Investments were targeted at the most pressing agricultural challenges facing food security globally as well as toward specific issues of importance to countries that were the focus of the Feed the Future initiative. Figure 2 disaggregates total funding into its component areas identified by the title of the investment, broadly divided into nine areas representing cereal crops, grain legumes, horticulture, livestock, fisheries, post-harvest loss prevention, crop and natural resource management, human nutrition, and policy. Research on crops, livestock, and natural resource management has accounted for about 82% of program expenditures, with research on fisheries, policy, nutrition, and post-harvest loss prevention making up the remainder. These are direct allocations to specific CRSP or ILs and thus do not capture how the programs and labs allocated funds to activities. This categorization does not account for investment that was directed at “cross-cutting” thematic areas. An example would be research that aims to lower child malnutrition by increasing smallholder dairy productivity would be assigned to livestock though its major aim or theme is nutrition.
Distribution of CRSP and Innovation Lab funding by year and programmatic area (US$ 2016).
Methods and Data for Meta-Analysis
Meta-analyses can be used to synthesize multiple studies over a similar topic and have been used in several studies on the returns to agricultural research (Alston et al., Reference Alston, Marra, Pardey and Wyatt.2000, Reference Alston, Marra, Pardey and Wyatt.2002; Maredia and Raitzer, Reference Maredia and Raitzer.2010; Raitzer and Kelley, Reference Raitzer and Kelley.2008; Rao, Hurley, and Pardey, Reference Rao, Hurley and Pardey.2019; Zereyesus and Dalton, Reference Zereyesus and Dalton.2017). Best practices for doing so have been established for the social sciences (Stanley et al., Reference Stanley, Doucouliagos, Giles, Heckemeyer, Johnston, Laroche and Nelson2013). We follow these practices to maximize the number of data points under consideration, to minimize compilation and coding errors, and to improve overall transparency and quality of the analysis.
Beginning in July 2017, a literature review identified several hundred reports that evaluated the impact of CRSP or Innovation Lab technological innovations.Footnote 2 Online search engines such as Google Scholar, economic literature databases such as EconLit, AgEconSearch, JSTOR, and Agricola were used for the search. Key words such as “CRSP,” “Innovation Lab,” “rate of return,” “impact,” “costs and benefits” were combined in strings to identify the studies. “Snowballing” of the manuscripts was conducted to identify additional sources until no new studies were revealed. The studies, dating from 1993 to 2016, covered a broad range of innovations, used varying evaluation techniques, and were conducted under differing assumptions.
The reviewed studies include publications in peer-reviewed journals, book chapters, and evaluation and impact reports, as well as unpublished papers (such as a M.S. and Ph.D. theses or other gray literature). We then evaluated each study to determine whether they included information on the costs and benefits of a CRSP or FtFIL innovation. Many reports were not included in the meta-analysis because of their qualitative nature or lack of transparency on assumptions and data. We then screened for eligibility based on the analyst’s assumptions underlying the calculation of benefits and costs, clear attribution to U.S. investment, and the geographical impact of the research. Studies that described spillover benefits into the United States were excluded, as were any studies with only ex ante assessments (i.e., where estimates of benefits were based only on anticipated or potential uptake of the innovation by users). The screening and eligibility assessment resulted in 46 studies with measurable ex post economic impacts in developing countries. These form the core of our meta-analysis. See Appendix A for a list of these studies plus four others referred to in this review.
The studies focused on the benefits to farmers and consumers from the process of technological innovation. None of these studies included benefits and costs associated with other elements of the collaborative programs such as human and institutional capacity development, nutritional, or environmental effects, although some described these impacts qualitatively. A few studies overlapped, meaning they evaluated the same technology but with varying degrees of evidence on adoption. Redundant estimates of benefits from the same technologies were removed, as were any studies that relied on strictly ex ante assumptions about technology adoption (i.e., inclusion in the meta-analysis required evidence that substantial farmer adoption had actually occurred). The approach of this review is to aggregate the unique economic impacts identified by these case studies and contrast this against the total investment by USAID in research and development through the CRSP and FtFIL mechanisms, considering the uncertainty surrounding some of the estimates of impact.
Table 1 lists the studies identified through the literature search on the economic impacts of CRSP and FtFIL research. These are sorted according to their topical focus, geographical area, and commodity. In most of these impact analyses, there is considerable uncertainty about the precise value of the welfare effect of the innovation. Studies are often conducted before the innovation reached obsolescence so the estimates of future stream of benefits must be made under varying assumptions on the roll-out of benefits and the scale of their effects. Benefit estimation is also affected by market characteristics, such as elasticities of supply and demand, which are not known with certainty. Most studies provide a range of benefit estimates based on different assumptions about the underlying parameters used in the calculation. The meta-analysis considers these assumptions by treating each scenario or sensitivity analysis as an estimate of the true value of the impact estimate. To estimate the value of the benefits from these innovations, Monte Carlo simulation is conducted where each scenario of a study is randomly sampled as the impact estimate of the study. The total value of the impact from all 46 case studies is then recalculated by sampling with replacement 500 times. This approach generates a distribution of estimated total impact that represents all possible combinations of outcomes rather than a point estimate at each study’s mean. This allows for the exploration of all the varying assumptions present in each case study and hence pessimistic or optimistic “what-if” scenarios. The Monte Carlo simulation was conducted using the Simetar spreadsheet add-on program.
List of studies on economic impacts of CSRP-IL research
Only first authors listed. See Appendix A for complete references.
It should be evident from the list of studies in Table 1 that the coverage of the impact studies identified in this review does not reflect the distribution of the investment across the CRSP and FtFIL research portfolio described in Figure 2. Thirty-two percent of the impact studies are on Integrated Pest Management (IPM) innovations for a variety of crop species, including vegetables and fruits, 36% on varietal improvement in grain legumes, 11% on cereal crop varieties, 19% on post-harvest loss reduction, and 2% on livestock husbandry. Some of the grain legume research projects were evaluated both for on-farm productivity gains and post-harvest loss reduction. We have very little benefit-cost information on the impact of nutritional, human health, and livestock research and no information on the impacts of research on natural resource management, policy, and fisheries. However, the absence of evidence on impact of some parts of the research portfolio should not be interpreted as a lack of actual impact from this research, as there has been no systematic effort to measure impacts from all the research projects carried out by CRSP and FtFIL. In fact, the case studies included in this review represent 5% or less than that of all the projects funded by USAID through these programs over the 40-year study period. The 46 impact studies cataloged over this 40-year time horizon convert to an average of 1.2 assessments produced per year.
The lack of information across the entire portfolio limits our ability to inform research resource allocation based on efficiency criteria. The findings are restricted to an overall comparison of the total investment pattern to just a small subset of case studies with benefit calculations that are not representative of the portfolio of programs nor the scale of technology development.
A second dimension of this meta-analysis is to explore welfare implications of the economic impacts of CRSP-FtFIL research, especially, the extent to which this may have reduced poverty. The studies listed in Table 1 show a wide geographic distribution with impacts accruing over different periods of time. While a precise analysis of the welfare effects is not possible given the data available, we can draw some general conclusions by looking at the extent of poverty in the countries where significant economic impact was achieved and using this to estimate the likely share of total benefits accruing to poor households. We premise this approach on the assumption that the economic benefits from the projects listed in Table 1 are widely shared across income classes within a country. Technology adoption raises income of farm adopters and, through market-level effects, reduces prices paid by consumers for food. In almost all the case studies listed in Table 1, the commodities affected by new technologies are produced predominantly by smallholders, who tend to congregate on the lower end of the income scale. For consumers, income elasticities for these commodities (especially food staples) are likely to be positive but small, meaning that per capita levels of consumption do not vary much across income classes (and, as a percentage of total expenditure, are higher for poor households). Thus, it is reasonable to assume that benefits are roughly evenly distributed across the income strata of a country, and therefore, the share of benefits accruing to those below a poverty line will be correlated with the poverty headcount index for that country at the time these impacts occurred. This is consistent with recent studies that have found that in low-income countries, income gains from agricultural growth are much more evenly distributed across income strata than growth in sectors like natural resource extraction, industrial development, and urban-based services (Ivanic and Martin, Reference Ivanic and Martin.2018; Ligon and Sadoulet, Reference Ligon and Sadoulet.2018). Moreover, studies often find that for low-income countries, within the agriculture sector, growth in staple food crop and livestock have even stronger effects on poverty reduction than growth in non-staple commodities (e.g., Diao et al., Reference Diao, Nin-Pratt, Gautam, Keough, Chamberlin, Hou, Puetz, Resnick and Yu.2005).
To assess welfare impacts across countries, we focus on mean estimates of the distribution of net present values (NPV) that study authors estimated and assume this represents the expected value of income benefits accruing to the country where technology adoption occurred. In the case studies, the NPV is given in US$ at official exchange rates. We convert the estimates into its purchasing power parity (PPP) equivalent to facilitate international comparisons of welfare (PPP$ compares the cost of a similar basket of consumer goods across countries) and World Bank poverty rates, which are defined in terms of PPP$ per capita. We apportion NPV by year over the lifespan of the project to get an annual stream of benefits.Footnote 3 To get an estimate of the benefits accruing to poor households, we multiply annual benefits by the poverty head count index for a country in that time period and re-aggregate these poverty-weighted benefits. The total income benefits accruing to poor households are thus found from:
$$ {\rm Benefits\ to\ poor\ households}=\sum\nolimits _{t\,=\,1978}^{2020}\sum\nolimits _{c\,=\,1}^{C}\sum\nolimits _{i\,=\,1}^{I}{\rm Pov}_{ct}*V_{ct,i}$$
where V ct, i is the net annual benefit from project i (measured in constant 2016 PPP$) in country c in year t and Pov ct is the poverty headcount index for that country and time period. This, of course, is only an approximate measure of the share of economic impacts accruing to poor households and depends on the strong (though not unrealistic) assumption that productivity gains in food staples in low-income countries are widely shared across the population.
Equation (1) can be thought of as a social welfare function which sums up the poverty-weighted incomes of each individual in the population, where the weight reflects the income shortfall of the poor. Foster, Greer, and Thorbecke (Reference Foster, Greer and Thorbecke.1984) postulate a class of such poverty weights as a function of societal aversion for poverty. Indifference to poverty gives everyone’s income the same weight, while a strong aversion to poverty might give, for a specified poverty line, a weight of 1 to the income of poor households and 0 to the income of nonpoor households. An even stronger aversion to poverty might give an increasing weight to those individuals with incomes farther below the poverty line. Poverty data are from World Development Indicators and interpolated for missing years. The analysis is conducted for three poverty lines in PPP$/capita/day: $5.50, $3.20, and $1.90.
Results and Discussion
Cost-Benefit Analysis of University-Led Agricultural Research
Figure 3 presents the results of the Monte Carlo simulation analysis showing the median and distribution of aggregated benefits from the 46 case studies of economic impacts from university-led agricultural research. Impacts are expressed in both US$ and PPP$ at constant 2016 prices. The sample of studies documented a median estimate of US$2.94 billion in net benefits to farmers and consumers with a 95% confidence interval of US$2.4 billion to US$3.4 billion at official exchange rates. When the benefits are converted by each nation’s PPP, the median estimate is PPP$8.43 billion, with a 95% confidence interval ranging from PPP$6.7 billion to PPP$10.0 billion. The distribution of net benefits is bimodal reflecting the combination of pessimistic and optimistic assumptions in each of the studies. Under the worst-case scenario, these studies generated a minimum of US$2.3 billion at official exchange rates (or PPP$6.4 billion) in net benefits for a multiplier of USAID research expenditures of 1.83 (or 5.17 at PPP), while under the most optimistic scenario, that ratio of net benefits to costs is approximately 2.87 (8.52 at PPP). At the median of the net benefit estimate, the benefit-cost ratio 2.36 (6.79 at PPP). Fifty-six percent of the benefits were found in IPM innovations, 31% in varietal improvement, 12% in crop storage, and 1% in livestock.
Estimated probability distribution of total net benefits from technologies developed through CRSP and FtFIL research in US$ and PPP$ (constant 2016 prices).
Figure 3 allows the comparison of the investment cost of the 40-year USAID investment in university-led agricultural research, across all programmatic areas, to the net benefits in developing countries from a non-representative sample of innovations from those investments. It does not include any spill-in benefits to the U.S. agricultural and food economy, which, as described in Glauber, Kraybill, and Mercier (Reference Glauber, Kraybill and Mercier.2019), have in some cases been significant. For example, in southern Africa in the 1980s, plant breeding and genetics research by the INTSORMIL CRSP identified host plant resistance in sorghum against the sugarcane aphid, an endemic pest in Africa. When this pest began attacking U.S. sorghum production in 2013, it was partially controlled by incorporating this genetic material into U.S.-grown varieties (Peterson et al., Reference Peterson, Armstrong, Pendleton, Stetler and Brewer.2018). Moreover, since each study presents the NPV to the technological innovation (i.e., local benefits of the innovation minus project costs incurred by U.S. government and partner-country R&D investment), it cannot be considered as an accurate benefit-cost ratio but one that is biased downward since the project costs are counted twice.
Likely poverty impacts from the 46 impact studies are shown in Table 2. In constant 2016 PPP$, net benefits from the CRSP and FtFIL projects in Africa, Asia, Latin America, and Eastern Europe through 2020 total PPP$8,064 million.Footnote 4 About 45% of these benefits accrued to countries in Asia, especially India. African countries received about 28% of benefits, Latin American countries (primarily in Central America) received about 23% and Eastern European countries about 4% of estimated benefits. Because poverty rates in these countries were high when these technologies generated economic impacts, our model assigns a high proportion of these impacts to the poor. Assuming that these benefits are widely shared amongst producers and consumers in the countries of impact, we find that households on the lower end of the income strata appeared to be the primary beneficiaries of these income gains. About 78% of the income benefits shown in Table 2 likely accrued to individuals living on less than $PPP 5.50/day, 57% to individuals spending less than $3.20/day, and 29% to those in extreme poverty with less than $1.90/day for subsistence. In Africa, our model assigns 46% of the benefits to those in extreme poverty earning less than $1.90/day and 28% of the benefits in Asia to this group.
Cumulative welfare impacts of technologies developed through CRSP and FtFIL research, 1978–2020
Other Impacts of University-Led Agricultural Research
The economic impacts from technological change described in the previous section are largely income gains to producing and consuming households, which are calculated using market prices to value the changes in quantities of goods produced and consumed. Beyond these direct income or economic impacts, new technologies can contribute to welfare changes in important ways that may be missed in market transactions. Changes to human health, environmental quality, and the risk of and ability to recover from economic shocks (“resilience”) are additional ways as new technology may positively (or negatively) influence household and community well-being. There are also cases where university-led research may have made relatively small but nonetheless strategic contributions to advances in science and technology that, while not easily attributable to a particular institution, have resulted in significant social and economic impacts in developing countries. In this section, we briefly canvass some of the “non-market” or unattributed impacts of USAID-supported university research. Together, these additional dimensions of impact illustrate that purely economic measures of impact understate the overall value of this research investment.
Health and Environmental Benefits from Lower Pesticides Exposure
IPM has been a major theme of CRSP and FtFIL research. IPM aims both to increase farm productivity and create alternatives to pesticide use, especially where exposure to pesticides may have negative health and environmental effects. For example, in the 1990s research funded by the Rockefeller Foundation found that pesticide use in the Andes posed significant risks to human health and the environment but were also highly profitable because they enabled farmers to avoid crop losses (Crissman, Antle, and Capalbo, Reference Crissman, Antle and Capalbo1998). Subsequently, the IPM CRSP undertook research to develop IPM and piloted farmer field schools and other extension methods to enable farmers to reduce pesticide use on potatoes, focusing on the Carchi Province of Ecuador. Yaguana (Reference Yaguana2013) found that by 2011, most potato growers in Carchi had adopted at least some IPM methods, and that on average, adopters of IPM were able to lower their pesticide costs by around $500 per hectare, or by more than 60%, while maintaining potato yield. In addition to direct economic benefits from reduced pesticide costs (estimated by Yaguana, Reference Yaguana2013 to be over $800,000 per year in Carchi), adoption presumably generated significant (though unmeasured) health and environmental benefits to local communities by reducing their exposure to pesticides.
Another CRSP IPM project on vegetable production in Central Luzon, Philippines, was found to have reduced pesticide use on onions by 25%–65% (Cuyno, Norton, and Rola, Reference Cuyno, Norton and Rola.2001). To derive an estimate of the perceived non-market value of lower pesticide use, the authors asked local residents about their “willingness to pay” for reduced risk to human and nonhuman species from lower pesticide exposure. The aggregate value of these environmental benefits in the five villages where the IPM program was centered was $150,000 for the 4,600 residents or about half the value of the direct economic benefits.
More recently, a USAID-supported project has developed insect-resistant varieties of eggplant using GM technology (Bt eggplant) in Bangladesh. A randomized control trial showed that adopters used 39% less pesticides (and 51% fewer sprays) and produced 42% higher yields on average than non-adopters (Ahmed et al., Reference Ahmed, Hoddinott, Islam, Khan, Abedin and Hossain.2019). The study also found highly suggestive evidence that adoption improved the health of growers and their families: Individuals in adopting households were 10% points less likely to self-report health symptoms consistent with pesticide exposure compared with non-adopting households (Ahmed et al., Reference Ahmed, Hoddinott, Islam, Khan, Abedin and Hossain.2019). The new eggplant varieties are proving popular due to their profitability and are being rapidly adopted in Bangladesh.
Nutritional Benefits from Dietary Quality and Diversification
Lack of balanced diet underlies the “triple burden of malnutrition”: (1) undernutrition (caloric inadequacy), (2) micronutrient deficiencies, and (3) overnutrition (leading to obesity and associated non-communicable diseases). One means of improving dietary quality is through diversification, defined as the number of major food crops regularly consumed in one’s diet (Ruel, Reference Ruel2003). Dietary diversity is enhanced when food becomes more affordable, either because household incomes rise or because the price of food declines. This is true even for food staples that often dominate the budgets of poor households because lower staple prices free up household expenditures to purchase other foods.
Most of the case studies of economic impact identified in this review likely contributed to dietary diversification through these income and price effects. Impacts that increased availability and affordability of foods that are rich in scarce micronutrients, such as Bt eggplant in Bangladesh and improved beans in Central America, may be particularly important to dietary quality. In West Africa, new early-maturing varieties of cowpea improved diets by making food more available to households during the hunger season prior to the traditional harvest months (Schwartz, Sterns, and Oehmke, Reference Schwartz, Sterns and Oehmke.1993). None of the case studies in this review attempted to quantify specific nutritional impacts, although other meta-studies and econometric analysis have established clear and significant impacts from higher agricultural productivity on improved household nutrition in developing countries (see Pray, Masters, and Ayoub, Reference Pray, Masters and Ayoub.2017, for a concise review of recent evidence).
Impacts of Strategic Research that Addressed Significant Technical Bottlenecks
A 2012 Board for International Food and Agricultural Development review of the “CRSP model” identified two pathways through which U.S. university-led research contributes to agricultural development: (1) demand-driven research designed to achieve tangible development outputs to address local problems, and (2) strategic research which provides cutting-edge solutions to narrowly defined problems of global importance (USAID, 2012, pp. 32–34). All the case studies of impact identified in this review are examples of the first type—demand-driven research that produces tangible solutions to local problems. The impacts of strategic research, on the other hand, can be harder to identify and attribute to a single or few technology providers. Results of strategic research, for example, may provide component knowledge that enhances performance of applied R&D. Importantly, strategic research may help overcome technical bottlenecks and open new opportunities and approaches to seemingly intransigent problems.
One example of strategic research has been the extension of genomics-enabled plant breeding platforms to national agricultural research systems in low-income countries. Few of these countries have all the required expertise and infrastructure in phenomics, genetics, and bioinformatics to implement state-of-the-art breeding programs. Many suffer from small-country inefficiencies of size in research capacity that make these techniques cost prohibitive. FtFILs have allowed target nations to pursue activities where they hold a comparative advantage, for example in screening for resistance against persistent insects or disease and plant phenotyping, while U.S.-based scientists, often with degree-seeking students from the target nations, conduct genomic characterization and process bioinformatics to determine the genetic location of host plant resistance against these pests. Information and genetic markers are then fed back into host-country breeding programs to speed crop development, reduce yield damage, and increase crop production resiliency. Two recent examples include the discovery of the ARG1 gene that confers tolerance in sorghum against anthracnose, which is prevalent in humid lowlands of western Ethiopia, and the creation of genetic markers for the RMES1 SCA resistance locus that confers host plant resistance against the sugarcane aphid (SCA) in Haitian, and global, sorghum production (Lee et al., Reference Lee, Fu, Liao, Mewa, Adejanju, Ejeta, Lisch and Mengiste.2022; Muleta et al., Reference Muleta, Felderhoff, Winans, Walstead, Rigaud Charles, Armstrong and Mamidi2022).
A second example of how US government-funded research provided narrowly defined but critical inputs to a problem of international significance is the development of thermo-stable vaccines against major livestock diseases (though this case also has dimensions of the first type of demand-driven research focused on tangible outputs). While a highly effective Rinderpest (cattle plague) vaccine had been developed in 1960 by the Scottish veterinarian Walter Plowright, its principal limitation was that it required refrigeration, a significant impediment to field vaccination in remote areas (Roeder, Mariner, and Kock, Reference Roeder, Mariner and Kock.2013). A 2-year research effort by Tufts University School of Veterinary Medicine and the United States Department of Agriculture successfully developed ThermoVax, a thermo-stable version of the Rinderpest vaccine, and by 1992 ThermoVax was commercially available in Africa. This innovation dramatically extended the reach of field vaccination programs. In 2011, the UN Food and Agriculture Organization and the World Health Organization declared that Rinderpest had been eradicated world-wide, only the second disease (after smallpox) to be so designated. That fact that U.S. universities appear to have unique capabilities for this type of technology development is revealed by the fact that USAID reenlisted Tufts and Florida universities to develop a thermo-stable vaccine against the peste des petits ruminants, a highly lethal virus that plagues goats and sheep in Africa.
Conclusions
Investing in R&D to raise agricultural productivity in developing nations is an important element of U.S. foreign technical assistance. Increasing agricultural productivity is valued not only for its contribution to ending hunger but also because it drives inclusive economic growth and transformation, promotes better health and nutrition, and conserves natural resources. USAID directs funding for agricultural R&D through national and international research institutions, including a major portion to U.S. universities. In this paper, we reviewed evidence on the economic impact of agricultural research supported by USAID and conducted by U.S. universities which is aimed at strengthening global food security. U.S. agricultural land-grant universities have been an integral part of the U.S. government’s commitment to agricultural development for much of the past half-century and has been formally enshrined in USAID programs since the late 1970s. The two programs of most significance in this endeavor have been the Collaborative Research Support Program, which ran from 1978 to 2012 and its successor, the Feed the Future Innovation Labs, which have operated since 2012.
We identified nearly four dozen economic studies that quantified impacts of research projects undertaken by CRSP and FtFIL since 1978. Most of these studies used standard tools of benefit-cost analysis to appraise a project’s NPV (i.e., the discounted present value of the annual stream of user benefits from higher agricultural productivity minus the costs of research and extension, including costs incurred by partner organizations). Since most studies lacked precise information on long-run benefits from technology adoption, they provided a range of NPV that considered uncertainty about the value of future benefits. Treating these estimates as random variables, we used a repeated sampling procedure to construct a probability distribution of the aggregate net benefits in developing countries from this sample of projects. In constant 2016 prices and at official exchange rates, their aggregate NPV had a median value of US$2.94 billion, with a 95% confidence interval ranging from US$2.4 billion to US$3.4 billion. This compares favorably against USAID’s cumulative investment in the CRSP and FtFIL of US$1.24 billion over 1978–2018 despite the fact that the benefits are measured from only a small fraction of the total number of projects conducted under the CRSP and FtFIL mechanisms. Even if all other projects in the CRSP and FtFIL portfolios had zero gross benefits, granted as a very a heroic assumption, this program would still be considered highly successful. Our estimate could be considered as a minimum benefit calculation when evaluated at official exchange rates based on available information. Alternatively, we may have overestimated the attribution of these benefits to the USAID mechanism by not taking into consideration alternative projects or programs that complement the research intervention. For example, a development project may have been responsible for extending an innovation and thus deserves a portion of the impact attributed to their role in dissemination.
Because USAID-funded agricultural research is heavily oriented toward raising productivity of smallholder farmers, and especially for food crops, it should come as no surprise that the primary beneficiaries are likely to be low-income households in developing countries. When adjusted for PPP in the countries where technology adoption occurred, the aggregate economic impact from the set of project rises to over PPP$ 8.43 billion (median value, again at 2016 prices). Under the most optimistic scenario, these studies document benefits that are 8.5 times greater than the total cost of the entire CRSP-FtFIL program. Under the strong assumption that these benefits were evenly shared amongst the population in the countries where economic impacts occurred, we estimate that about four-fifths of these economic benefits accrued to individuals with incomes under $5.50/day, and about 29% to those in extreme poverty subsisting on less than $1.90/day. Or, alternatively, we could say that the majority of CRSP-IL impacts accrued in countries where poverty rates were exceptionally high and to commodities of particular importance to lower income strata of the populations within these countries. Moreover, as this estimate only considers a subset of CRSP and FtFIL projects undertaken over these years, and only considers one dimension of outcomes (income benefits), it represents an underestimation or minimum bound of the full impacts achieved by the USAID-University partnership to date.
Nearly all the impact studies identified in our review focused on crop improvement research, namely, integrated management of crop pests and diseases, breeding of new crop varieties, and improved crop storage. This is not a balanced representation of the CRSP and FtFIL research portfolio, however, and major parts of the USAID investment—in natural resource management, livestock and fish, human nutrition, and policy—have received scant attention for their economic and social impacts. But the lack of formal studies on impact cannot be interpreted as a lack of impact of research in these areas. Rather, it likely reflects both the initiative of certain CRSP and FtFIL programs in sponsoring impact studies as well as the ease of undertaking such assessments. More assessments on a broader range of programs would provide an objective basis for evaluating the relative performance of FtFIL investments. Given the history and uneven attention to impact assessment studies, USAID could consider incentivizing this process, such as by reserving some project funds for impact assessment.
Often, CRSP and FtFIL research is directed toward upstream, strategic research that contributes basic or targeted knowledge to larger efforts (involving many partners, in both research and implementation) to address pressing challenges. In addition, many CRSP and FtFIL projects have been oriented toward achieving impacts that are hard to quantify in a money metric. Several of the case studies included in this synthesis described (but rarely were able to monetize) significant benefits above the income gains they documented, such as improvements to farm family health through more judicious use of chemical pesticides, greater dietary diversity of nutritious foods, and greater stability of agricultural yields. Comparing these secondary benefits to those produced by FtFIL labs targeting nutrition, or crop and resource management for example, may show that the secondary benefits outweigh those produced by direct investment.
Getting a fuller account of impacts of USAID-funded research remains important for improving the design of research projects and the allocation of budgetary resources across the program portfolio. Program areas within USAID’s R&D portfolio where evidence of impact is especially needed include crop and natural resource management, policy, livestock, and nutrition. A more systematic commitment to ex post and ex ante analysis to assess benefits relative to costs of agricultural R&D can help to focus investments on the most impactful areas and help to justify further Congressional funding for agricultural R&D in foreign aid. Given the multiple policy objectives this aid aims to achieve, a broader set of impact measures should be considered. It is becoming increasingly possible, through integrated models, to consider not only economic impacts but also on impacts on nutrition and health, climate and environmental change, and resilience to shocks. And, important for the long-run graduation of foreign countries from the need for technical and food assistance, the impact of U.S. investments on human and institutional capacities in agricultural science and technology could also receive attention.
Acknowledgements
The authors acknowledge the important research assistance of Maria Alejandra Ramirez Lopez and Wyatt Pracht. This study is made possible by the support of the American People provided to the Feed the Future Innovation Lab for Collaborative Research on Sorghum and Millet through the United States Agency for International Development (USAID) and by the United States Department of Agriculture (USDA). The contents are the sole responsibility of the authors and do not necessarily reflect the views of USAID, USDA, or the United States Government. Program activities are funded by the United States Agency for International Development (USAID) under Cooperative Agreement No. AID-OAA-A-13-00047.
Author contributions
Conceptualization, TJD, KF; Methodology, TJD, KF; Formal Analysis, TJD, KF; Data Curation, TJD, KF; Writing—Original Draft, TJD, KF, Writing—Review and Editing, TJD, KF; Supervision, TJD; Funding Acquisition, TJD.
Competing interests
TJD and KF declare none.
Data availability statement
Data are available from cited references or the authors.
List of Economic Impact Studies Identified through Literature Search
Open access
