Skip to main content

Not All Roads Lead to Rome: A Meta-analysis of Invasive Plant Impact Methodology

  • Daniel R. Tekiela (a1) and Jacob N. Barney (a2)

The negative effects of invasive plant species on native ecosystems, which can be large and long-lasting, are the primary justifications for their research and management. Tremendous effort is focused on quantifying the ecological impacts of invasive plants, though two different methods are primarily used: observational (compare invaded and uninvaded) and removals (compare invaded and invader removal). However, it is unknown whether these methods, which differ in their assumptions and execution, yield similar results, which could affect our ability to draw broad conclusions within and across studies. Therefore, we performed a meta-analysis on 174 studies that described 547 impacts of 72 invasive plants to test the effect of study method, invader cover, and removal period on the direction and magnitude of impact. Overall, by only considering impact magnitude and not direction, both observational and removal methods yielded similar results—invasive plants are changing most aspects of the ecosystem—and the variation among species and study systems was dramatically reduced compared with traditional, directionally focused studies. This is contrary to a similar analysis that did not control for directionality of impacts, which found overall differences in impact depended on methodology. However, even when the effects of study ecosystem, invader life-form, and impact type were accounted for, significant differences occurred between removal and observational studies. Particularly vulnerable systems appear to be those that would be more greatly disturbed by the removal of the target species, such as tree species or invasive plants in riparian areas. Additionally, impact magnitude increased with invader cover and removal time. We confirm that invasive plants impact the systems they invade in a nonuniform manner; however, we suggest some study conditions may be more sensitive to study methodology. Careful consideration should be given as to which methodology is used in the context of the study system.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the or variations. ‘’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Not All Roads Lead to Rome: A Meta-analysis of Invasive Plant Impact Methodology
      Available formats
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Not All Roads Lead to Rome: A Meta-analysis of Invasive Plant Impact Methodology
      Available formats
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Not All Roads Lead to Rome: A Meta-analysis of Invasive Plant Impact Methodology
      Available formats
Corresponding author
*Corresponding author’s E-mail:
Hide All

Associate Editor for this paper: Guillaume Fried, ANSES

Hide All
Allison, SD, Nielsen, C, Hughes, RF (2006) Elevated enzyme activities in soils under the invasive nitrogen-fixing tree Falcataria moluccana . Soil Biol Biochem 38:15371544
Barney, JN, Tekiela, DR, Barrios-Garcia, MN, Dimarco, RD, Hufbauer, RA, Leipzig-Scott, P, Nuñez, MA, Pauchard, A, Pyšek, P, Vítková, M, Maxwell, BD (2015) Global Invader Impact Network (GIIN): toward standardized evaluation of the ecological impacts of invasive plants. Ecol Evol 5:28782889
Barney, JN, Tekiela, DR, Dollete, ES, Tomasek, BJ (2013) What is the “real” impact of invasive plant species? Front Ecol Environ 11:322329
Belnap, J, Phillips, S, Sherrod, S, Moldenke, A (2005) Soil biota can change after exotic plant invasion: does this affect ecosystem processes? Ecology 86:30073017
Blackburn, TM, Essl, F, Evans, T, Hulme, PE, Jeschke, JM, Kühn, I, Kumschick, S, Marková, Z, Mrugała, A, Nentwig, W, Pergl, J, Pyšek, P, Rabitsch, W, Ricciardi, A, Richardson, DM, Sendek, A, Vilà, M, Wilson, JRU, Winter, M, Genovesi, P, Bacher, S (2014) A unified classification of alien species based on the magnitude of their environmental impacts. PLoS Biol 12:e1001850
Charles, H, Dukes, J (2007) Impacts of invasive species on ecosystem services. Biol Invasions 193:217238
Corbin, JD, D’Antonio, CM (2012) Gone but not forgotten? Invasive plants’ legacies on community and ecosystem properties. Invasive Plant Sci Manag 5:117124
Cuddington, K (2011) Legacy effects: the persistent impact of ecological interactions. Biol Theory 6:203210
Dostál, P, Müllerová, J, Pyšek, P, Pergl, J, Klinerová, T (2013) The impact of an invasive plant changes over time. Ecol Lett 10:18
Fried, G, Panetta, FD (2016) Comparing an exotic shrub’s impact with that of a native life-form analogue: Baccharis halimifolia vs Tamarix gallica in Mediterranean salt marsh communities. J Veg Sci 27:812823
Gaertner, M, Den Breeyen, A, Richardson, DM (2009) Impacts of alien plant invasions on species richness in Mediterranean-type ecosystems: a meta-analysis. Prog Phys Geogr 33:319338
Gooden, B, French, K, Turner, PJ, Downey, PO (2009) Impact threshold for an alien plant invader, Lantana camara L., on native plant communities. Biol Conserv 142:26312641
Greene, BT, Blossey, B (2011) Lost in the weeds: Ligustrum sinense reduces native plant growth and survival. Biol Invasions 14:139150
Hejda, M, Pyšek, P, Jarošík, V (2009) Impact of invasive plants on the species richness, diversity and composition of invaded communities. J Ecol 97:393403
Hobbs, RJ, Higgs, E, Harris, JA (2009) Novel ecosystems: implications for conservation and restoration. Trends Ecol Evol 24:599605
Hulme, PE, Bremner, ET (2005) Assessing the impact of Impatiens glandulifera on riparian habitats: partitioning diversity components following species removal. J Appl Ecol 43:4350
Hulme, PE, Pyšek, P, Jarošík, V, Pergl, J, Schaffner, U, Vilà, M (2013) Bias and error in understanding plant invasion impacts. Trends Ecol Evol 28:212218
Hulme, PE, Pyšek, P, Pergl, J, Schaffner, U, Vilà, M (2014) Pragmatism required to assess impacts of invasive plants. Front Ecol Environ 12:153154
Iacarella, JC, Mankiewicz, PS, Ricciardi, A (2015) Negative competitive effects of invasive plants change with time since invasion. Ecosphere 6:114
Jäger, H, Kowarik, I, Tye, A (2009) Destruction without extinction: long-term impacts of an invasive tree species on Galápagos highland vegetation. J Ecol 97:12521263
Jeschke, JM, Bacher, S, Blackburn, TM, Dick, JT, Essl, F, Evans, T, Gaertner, M, Hulme, PE, Kühn, I, Mrugała, A, Pergl, J, Pyšek, P, Rabitsch, W, Ricciardi, A, Richardson, DM, Sendek, A, Vilà, M, Winter, M, Kumschick, S (2014) Defining the impact of non-native species. Conserv Biol 28:11881194
Kontopantelis, E, Reeves, D (2012) Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: a simulation study. Stat Methods Med Res 21:409426
Kumschick, S, Bacher, S, Evans, T, Marková, Z, Pergl, J, Pyšek, P, Vaes-Petignat, S, van der Veer, G, Vilà, M, Nentwig, W (2015a) Comparing impacts of alien plants and animals in Europe using a standard scoring system. J Appl Ecol 52:552561
Kumschick, S, Gaertner, M, Vila, M, Essl, F, Jeschke, JM, Pysek, P, Ricciardi, A, Bacher, S, Blackburn, TM, Dick, JTA, Evans, T, Hulme, PE, Kuhn, I, Mrugaƚa, A, Pergl, J, Rabitsch, W, Richardson, DM, Sendek, A, Winter, M (2015b) Ecological impacts of alien species: quantification, scope, caveats, and recommendations. BioScience 65:5563
Liao, C, Peng, R, Luo, Y, Zhou, X, Wu, X, Fang, C, Chen, J, Li, B (2008) Altered ecosystem carbon and nitrogen cycles by plant invasion: a meta-analysis. New Phytol 177:706714
Litt, AR, Cord, EE, Fulbright, TE, Schuster, GL (2014) Effects of invasive plants on arthropods. Conserv Biol 28:15321549
Lowry, E, Rollinson, EJ, Laybourn, AJ, Scott, TE, Aiello-Lammens, ME, Gray, SM, Mickley, J, Gurevitch, J (2013) Biological invasions: a field synopsis, systematic review, and database of the literature. Ecol Evol 3:182196
Marchante, E, Kjøller, A, Struwe, S, Freitas, H (2008) Soil recovery after removal of the N2-fixing invasive Acacia longifolia: consequences for ecosystem restoration. Biol Invasions 11:813823
Minteer, BA, Collins, JP (2010) Move it or lose it? The ecological ethics of relocating species under climate change. Ecol Appl 20:18011804
Olsson, AD, Betancourt, J, McClaran, MP, Marsh, SE (2012) Sonoran Desert ecosystem transformation by a C4 grass without the grass/fire cycle. Divers Distrib 18:1021
Panetta, FD, Gooden, B (2017) Managing for biodiversity: impact and action thresholds for invasive plants in natural ecosystems. NeoBiota 34:5366
Pyšek, P, Jarošík, V, Hulme, PE, Pergl, J, Hejda, M, Schaffner, U, Vilà, M (2012) A global assessment of invasive plant impacts on resident species, communities and ecosystems: the interaction of impact measures, invading species’ traits and environment. Glob Chang Biol 18:17251737
Rosenberg, MS, Adams, DC, Gurevitch, J (2000) MetaWin: Statistical Software for Meta-analysis. Sunderland, MA: Sinauer
Ruwanza, S, Gaertner, M, Esler, KJ, Richardson, DM (2013) Both complete clearing and thinning of invasive trees lead to short-term recovery of native riparian vegetation in the Western Cape, South Africa. Appl Veg Sci 16:193204
Stricker, KB, Hagan, D, Flory, SL (2015) Improving methods to evaluate the impacts of plant invasions: lessons from 40 years of research. AoB Plants 1:plv028
Tekiela, DR, Barney, JN (2015) System-level changes following invasion caused by disruption of functional relationships among plant and soil properties. Ecosphere 6:294
Thiele, J, Isermann, M, Kollmann, J, Otte, A (2011) Impact scores of invasive plants are biased by disregard of environmental co-variation and non-linearity. NeoBiota 10:65
Toth, LA (2016) Cover thresholds for impacts of an exotic grass on the structure and assembly of a wet prairie community. Wetl Ecol Manag 24:6172
Truscott, AM, Palmer, SC, Soulsby, C, Westaway, S, Hulme, PE (2008) Consequences of invasion by the alien plant Mimulus guttatus on the species composition and soil properties of riparian plant communities in Scotland. Perspect Plant Ecol Evol Syst 10:231240
Vilà, M, Espinar, JL, Hejda, M, Hulme, PE, Jarošík, V, Maron, JL, Pergl, J, Schaffner, U, Sun, Y, Pyšek, P (2011) Ecological impacts of invasive alien plants: a meta-analysis of their effects on species, communities and ecosystems. Ecol Lett 14:702708
Vilà, M, Weiner, J (2004) Are invasive plant species better competitors than native plant species? Evidence from pair-wise experiments. Oikos 105:229238
Wallace, BC, Lajeunesse, MJ, Dietz, G, Dahabreh, IJ, Trikalinos, TA, Schmid, CH, Gurevitch, J (2016) OpenMEE: Intuitive, open-source software for meta analysis in ecology and evolutionary biology. Methods Ecol Evol 8:941947
Wang, C, Xiao, H, Liu, J, Wang, L, Du, D (2015) Insights into ecological effects of invasive plants on soil nitrogen cycles. Am J Plant Sci 6:3446
White, PS, Walker, JL (1997) Approximating nature’s variation: selecting and using reference information in restoration ecology. Restor Ecol 5:338349
Young, L, Schlesinger, C (2014) Habitat use and behaviour of birds in areas invaded by buffel grass (Cenchrus ciliaris L.) and in restored habitat. Wildlife Res 41:379394
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Invasive Plant Science and Management
  • ISSN: 1939-7291
  • EISSN: 1939-747X
  • URL: /core/journals/invasive-plant-science-and-management
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed