Skip to main content Accessibility help
×
Home

Power and False Negatives in Qualitative Comparative Analysis: Foundations, Simulation and Estimation for Empirical Studies

  • Ingo Rohlfing (a1)

Abstract

In Qualitative Comparative Analysis (QCA), empirical researchers use the consistency value as one, if not sole, criterion to decide whether an association between a term and an outcome is consistent with a set-relational claim. Braumoeller (2015) points out that the consistency value is unsuitable for this purpose. We need to know the probability of obtaining it under the null hypothesis of no systematic relation. He introduces permutation testing for estimating the $p$ value of a consistency score as a safeguard against false positives. In this paper, I introduce permutation-based power estimation as a safeguard against false-negative conclusions. Low power might lead to the false exclusion of truth table rows from the minimization procedure and the generation and interpretation of invalid solutions. For a variety of constellations between an alternative and null hypothesis and numbers of cases, simulations demonstrate that power estimates can range from 1 to 0. Ex post power analysis for 63 truth table analyses shows that even under the most favorable constellation of parameters, about half of them can be considered low-powered. This points to the value of estimating power and calculating the required number of cases before the truth table analysis.

Copyright

Corresponding author

Footnotes

Hide All

Contributing Editor: Jonathan N. Katz.

Footnotes

References

Hide All
Abadie, Alberto, Athey, Susan, Imbens, Guido W., and Wooldridge, Jeffrey M.. 2014. Finite population causal standard errors. NBER Working Paper No. 20325, accessed April 26, 2017, https://www.nber.org/papers/w20325.
Athey, Susan, and Imbens, Guido W.. 2016. The econometrics of randomized experiments. arXiv working paper, accessed April 26, 2017, https://arxiv.org/abs/1607.00698v1.
Braumoeller, Bear F. 2015. Guarding against false positives in Qualitative Comparative Analysis. Political Analysis 23(4):471487.
Braumoeller, Bear F., and Goertz, Gary. 2000. The methodology of necessary conditions. American Journal of Political Science 44(4):844858.
Carsey, Thomas M., and Harden, Jeffrey J.. 2013. Monte Carlo simulation and resampling methods for social science . Thousand Oaks: SAGE.
Ellis, Paul D. 2010. The essential guide to effect sizes: Statistical power, meta-analysis, and the Interpretation of research results . Cambridge: Cambridge University Press.
Freitag, Markus, and Schlicht, Raphaela. 2009. Educational federalism in Germany: Foundations of social inequality in education. Governance 22(1):4772.
Good, Phillip I. 1994. Permutation tests . New York: Springer-Verlag.
Hug, Simon. 2013. Qualitative Comparative Analysis: How inductive use and measurement error lead to problematic inference. Political Analysis 21(2):252265.
Marx, Axel, Rihoux, Benoît, and Ragin, Charles C.. 2014. The origins, development, and application of Qualitative Comparative Analysis: The first 25 years. European Political Science Review 6(1):115142.
McCluskey, Edward J. 1956. Minimization of Boolean functions. The Bell System Technical Journal 35(6):14171444.
Mello, Patrick A. 2012. Parliamentary peace or partisan politics? Democracies’ participation in the Iraq war. Journal of International Relations and Development 15(3):420453.
Ragin, Charles C. 1987. The comparative method: Moving beyond quantitative and qualitative strategies . Berkeley: University of Berkeley Press.
Ragin, Charles C. 2000. Fuzzy-set social science . Chicago: University of Chicago Press.
Ragin, Charles C. 2006. Set relations in social research: Evaluating their consistency and coverage. Political Analysis 14(3):291310.
Ragin, Charles C. 2008. Redesigning social inquiry . Chicago: Chicago University Press.
Ragin, Charles C. 2014. Comment: Lucas and Szatrowski in critical perspective. Sociological Methodology 44(1):8094.
Rohlfing, Ingo. 2017. Replication data for: Power and false negatives in Qualitative Comparative Analysis (QCA). doi:10.7910/DVN/UNHYMP, Harvard Dataverse, V1, UNF:6:4QDrl2fEelRJmjDVYJ5hFw==.
Schneider, Carsten Q., and Wagemann, Claudius. 2012. Set-theoretic methods for the social sciences. A guide to qualitative comparative analysis . Cambridge: Cambridge University Press.
Thiem, Alrik. 2014. Navigating the complexities of Qualitative Comparative Analysis: Case numbers, necessity relations, and model ambiguities. Evaluation Review 38(6):487513.
Thiem, Alrik, Spöhel, Reto, and Dusa, Adrian. 2015. Enhancing sensitivity diagnostics for Qualitative Comparative Analysis: A combinatorial approach. Political Analysis 24(1):104120.
MathJax
MathJax is a JavaScript display engine for mathematics. For more information see http://www.mathjax.org.

Keywords

Related content

Powered by UNSILO
Type Description Title
UNKNOWN
Supplementary materials

Rohlfing supplementary material 1
Rohlfing supplementary material

 Unknown (348 KB)
348 KB

Power and False Negatives in Qualitative Comparative Analysis: Foundations, Simulation and Estimation for Empirical Studies

  • Ingo Rohlfing (a1)

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.