Hostname: page-component-77f85d65b8-grvzd Total loading time: 0 Render date: 2026-04-22T05:17:22.492Z Has data issue: false hasContentIssue false
  • English
  • Français

Citizen science can help to alleviate the generalizability crisis

Published online by Cambridge University Press:  10 February 2022

Courtney B. Hilton Open the ORCID record for Courtney B. Hilton [Opens in a new window]  and
Samuel A. Mehr Open the ORCID record for Samuel A. Mehr [Opens in a new window]
Courtney B. Hilton
Affiliation:
Department of Psychology, Harvard University, Cambridge, MA 02138, USA courtneyhilton@g.harvard.edu
Samuel A. Mehr
Affiliation:
Department of Psychology, Harvard University, Cambridge, MA 02138, USA courtneyhilton@g.harvard.edu Data Science Initiative, Harvard University, Cambridge, MA 02138, USA sam@wjh.harvard.edu; https://themusiclab.org School of Psychology, Victoria University of Wellington, Kelburn Parade, Wellington 6012, New Zealand
Get access Rights & Permissions [Opens in a new window]

Abstract

Improving generalization in psychology will require more expansive data collection to fuel more expansive statistical models, beyond the scale of traditional lab research. We argue that citizen science is uniquely positioned to scale up data collection and, that in spite of certain limitations, can help to alleviate the generalizability crisis.

Information

Type
Open Peer Commentary
Information
Behavioral and Brain Sciences , Volume 45 , 2022 , e21
Check for updates
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Sharff, A., … Rahwan, I. (2018). The moral machine experiment. Nature, 563(7729), 59–64.CrossRefGoogle ScholarPubMed
Baribault, B., Donkin, C., Little, D. R., Trueblood, J. S., Oravecz, Z., van Ravenzwaaij, D., … Vandekerckhove, J. (2018). Metastudies for robust tests of theory. Proceedings of the National Academy of Sciences, 115(11), 2607–2612.CrossRefGoogle ScholarPubMed
Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., … Players, F. (2010). Predicting protein structures with a multiplayer online game. Nature, 466(7307), 756–760.CrossRefGoogle ScholarPubMed
de Leeuw, J. R. (2015). jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods, 47(1), 1–12.CrossRefGoogle Scholar
Hartshorne, J. K., de Leeuw, J., Goodman, N., Jennings, M., & O'Donnell, T. J. (2019). A thousand studies for the price of one: Accelerating psychological science with Pushkin. Behavior Research Methods, 51(4), 1–22.CrossRefGoogle Scholar
Hilton, C., Crowley de-Thierry, L., Yan, R., Martin, A., & Mehr, S. (2021). Children infer the behavioral contexts of unfamiliar songs. PsyArXiv. doi: 10.31234/osf.io/rz6qn.CrossRefGoogle Scholar
Hilton, C. B., Moser, C. J., Bertolo, M., Lee-Rubin, H., Amir, D., Bainbridge, C. M., … Mehr, S. A. (2021). Acoustic regularities in infant-directed vocalizations across cultures. bioRxiv. doi: 10.1101/2020.04.09.032995Google Scholar
Lourenco, S. F., & Tasimi, A. (2020). No participant left behind: Conducting science during COVID-19. Trends in Cognitive Sciences, 24(8), 583–584.CrossRefGoogle ScholarPubMed
ManyBabies Consortium. (2020). Quantifying sources of variability in infancy research using the infant-directed-speech preference. Advances in Methods and Practices in Psychological Science, 3, 24–52.CrossRefGoogle Scholar
Mehr, S. A., Singh, M., Knox, D., Ketter, D., Pickens-Jones, D., Atwood, S., … Glowacki, L. (2019). Universality and diversity in human song. Science, 366(6468), eaax0868.CrossRefGoogle ScholarPubMed
Mehr, S. A., Singh, M., York, H., Glowacki, L., & Krasnow, M. M. (2018). Form and function in human song. Current Biology, 28(3), 356–368.e5.CrossRefGoogle ScholarPubMed
Peirce, J., Gray, J. R., Simpson, S., MacAskill, M., Höchenberger, R., Sogo, H., … Lindeløv, J. K. (2019). PsychoPy2: Experiments in behavior made easy. Behavior Research Methods, 51(1), 195–203.CrossRefGoogle ScholarPubMed
Scott, K., & Schulz, L. (2017). Lookit (Part 1): A new online platform for developmental research. Open Mind, 1(1), 4–14.CrossRefGoogle Scholar
Sheskin, M., Scott, K., Mills, C. M., Bergelson, E., Bonawitz, E., Spelke, E. S., … Schulz, L. (2020). Online developmental science to foster innovation, access, and impact. Trends in Cognitive Sciences, 24(9), 675–678.CrossRefGoogle ScholarPubMed
Smaldino, P. E., & McElreath, R. (2016). The natural selection of bad science. Royal Society Open Science, 3(9), 160384.CrossRefGoogle ScholarPubMed
Stuart, E. A. (2010). Matching methods for causal inference: A review and a look forward. Statistical Science, 25(1), 1–21.CrossRefGoogle Scholar
Thompson, W. F., Schellenberg, E. G., & Husain, G. (2001). Arousal, mood, and the Mozart effect. Psychological Science, 12(3), 248–251.CrossRefGoogle ScholarPubMed
Way, S. F., Garcia-Gathright, J., & Cramerr, H. (2020). Local trends in global music streaming. Proceedings of the Fourteenth International AAAI Conference on Web and Social Media, 10.Google Scholar
Yarkoni, T., & Westfall, J. (2017). Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science, 12(6), 1100–1122.CrossRefGoogle ScholarPubMed