Skip to main content
    • Aa
    • Aa

Testing Social Science Network Theories with Online Network Data: An Evaluation of External Validity


To answer questions about the origins and outcomes of collective action, political scientists increasingly turn to datasets with social network information culled from online sources. However, a fundamental question of external validity remains untested: are the relationships measured between a person and her online peers informative of the kind of offline, “real-world” relationships to which network theories typically speak? This article offers the first direct comparison of the nature and consequences of online and offline social ties, using data collected via a novel network elicitation technique in an experimental setting. We document strong, robust similarity between online and offline relationships. This parity is not driven by shared identity of online and offline ties, but a shared nature of relationships in both domains. Our results affirm that online social tie data offer great promise for testing long-standing theories in the social sciences about the role of social networks.

Corresponding author
James Bisbee is Ph.D. Candidate, NYU Department of Politics, 19 W. 4th St., New York, NY 10012. (
Jennifer M. Larson is Assistant Professor, NYU Department of Politics, 19 W. 4th St., New York, NY 10012. Corresponding Author (
Hide All

The authors thank Neal Beck, Eric Dickson, Sean Kates, and Xiang Zhou, as well as the participants of the New York University Empirical Research for Advanced Students seminar and the participants of the 2017 Harvard Experimental Political Science Graduate Student Conference, for their valuable feedback on the project.

Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

Daron Acemoglu , Asuman Ozdaglar , and Ali ParandehGheibi . 2010. “Spread of (Mis) Information in Social Networks.” Games and Economic Behavior 70 (2): 194227.

Yong-Yeol Ahn , Seungyeop Han , Haewoon Kwak , Sue Moon , and Hawoong Jeong . 2007. “Analysis of Topological Characteristics of Huge Online Social Networking Services.” In Proceedings of the 16th International Conference on World Wide Web. New York, NY: ACM Press, 835–44.

Ofra Amir , David G. Rand , and Ya’akov Kobi Gal . 2012. “Economic Games on the Internet: The Effect of $1 Stakes.” PLoS One 7 (2): e31461.

Sinan Aral , and Dylan Walker . 2011. “Creating Social Contagion Through Viral Product Design: A Randomized Trial of Peer Influence in Networks.” Management Science 57 (9): 1623–39.

Christoph Bartneck , Andreas Duenser , Elena Moltchanova , and Karolina Zawieska . 2015. “Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies Conducted Online and with Direct Recruitment.” PloS One 10 (4): e0121595.

Robert M. Bond , Christopher J. Fariss , Jason J. Jones , Adam D. I. Kramer , Cameron Marlow , Jaime E. Settle , and James H. Fowler . 2012. “A 61-Million-Person Experiment in Social Influence and Political Mobilization.” Nature 489 (7415): 295–98.

Yann Bramoullé , and Rachel Kranton . 2007. “Public Goods in Networks.” Journal of Economic Theory 135 (1): 478–94.

Antoni Calvo-Armengol , and Matthew O. Jackson . 2004. “The Effects of Social Networks on Employment and Inequality.” American Economic Review 94 (3): 426–54.

Damon Centola . 2010. “The Spread of Behavior in an Online Social Network Experiment.” Science 329 (5996): 1194–97.

Damon Centola , and Michael Macy . 2007. “Complex Contagions and the Weakness of Long Ties.” American Journal of Sociology 113 (3): 702–34.

Michael Suk-Young Chwe . 2000. “Communication and Coordination in Social Networks.” Review of Economic Studies 67 (1): 1 16.

Scott Clifford , Ryan M. Jewell , and Philip D. Waggoner . 2015. “Are Samples Drawn from Mechanical Turk Valid for Research on Political Methodology?Research and Politics 2 (4): 205316801562272.

Matthew J. C. Crump , John V. McDonnell , and Todd M. Gureckis . 2013. “Evaluating Amazon’s Mechanical Turk as a Tool for Experimental Behavioral Research.” PloS One 8 (3): e57410.

Nicole B. Ellison , Charles Steinfield , and Cliff Lampe . 2007. “The Benefits of Facebook ‘Friends:’ Social Capital and College Students’ Use of Online Social Network Sites.” Journal of Computer-Mediated Communication 12 (4): 1143–68.

Joseph K. Goodman , Cynthia E. Cryder , and Amar Cheema . 2013. “Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples.” Journal of Behavioral Decision Making 26 (3): 213–24.

Przemyslaw A. Grabowicz , José J. Ramasco , Esteban Moro , Josep M. Pujol , and Victor M. Eguiluz . 2012. “Social Features of Online Networks: The Strength of Intermediary Ties in Online Social Media.” PloS One 7 (1): e29358.

John J. Horton , David G. Rand , and Richard J. Zeckhauser . 2011. “The Online Laboratory: Conducting Experiments in a Real Labor Market.” Experimental Economics 14 (3): 399425.

Connor Huff , and Dustin Tingley . 2015. “‘Who Are These People?’ Evaluating the Demographic Characteristics and Political Preferences of MTurk Survey Respondents.” Research and Politics 2 (1): 112.

Adam Joinson . 1999. “Social Desirability, Anonymity, and Internet-Based Questionnaires.” Behavior Research Methods, Instruments, and Computers 31 (3): 433–38.

Jason J. Jones , Jaime E. Settle , Robert M. Bond , Christopher J. Fariss , Cameron Marlow , and James H. Fowler . 2013. “Inferring Tie Strength from Online Directed Behavior.” PloS One 8 (1): e52168.

Jennifer M. Larson 2017. “Networks and Interethnic Cooperation.” Journal of Politics 79 (2): 546–59.

David Lazer , Alex Sandy Pentland , Lada Adamic , Sinan Aral , Albert Laszlo Barabasi , Devon Brewer , Nicholas Christakis , Noshir Contractor , James Fowler , Myron Gutmann , et al. 2009. “Life in the Network: The Coming Age of Computational Social Science.” Science 323 (5915): 721.

Kevin E. Levay , Jeremy Freese , and James N. Druckman . 2016. “The Demographic and Political Composition of Mechanical Turk Samples.” SAGE Open 6 (1): 116.

Gerald Marwell , Pamela E. Oliver , and Ralph Prahl . 1988. “Social Networks and Collective Action: A Theory of the Critical Mass. III.” American Journal of Sociology 94 (3): 502–34.

Doug McAdam , and Ronnelle Paulsen . 1993. “Specifying the Relationship Between Social Ties and Activism.” American Journal of Sociology 99 (3): 640–67.

Karl-Dieter Opp , and Christiane Gern . 1993. “Dissident Groups, Personal Networks, and Spontaneous Cooperation: The East German Revolution of 1989.” American Sociological Review 58 (5): 659–80.

Sarah Elizabeth Parkinson . 2013. “Organizing Rebellion: Rethinking High-Risk Mobilization and Social Networks in War.” American Political Science Review 107 (03): 418–32.

John W. Patty , and Elizabeth Maggie Penn . 2014. “Sequential Decision Making and Information Aggregation in Small Networks.” Political Science Research and Methods 2 (02): 243–71.

Matthew J. Salganik , Peter Sheridan Dodds , and Duncan J. Watts . 2006. “Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market.” Science 311 (5762): 854– 56.

David A. Siegel 2009. “Social Networks and Collective Action.” American Journal of Political Science 53 (1): 122–38.

Betsy Sinclair . 2012. The Social Citizen: Peer Networks and Political Behavior. Chicago, IL: University of Chicago Press.

Zachary C. Steinert-Threlkeld 2017. “Spontaneous Collective Action: Peripheral Mobilization during the Arab Spring.” American Political Science Review 111 (2): 379403.

Zachary Steinert-Threlkeld , Delia Mocanu , Alessandro Vespignani , and James Fowler . 2015. “Online Social Networks and Offline Protest.” EPJ Data Science 4 (1): 19.

Kaveri Subrahmanyam , Stephanie M. Reich , Natalia Waechter , and Guadalupe Espinoza . 2008. “Online and Offline Social Networks: Use of Social Networking Sites by Emerging Adults.” Journal of Applied Developmental Psychology 29 (6): 420–33.

Güneş Murat Tezcür . 2016. “Ordinary People, Extraordinary Risks: Participation in an Ethnic Rebellion.” American Political Science Review 110 (02): 247–64.

Jill D. Weinberg , Jeremy Freese , and David McElhattan . 2015. “Comparing Data Characteristics and Results of an Online Factorial Survey Between a Population-Based and a Crowdsource-Recruited Sample.” Sociological Science 1 (doi:10.15195/v1.a19): 292310.

Keith Wilcox , and Andrew T. Stephen . 2013. “Are Close Friends the Enemy? Online Social Networks, Self-Esteem, and Self-Control.” Journal of Consumer Research 40 (1): 90103.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

American Political Science Review
  • ISSN: 0003-0554
  • EISSN: 1537-5943
  • URL: /core/journals/american-political-science-review
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
Type Description Title
Supplementary Materials

Bisbee and Larson supplementary material
Online Appendix

 PDF (302 KB)
302 KB


Altmetric attention score

Full text views

Total number of HTML views: 27
Total number of PDF views: 311 *
Loading metrics...

Abstract views

Total abstract views: 1131 *
Loading metrics...

* Views captured on Cambridge Core between 13th June 2017 - 22nd September 2017. This data will be updated every 24 hours.