Hostname: page-component-848d4c4894-sjtt6 Total loading time: 0 Render date: 2024-06-24T05:16:01.251Z Has data issue: false hasContentIssue false

Scraping Public Co-Occurrences for Statistical Network Analysis of Political Elites

Published online by Cambridge University Press:  14 September 2017


Collecting network information on political elites using conventional methods such as surveys and text records is challenging in authoritarian and/or conflict-ridden states. I introduce a data collection method for elite networks using scraping algorithms to capture public co-appearances at political and social events. Validity checks using existing data show the method effectively replicates interaction-based networks but not networks based on behavioral similarities; in both cases, measurement error remains a concern. Applying the method to Nigeria illustrates that patronage—measured in terms of public connectivity—does not drive national oil companies appointments. Given that theories of elite behavior aim to understand individual-level interactions, the applicability of data using this technique is well-suited to situations where intrusive data collection is costly or prohibitive.

Research Note
© The European Political Science Association 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)



Paasha Mahdavi is an Assistant Professor in the McCourt School of Public Policy, Georgetown University, Old North, Suite 100, 3700 O Street NW, Washington, DC 20057 ( This paper has benefited from discussions with Nicholas Beauchamp, Graeme Blair, Bruce Desmarais, Mark Handcock, John Ishiyama, Franziska Keller, Jeffrey Lewis, Lauren Peritz, Brandon Stewart, Josef Woldense and participants at the 2014 meeting of the Society for Political Methodology, the 2015 meeting of the American Political Science Association, and the UCLA working group on statistical network analysis. The author thanks the editors and three anonymous reviewers for their comments and suggestions. All errors are the authors own. To view supplementary material for this article, please visit


Avina-Vazquez, Carlos Rafael, and Uddin, Shahzad. 2016. ‘Social capital, networks and interlocking directorates: A Mexican tale’. Journal of Accounting in Emerging Economies 6(3):291312.Google Scholar
Bueno de Mesquita, Bruce, Smith, Alastair, Siverson, Randolph, and Morrow, James. 2003. The Logic of Political Survival. Cambridge, MA: MIT Press.Google Scholar
Cranmer, Skyler J., and Desmarais, Bruce A.. 2011. ‘Inferential network analysis with exponential random graph models’. Political Analysis 19(1):6686.Google Scholar
Desmarais, Bruce A., Moscardelli, Vincent G., Schaffner, Brian F., and Kowal, Michael S.. 2015. ‘Measuring legislative collaboration: The Senate press events network’. Social Networks 40:4354.Google Scholar
Fowler, James H. 2006. ‘Connecting the Congress: A Study of Cosponsorship Networks’. Political Analysis 14(4):456487.Google Scholar
Gillies, Alexandra. 2009. ‘Reforming corruption out of Nigerian oil?’. Chr. Michelson Institute U4 Brief 2:14.Google Scholar
Grimmer, Justin, and Stewart, Brandon M.. 2013. ‘Text as data: The promise and pitfalls of automatic content analysis methods for political texts’. Political Analysis 21:267297.Google Scholar
Ishiyama, John. 2014. ‘Assessing the leadership transition in North Korea: Using network analysis of field inspections, 1997-2012’. Communist and Post-Communist Studies 47:137146.Google Scholar
Lazer, David. 2011. ‘Networks in political science: Back to the future’. PS: Political Science & Politics 44(1):6168.Google Scholar
Lee, Sang Hoon, Kim, Pan-Jun, Ahn, Yong-Yeol, and Jeong, Hawoong. 2010. ‘Googling social interactions: Web search engine based social network construction’. PLoS ONE 5(7):e11233.Google Scholar
Mahdavi, Paasha, and Ishiyama, John. 2016. Dynamics of the inner elite in dictatorships: Evidence from North Korea. Unpublished manuscript, Georgetown University.Google Scholar
Scott, James C. 1972. ‘Patron-client politics and political change in Southeast Asia’. American Political Science Review 66(1):91113.Google Scholar
Svolik, Milan. 2012. The Politics of Authoritarian Rule. New York, NY: Cambridge University Press.Google Scholar
Victor, David G., Hults, David, and Thurber, Mark C. (Eds.) 2012. Oil and Governance: State-owned Enterprises and the World Energy Supply. New York, NY: Cambridge University Press.Google Scholar
Victor, Jennifer N., and Ringe, Nils. 2009. ‘The social utility of informal institutions caucuses as networks in the 110th US House of Representatives’. American Politics Research 37(5):742766.Google Scholar
Ward, Michael D., Stovel, Katherine, and Sacks, Audrey. 2011. ‘Network analysis and political science’. Annual Review of Political Science 14:245264.Google Scholar
Wasserman, Stanley, and Faust, Katherine. 1994. Social Network Analysis: Methods and Applications. Cambridge, UK: Cambridge University Press.Google Scholar
Supplementary material: PDF

Mahdavi supplementary material

Online Appendix

Download Mahdavi supplementary material(PDF)
PDF 3.8 MB