Today, institutions of higher education face austerity pressures (Furstenberg Reference Furstenberg2021); shrinking numbers of tenure-track research faculty positions (Woolston Reference Woolston2021); a multiyear pandemic that necessitated new methods of instruction (Phillips Reference Phillips2021); and a growing realization about the ways that structural racism limits access to higher education and impoverishes the perspectives promoted in academia (Matias and Hope Reference Matias2021). Amid the pressures to publish, do more with less, and adapt to changing student needs, faculty members have an obligation to help their students develop new skills and to increase diversity in the academy through mentorship.
As a team consisting of undergraduate, graduate, and faculty researchers who identify as women, BIPOC (Black, Indigenous, and People of Color), first-generation college students, and queer scholars (several of whom experience learning disabilities), we have implemented a collaborative research lab designed to confront these interrelated problems. Our pedagogical premise is that faculty research goals, student experiential learning, and student well-being reinforce one another. Our lab-based model leverages evidence-based best practices in experiential education (Roberts Reference Roberts2015), builds collaborative research teams with a commitment to servant leadership, and strives for a “whole-person” approach to mentorship (Podger, Mustakova-Possardt, and Reid Reference Podger, Mustakova-Possardt and Reid2010). This enables an iterative, learn-by-doing, low-pressure environment in which mistakes are considered a necessary part of learning and students are better able to develop their research and management skills (Niiya, Crocker, and Bartmess Reference Niiya, Crocker and Bartmess2004).Footnote 1 Moreover, faculty members can be actively involved in counteracting the canonical hierarchical relationships that often marginalize students from certain backgrounds (Jordan-Zachery Reference Jordan-Zachery2004; Monforti and Michelson Reference Monforti and Michelson2008).
This approach required a change in thinking about student compensation, student recognition, student well-being, and faculty members’ investment in student training. We counteract the approach to research as a zero-sum game—which often makes students feel exploited and depressed (Anonymous Academics 2018)—by building a fun, collaborative research environment that helps students to achieve their individual goals while advancing collective research efforts, compensating students fully for their work, and investing in their long-term skill development. These changes yield more rigorous, more innovative research output (Aikens et al. Reference Aikens, Robertson, Sadselia, Watkins, Evans, Runyon, Eby and Dolan2017) for faculty members as well.
BARRIERS TO ACHIEVING RESEARCH AND PEDAGOGICAL SUCCESS
Higher education remains centered around lectures and evaluation, even though experiential education yields improved educational outcomes (Eyler Reference Eyler2009; Roberts Reference Roberts2015). Traditional hierarchies (e.g., between faculty members and students) introduce communication deficiencies (Aikens et al. Reference Aikens, Robertson, Sadselia, Watkins, Evans, Runyon, Eby and Dolan2017; Widhiastuti Reference Widhiastuti2012) and perpetuate inequality (Jordan-Zachery Reference Jordan-Zachery2004; Monforti and Michelson Reference Monforti and Michelson2008). Students functioning in typical research cultures often are fearful of making or admitting mistakes, which can introduce data errors, undermine student learning (Metcalfe Reference Metcalfe2017), and disincentivize student participation.
Established norms contribute to exclusionary pipelines that marginalize students from certain racial, cultural, and economic groups. The expectation that students interested in research should engage in unpaid research labor exacerbates these challenges and disproportionately excludes financially vulnerable students (who lack the resources to spend extracurricular time working without pay) from gaining experience that could dramatically expand their career opportunities (Chemers et al. Reference Chemers, Zurbriggen, Syed, Goza and Bearman2011).
The expectation that students interested in research should engage in unpaid research labor exacerbates these challenges and disproportionately excludes financially vulnerable students (who lack the resources to spend extracurricular time working without pay) from gaining experience that could dramatically expand their career opportunities.
PEDAGOGICAL APPROACH
We expect that students who feel supported, compensated, and personally invested will produce better research. Therefore, faculty research goals, student learning, and student well-being all reinforce one another. Our pedagogical strategy centers on three fundamental pillars: experiential learning (EE), team-based research guided by servant leaders, and a whole-person approach to supporting student researchers. This work requires a proactive commitment to counteracting the entrenched biases that exclude or marginalize students from certain racial, economic, and cultural backgrounds.
Experiential Education
EE replaces lectures and evaluation with a semi-structured, apprentice-style education that is highly successful (Christian, McCarty, and Brown Reference Christian, McCarty and Brown2021; Cook and Cutting Reference Cook and Cutting2014; DiConti Reference DiConti2004; Katula and Threnhauser Reference Katula and Threnhauser1999; Roberts Reference Roberts2015; Stehno Reference Stehno1986), despite faculty resistance (Erickson Reference Erickson2013). EE can facilitate student enjoyment and lifelong learning (Sibthorp et al. Reference Sibthorp, Schumann, Gookin, Baynes, Paisley and Rathunde2011), enhance critical thinking (Savage and Wehman Reference Savage and Wehman2014), retain student researchers (Monroe, Mailander, and Lima Reference Monroe, Mailander and Lima2006), and support students from historically excluded backgrounds (Roberts Reference Roberts2018). In our EE-based lab, students actively participate in every stage of the research process; assume more responsibilities as their competencies develop; and fill management roles that, in turn, cultivate learning-by-teaching, leadership experience, student investment in research output, and institutional memory.
Students from a relatively privileged background are more likely to have the preexisting skills, knowledge, and decorum that faculty members seek when hiring undergraduate researchers—that is, academia’s “hidden curriculum” (Jackson Reference Jackson1968; Margolis Reference Margolis2001). Our EE approach responds to individual students’ existing experience, skills, and interests to provide the unique training they need to grow as researchers.
Teams with Servant Leaders
Team environments based on trust and mutual benefit facilitate innovation (Fraga Reference Fraga2022; Salas, Reyes, and McDaniel Reference Salas, Reyes and McDaniel2018) and improve business outcomes (Collins Reference Collins2009; Covey Reference Covey1989). Despite the success of companies that famously cultivate teams, academia maintains relatively insular, individual “sink-or-swim” approaches to research. In contrast, academic research labs build supportive, collaborative teams guided by “servant leaders” (Patterson Reference Patterson2003; Van Dierendonck Reference Van Dierendonck2011)Footnote 2 who demonstrate their imperfections, solicit advice from students, apologize for mistakes (de Saint-Exupery Reference de Saint-Exupery1943), and avoid “one-size-fits-all” management. Collaborative teams cultivate student creativity; establish “safe” environments to diagnose and address errors; enhance student learning, enjoyment, and retention; and ultimately improve research volume, quality, and innovation.
This approach can accommodate and benefit from participants who have diverse skills and experiences by expanding the pool of student participants and disrupting patterns of exclusion. Moreover, faculty servant leaders are accessible, help to demystify prestige, and present professional pathways as more attainable to all students.
Whole-Person Approach
The team-oriented model approaches each student researcher as a whole person with unique strengths, needs, interests, and career goals. Whole-person learning focuses on a person’s “identity, motivation, and higher-order dispositions” rather than their “specific capabilities and competencies” (Podger, Mustakova-Possardt, and Reid Reference Podger, Mustakova-Possardt and Reid2010). Relative to capability-focused learning, whole-person education models are more inclusive, yield greater skill acquisition (Hoover et al. Reference Hoover, Giambatista, Sorenson and Bommer2010), and could safeguard against widespread (if unintentional) exploitation within academia (Anonymous Academics 2018). With a whole-person approach, students feel free to express their unique identities, are valued and supported, and connect with their colleagues.
IMPLEMENTATION
Our implementation strategy is designed to improve academic research output; improve student educational experience and professional preparedness; and upend academic norms and practices that unintentionally contribute to historical patterns of exclusion.
Experiential Education in Practice
We involve students in every phase of the research process, shifting their tasks as their skills develop. We give students opportunities to incrementally accomplish unfamiliar tasks and support them as they learn, try, fail, adapt, and eventually succeed.
Consider, for example, one student’s research experience. The student began working in the lab as an undergraduate research assistant responsible for labeling tweets from a militant group. She had regular one-on-one meetings with her graduate-student supervisor, who encouraged her to ask questions about the coding ontology, identify problems and challenges with the coding schema, and suggest areas for improvement. When the student demonstrated an advanced understanding of the coding process, she began training and managing a team of five undergraduate coders. Eventually, her team wrote the first draft of a new coding ontology for publication, and each team member subsequently trained and supervised their own group of new coders. Team leaders had the opportunity to learn statistical programming software (R), clean the data that they had helped to generate, conduct basic analysis, and participate as coauthors in the research report. Each student acquired marketable professional skills (e.g., teaching, management, and presenting) and also developed advanced knowledge about the subject (civil conflict), the case (Syria), the theories and practices of social science hypothesis testing, the data-collection process, research strategies, and academic writing.
Collaborative Culture
Our work culture is centered on the belief that rigorous, innovative research is best achieved through supportive collaboration—versus competition and punishment—among people who feel happy and valued.
Displaying Imperfections and Celebrating Failures
To produce high-quality, accurate research with integrity, we first need student researchers to perform careful work and to feel comfortable communicating questions and errors. To establish these norms, faculty members and student leaders are encouraged to share their mistakes and failures. Second, we normalize (rather than punish) mistakes as part of the research and learning processes (Smith et al. Reference Smith, Kass, Rotunda and Schneider2006) so that students feel safe to identify and help remediate errors (which otherwise may go unaddressed), as described by the following student’s experience:
I learned a lot about personal accountability and how to make mistakes and find cooperative solutions for them. This lab values mistakes as a learning moment and that taught me a lot about how to take responsibility while not feeling shame (anonymous student evaluation, November 2020).
Third, we allow flexible deadlines to prevent students from producing suboptimal work. Fourth, we maintain informal, approachable communication styles that allow students to participate in whichever formats are most natural to them and to offer ideas for new and ongoing research. In addition to enhancing research integrity, these tactics improve student confidence and well-being.
Actively Supporting Student Well-Being
We conduct individual discussions with every student to understand their preferred working style, their unique needs to achieve their tasks, their long-term goals, and any personal circumstances that they want to share. We proactively support student mental health in light of personal circumstances and current events and tragedies. For example, following the racially motivated police killing of George Floyd, we paid BIPOC-identifying students for one to two hours of self-care and non-BIPOC students for one to two hours of self-education about racial injustice.
We also introduce mechanisms for support and levity at the lab-wide level, including posting faculty members’ “failure resumés” and student achievement “brags”; recognizing religious and cultural holidays, birthdays, and family milestones; hosting game nights and trivia contests; and creating space for students to share nonacademic skills and interests. According to one anonymous student review (March 2021): “No community is perfect but this one is really close!”
Compensation for Participation
Academic norms often expect students to conduct some degree of free research labor, and established funding parameters infrequently allow principal investigators (PIs) to pay students for time spent acquiring requisite research skills (Anonymous Academics 2018). These expectations can render certain students (e.g., those whose families are experiencing financial hardship) unable to participate in research, to feel unwelcome, to be embarrassed for lacking exposure to presumed knowledge and experience, to face financial hardship, to avoid pursuing research-related careers, and/or to consider leaving college. We contend that compensating students for their time can mitigate against perpetuating such inequalities (Chemers et al. Reference Chemers, Zurbriggen, Syed, Goza and Bearman2011) and encourage all students to take their research tasks more seriously. We compensate students with pay from grants and federal work–study programs and/or course credit. We provide additional incentives via live computational coding sessions; writing tutorials; professional-development workshops (e.g., pursuing policy careers and applying to graduate school); and targeted support to prepare students for desired careers in academic, public policy, and industry sectors.
Student Investment in Research Products
We depart from prevailing norms that limit coauthorship and emphasize individual faculty ownership over research. Faculty members can remain intellectual drivers while providing adequate intellectual credit to their student researchers. The increase in social science coauthorship (Henriksen Reference Henriksen2016, Reference Henriksen2018; Metz and Jackle Reference Metz and Jackle2017) insufficiently extends to graduate students and rarely includes undergraduates. However, our students devote considerable research time and frequently make valuable intellectual contributions to our research projects. To incentivize student engagement and acknowledge their contributions, we cultivate noncompetitive teams in which all active participants who make specific intellectual contributions receive coauthorship on relevant research output. Intellectual contributions range from helping to develop and improve coding categories and other date-generation parametersFootnote 3; to aiding in the data-cleaning, analysis, and writing processes; to generating new research ideas or frameworks. Providing opportunities for student investment and coauthorship yields higher-quality data collection, deters mistakes and falsification, produces stronger research overall, contributes to students’ skill development, buttresses the academic credentials of those from historically excluded backgrounds, and more accurately represents the entire landscape of intellectual contribution to a given research project.
Providing opportunities for student investment and coauthorship yields higher-quality data collection, deters mistakes and falsification, produces stronger research overall, contributes to students’ skill development, buttresses the academic credentials of those from historically excluded backgrounds, and more accurately represents the entire landscape of intellectual contribution to a given research project.
Our goal is to recruit bright, engaged students—emphasizing enthusiasm and work ethic over experience and skill base—from our courses and via an application form without strict reference to existing skills. With full student buy-in, we can teach students what they need to know (e.g., data analysis and academic writing). We begin with course-credit options to acclimatize students to our expectations and culture, provide a foundation in data-collection and labeling skills, and then give those who are fully engaged the opportunity for a paid role. Because we emphasize a decentralized education model, students can teach and support other students, allowing faculty members to support more students without becoming overburdened. This not only minimizes the costs to faculty members with limited budgets but also allows for the recruitment of students who might not have had the required skills for the role at the outset.
Hierarchy-Attenuating Mentorship
Multilevel and peer-mentorship networks streamline workflows, provide students with various mentor perspectives, and disrupt patterns of exclusion perpetuated by dyadic mentorship structures (Becker Reference Becker2020; Becker, Graham, and Zvobgo Reference Becker, Benjamin and Zvobgo2021). We enable students to learn from one another, become mentors to newer lab members, and ask questions of entire teams. Graduate students model how to ask questions and frame responses. Slack (i.e., a collaborative workspace platform) channels connect students to problem solving and build peer relationships while also providing venues for PI input and comprehensive documentation of research decisions and processes.
EVIDENCE OF SUCCESS
Our approach has yielded a promising level of research productivity, research quality, and student retention. In four years, we have or are in the process of manually generating three major quantitative datasets from qualitative text-based data from social media and historical archives. Graduate and undergraduate students are coauthors of 10 working research articles based on the data collected; some articles currently are under review. Our approach to training coders achieves levels of intercoder reliability that exceed established social science standards. Student researchers have envisioned and implemented new approaches to evaluating coder agreement. At the time of writing, we have involved 41 undergraduate students, 14 graduate students, and one postdoctoral researcher. The average undergraduate student remains involved in research for 16 months; 27% remain involved after graduation. Our multilevel approach to mentorship and a teams-based structure allows us to maintain this level of research output, student involvement, and student retention.
Student researchers report gaining academic and practical skills that they otherwise would not have acquired from college coursework or traditional faculty engagement. In an anonymous April 2022 survey, students reported developing significant writing, research, coding, leadership, communication, and other skills through lab activities. Students from historically excluded demographics reported receiving rare and much-needed support. Student evaluations of their lab experience ranged from “positive” to “life changing” (table 1).
Selected Responses from April 2022 Anonymous Undergraduate Survey
ONGOING CHALLENGES
Several challenges remain for implementing an EE approach to academic research.
Disparate Research Objectives
Our lab primarily collects, codes, and analyzes observational data for quantitative analysis and qualitative process tracing. Researchers could deploy similar principles and tactics to accomplish other research tasks. Teams in experiment-based labs could brainstorm treatments and trial treatment arms and also consider ethical implications of experimental interventions. Computational labs could host hackathons and work in coding teams to generate, test run, and clean code.Footnote 4
Funding
Financing lab research and student compensation requires significant resources. External funding awards are exceptionally competitive, and access to internal university funding varies widely and has the potential to reinforce existing inequalities. (Our lab benefits from its location in a private university that has a significant endowment.). The EE approach has unique appeal to some potential funders, and faculty members may be able to use federal work–study programs to support qualified student researchers. Furthermore, other aspects of our pedagogical approach may be executable under the guise of more modest faculty startup funds, department support, and student course credit.
Institutional Buy-In
An EE model is likely to be most successful when it has buy-in across faculty members, departments, administrative leadership (e.g., department chairs and deans), and/or colleges and universities. In the absence of institutional buy-in, individual faculty members may need to spearhead new paths that deviate from established norms and expectations.
Entrenched Academic Systems
Some aspects of our proposed approach challenge conventional academic norms and assumptions. At times, our faculty leaders have faced skepticism and concern that investing in a multiple-researcher model squanders time and financial resources; that proactive undergraduate mentorship and/or commitments to diversity, equity, and inclusion detract from faculty progress; that extensive undergraduate involvement can undermine research quality and publication placement; and that this model is institutionally unsustainable. We anticipate that student demand for professional preparedness and the research success of emerging experiential labs (e.g., Vanderbilt University’s Laboratory for Research on Conflict and Collective Action and the University of Southern California’s Security and Political Economy Lab) eventually will assuage these concerns.
Some aspects of our proposed approach challenge conventional academic norms and assumptions.
FOUNDING A LAB
There is no one correct way to establish a lab. Our approach involved recruiting a single student from a wide applicant pool and training that student during the summer. We then recruited a small cohort of students (i.e., five) in the fall of 2019, and the first student that we trained became the lead coder for the project, facilitating question-answering and intercoder reliability. By implementing the pedagogical approach described above, and with student engagement that shaped how the lab developed, these students exceled (including coauthoring this article!) and enabled the lab leaders to engage a broader coding team. We ran frequent within-lab evaluations, focusing on team building and retaining institutional memory among coders to minimize the need for retraining. As student coders assumed more responsibility and eventually data-analysis and coauthorship roles, we were able to generate institutional support through internal grants and bridge funding at our home institution. In addition, we received external grant funding for various aspects of our work—specific research projects, educational initiatives, and summer workshops—from the National Science Foundation, the Carnegie Foundation, the Academic Data Science Alliance, and the US Air Force.
When speaking to department leadership, faculty leaders found it helpful to emphasize how the lab supported their own progress toward tenure and promotion as well as recruitment of undergraduate majors. When speaking to institutional leadership, faculty leaders found it helpful to emphasize the contribution to student learning, diversity and inclusion initiatives, overlap with institutional priorities, and undergraduate experience on campus. Over time, we secured follow-up grants, achieved recognition of the lab as a federal work–study program, and are en route to approval as an EE program at our primary institution.
HOW THE LAB PREPARED STUDENTS FOR WHAT COMES NEXT
Our students have moved from the lab directly into think-tank roles, consulting positions, paid policy-relevant internships, law schools, and master’s and PhD programs in political science. When they were asked, the student coauthors of this article highlighted the lab-provided skills that prepared them for these roles (table 2).
Student Authors’ Statements About How the Lab Experience Prepared Them for a Post-Collegiate Career
CONCLUSION
This article outlines a pedagogical approach and implementation strategy designed to accomplish three aims: (1) improve academic research output; (2) improve student educational experience and professional preparedness; and (3) upend academic norms and practices that unintentionally contribute to historical patterns of exclusion. Building a collaborative, experiential approach to education and research that considers “whole people” and emphasizes servant leadership not only advances each of these interrelated goals but also cultivates an enjoyable, innovative research environment that inspires students to enter academic and research careers. Broader institutional change could make funding and supporting these programs more feasible. Until then, many (but not all) of the strategies highlighted in this article can be implemented by individual faculty members as they continue to find ways to overcome ongoing barriers.
ACKNOWLEDGMENTS
We gratefully acknowledge conversations with Emily Ritter (Vanderbilt University), the Security and Political Economy Lab (University of Southern California), and Geoffrey Wallace (University of Washington) that helped us to establish this lab. We thank Janice Fournillier and Charity Gordon (Georgia State University) and Kamal Carter and Debra Nealy (Step Ahead Scholars) for conversations that influenced deeply how we think about education pedagogy and the best ways to support students from backgrounds historically excluded from the academy. We are grateful to Noah Smith (University of Washington) and Diyi Yang (Georgia Tech), whose computer science labs and leadership styles influenced the founding of our lab. Any mistakes are our own.
Supplementary Materials
To view supplementary material for this article, please visit http://doi.org/10.1017/S1049096523000033.
CONFLICTS OF INTEREST
The authors declare that there are no ethical issues or conflicts of interest in this research.
Open access
