Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-10-31T23:18:28.173Z Has data issue: false hasContentIssue false

Organizational and training factors that promote team science: A qualitative analysis and application of theory to the National Institutes of Health’s BIRCWH career development program

Published online by Cambridge University Press:  08 February 2017

Jeanne-Marie Guise*
Affiliation:
Department of Obstetrics and Gynecology, Division of Maternal Fetal Medicine, OHSU School of Medicine, Portland, OR, USA Department of Medical Informatics and Clinical Epidemiology, OHSU School of Medicine, Portland, OR, USA Department of Emergency Medicine, OHSU School of Medicine, Portland, OR, USA OHSU-PSU School of Public Health, Portland, OR, USA
Susan Winter
Affiliation:
College of Information Studies, University of Maryland, College Park, MD, USA
Stephen M. Fiore
Affiliation:
Cognitive Sciences Program, Department of Philosophy, University of Central Florida, Orlando, FL, USA
Judith G. Regensteiner
Affiliation:
Center for Women’s Health Research, Division of General Internal Medicine and Cardiology, University of Colorado School of Medicine, Aurora, CO, USA
Joan Nagel
Affiliation:
Center for Advancing Translational Sciences, National Institutes of Health, Bethesda, MD, USA
*
*Address for correspondence: J.-M. Guise, M.D., M.P.H., Department of Obstetrics and Gynecology, Division of Maternal Fetal Medicine, OHSU School of Medicine, L466, 3181 SW Sam Jackson Park Road, Portland, OR 97239, USA. (Email: guisej@ohsu.edu)
Rights & Permissions [Opens in a new window]

Abstract

Introduction

Research organizations face challenges in creating infrastructures that cultivates and sustains interdisciplinary team science. The objective of this paper is to identify structural elements of organizations and training that promote team science.

Methods

We qualitatively analyzed the National Institutes of Health’s Building Interdisciplinary Research Careers in Women’s Health, K12 using organizational psychology and team science theories to identify organizational design factors for successful team science and training.

Principal Results

Seven key design elements support team science: (1) semiformal meta-organizational structure, (2) shared context and goals, (3) formal evaluation processes, (4) meetings to promote communication, (5) role clarity in mentoring, (6) building interpersonal competencies among faculty and trainees, and (7) designing promotion and tenure and other organizational processes to support interdisciplinary team science.

Conclusion

This application of theory to a long-standing and successful program provides important foundational elements for programs and institutions to consider in promoting team science.

Type
Education
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Association for Clinical and Translational Science 2017

Introduction

Health and well-being, education and learning, climate change, and disaster response are just a few examples of the complex domains that the modern scientific enterprise is asked to address. The complexity of these societal problem calls for large-scale, sustained, collaborative, and interdisciplinary approaches. Governments, charitable foundations, and for-profit companies are investing in scientific collaborations that cut across all types of science, fueling the demand for integrated interdisciplinary perspectives [Reference Fiore1]. The centrality of interdisciplinarity to innovation has been widely acknowledged [Reference Uzzi2]. It has been reported that important discoveries and outcomes emerging from cutting-edge interdisciplinary research have fueled economic growth and improved societal vitality [3, Reference Wuchty, Jones and Uzzi4].

Expanding innovative interdisciplinary science requires changes in institutions that traditionally have focused on individual scholarship including universities and funding agencies. In addition, changes in the approaches and attitudes of scholars themselves will be necessary. In the long term, institutional systems and processes of promotion, and peer review of grants and manuscripts must include a broader perspective that encompasses the scholarly efforts of interdisciplinary science collaborations. At present, the individualistic focus of traditional scientific training is ill-suited to meet the demand for interdisciplinary scientists [Reference Winter5]. A number of programs have been created to encourage institutions to develop collaborative, interdisciplinary scientists, but this change needs to become widespread [Reference Paletz, Smith-Doerr and Vardi6].

Empirical research has shown that young scholars are particularly attracted to interdisciplinary research, especially for the opportunity to work on important problems and collaborate with others [Reference Rhoten and Parker7]. Developing interdisciplinary researchers requires educational experiences, exposing scientists to interdisciplinary environments, and developing deep knowledge of multiple fields. Further, scientists need to develop the skills required to become effective members of interdisciplinary collaborations and leaders for institutional change [Reference Van Hartesveldt and Giordan8]. The nature of these skills is not yet fully understood and efforts to develop interdisciplinary researchers have been limited [Reference Nash9]. In addition, there is growing concern that graduates of many interdisciplinary programs face significant disadvantages in their careers including difficulty in finding interdisciplinary positions, funding, and publication outlets appropriate for their cross-cutting areas of research [Reference Paletz, Smith-Doerr and Vardi6, Reference Rhoten and Parker7]. This can negatively impact professional development, resulting in a career pipeline that loses a large fraction of scientific talent at each career stage [Reference Rhoten and Pfirman10].

The objective of this study is to apply organizational and psychological sciences theory to evaluate one of the longest standing programs for training interdisciplinary team scientists [the US National Institutes of Health (NIH) Office of Research on Women’s Health (ORWH) Building Interdisciplinary Research Careers in Women’s Health (BIRCWH) Program (NIH ORWH BIRCWH K12 Program)] to understand the structure of scholarly institutions and the training that promotes team science.

Methods

Program Analysis Applying Organizational and Social Theory

Programs can be analyzed through the lens of organizational and social science theory. We briefly review recent developments in the conduct of science, highlighting the importance of complex organizations such as universities and interdisciplinary collaborative teams. Drawing on theory and concepts from organizational and social sciences, 1 qualitative expert trained in organizational studies and 1 BIRCWH Director experienced in qualitative research analyzed the BIRCWH program to identify mechanisms underlying its success and the implications for mutually informed theory and practice. To ensure reliability of the coding structure, all themes were reviewed with the larger multidisciplinary research team, which included a qualitative expert trained in team science, a BIRCWH Director, and a national BIRCWH Program leader representing a major governmental funder. Discrepancies between coders were resolved through discussion in the larger research team. Finally, we integrate theory and practice, identifying additional areas for research, and set the stage for translating the success of this program to support other complex interdisciplinary research endeavors.

Results

Developments in the Conduct of Team Science

Teams are defined as “two or more individuals who must interact and adapt to achieve specified, shared, and valued objectives” [Reference Salas11]. They rely on multiple information sources and intensive communication and have clearly demarcated roles. Members hold task-relevant knowledge with meaningful task interdependencies and must coordinate their actions and interactions so that goals and objectives are met. Teamwork allows people to achieve objectives that an individual could not achieve alone while maintaining only partially overlapping knowledge [Reference Salas, Fiore and Letsky12].

Teamwork in science varies in complexity based upon a variety of factors, including the number of scientific and professional disciplines involved. Science of Team Science scholars have defined the various ways that science teams interact to produce knowledge [Reference Fiore1, Reference Klein13Reference Wagner17]. At the simplest level, multidisciplinary research brings scientists together to accomplish a broader analysis of a problem. This team may periodically meet, but participants work largely independently and their contributions are more complementary than integrative. Interdisciplinary research involves the systematic integration of information, data, techniques, tools, perspectives, concepts, and/or theories from multiple bodies of specialized knowledge [15] to develop something new that advances fundamental understanding and solves problems that a single discipline could not [Reference Fiore1]. Transdisciplinary research brings a multi-level perspective to problems (eg, from cellular to societal) and may include partners from outside science (eg, patients, families, and advocacy groups) as active participants to develop a comprehensive understanding of complex societal challenges and accelerate the translation to application.

Description of the BIRCWH K12 Program

The NIH ORWH BIRCWH K12 Program provides protected time for research and salary support to early career clinical and basic scientists to conduct research in women’s health or sex differences research, and provides each participant an interdisciplinary team of mentors to guide them in building an interdisciplinary career.

The ORWH has long recognized that “the study of women’s health across the lifespan requires an interdisciplinary approach to research, bridging basic and clinical science, and incorporating new models of collaboration, institutional support, and ways of evaluating those who conduct it” [18]. Reports of a dearth of data on women’s health conditions and a need to support and protect time for women’s health research, were the impetus for the ORWH to establish the BIRCWH K12 Program to specifically encourage and support development of interdisciplinary team science on women’s health and gender topics [19Reference Pinn and Blehar22]. Fig. 1 provides an overview of the program’s structure. The program is designed around 3 pillars: (1) career development, (2) mentoring, and (3) interdisciplinary research. Although there are differences in the scientific focus and administrative details across participating institutions, all provide 75% protected time for scholars to pursue mentored research in women’s health, require interdisciplinary team mentoring, and have shared investments between NIH and the institution. The BIRCWH requires that the principal investigator (PI) of a program is a high-ranking leader in the institution, “such as a Dean, Department Chair, or Director of a research center or interdisciplinary institute” [18], specifically to ensure the integration of team science into the fabric of the institution.

Fig. 1 Organizational structure of the Building Interdisciplinary Research Careers in Women’s Health (BIRCWH) according to the Science of Team Science (SciTS) multi-level framework. NIH, National Institutes of Health.

Published evaluations provide evidence of the impact of the BIRCWH program since 2000. In October 2013, 27 sites were currently active and 77 funding awards had enabled 542 BIRCWH scholars to participate at 39 institutions. A majority of BIRCWH scholars had applied for competitive grants after completing training and approximately two-thirds were successful [Reference Nagel23]. Scholars participating in the BIRCWH were also found to have a grant success rate of 38% compared with the NIH overall average of 29%.

Application of Organizational and Psychological Sciences Theory to Evaluate the BIRCWH

The application of theory and concepts from research on organizations and teams applied to the NIH ORWH BIRCWH K12 Program identified themes for the design of institutions and programs to support team science and the development of interdisciplinary team scientists. Seven themes for infrastructural elements that promote team science were common across BIRCWH programs.

Semiformal Meta-Organizational Structure

Designing scientific research organizations is challenging [Reference Lutters and Winter24]. A multi-level mixed method approach has been used to understand the Science of Team Science [Reference Borner25]. Applying this model to the BIRCWH program reveals important insights on how the semiformal organizational structure of the BIRCWH addresses challenges faced by investigators and institutions in conducting and supporting team science (Fig. 1).

An important factor in the BIRCWH program’s success is its complex innovative cross-organizational structure that allows it to leverage existing resources by, for example, requiring shared NIH and institutional investments, thereby maximizing its impact, flexibility, and longevity (macro-level and meso-level organization). The BIRCWH program spans multiple academic research institutions (meso-level), allowing the program to leverage local facilities, investigator knowledge, and staff while being supported through funding and coordination through a Federal agency (NIH) (meta-level). This structure allows the BIRCWH program to act as a bridge that crosses research institutions and the Federal Government coordinating expertise that is widely shared across its member organizations instead of centralized and isolated within the BIRCWH senior staff. Table 1 provides a description of each organizational level. Organizational scientists would consider this kind of semiformal organization [Reference Biancani, McFarland and Dahlander26], an important structure for developing and maintaining communities of practice that link people who perform the same kind of work but at different locations [Reference Wenger27]. Consistent with organizational research, this structure provides the flexibility that is crucial to success allowing sites to tailor activities to fit local circumstances [Reference Winter and Berente28]. For instance, each BIRCWH program has different specific offerings for their BIRCWH Scholars with regard to, for example, training sessions and skill development, while all have the common goal of developing research careers [Reference Guise, Nagel and Regensteiner29].

Table 1 Multi-level mixed method analysis of strategies that promote collaborative team science

NIH, National Institutes of Health; BIRCWH, Building Interdisciplinary Research Careers in Women’s Health; PIs, Principal Investigators.

Shared Research Context and Goals

Coordinating the work of multiple individuals increases in difficulty as the number of people increases and their knowledge diverges [Reference Lutters and Winter24]. This includes not only scientific knowledge associated with their research domain, but also more practical/logistic knowledge. Simply put, 2 people in the same program, building, research institution, and state will have more shared knowledge than will 2 people in different programs. Although it may seem inconsequential, even a rudimentary lack of shared knowledge creates coordination problems. For example, people in different locations may not know about important features such as traffic delays affecting a member’s ability or availability.

The BIRCWH program has been remarkable in overcoming the many challenges associated with coordinating activities that are distributed across geography, time zones, and scholarly domains. Understanding the kinds of shared factors that ease coordination and those that present significant challenges and the mechanisms used to overcome them can facilitate their translation to other research communities. First, the nature of the work conducted across BIRCWH centers provides a shared research problem (women’s health and gender research) that is an important mechanism to overcome coordination barriers [Reference Winter and Butler30]. Second, there is a shared research context (academic research organizations). The BIRCWH program benefits from the fact that all of its participants work in the health area so they share knowledge about this area in general and about how health and healthcare research organizations operate. Third, there are shared goals around professional development and mentoring goals and have shared experiences with regard to how the centers are evaluated (eg, scholars, program level). Finally, there is the more general shared domain [Reference Winter and Berente28].

Formal Evaluation Processes

The scale of the BIRCWH program is too large for informal coordination among the BIRCWH Directors. Because of this, formal coordinating processes and practices such as performance evaluations, program evaluations, and an annual national meeting sponsored by the ORWH have been created [Reference Cummings and Kiesler31]. To minimize the administrative and reporting challenges, principal investigators and scholars work with NIH to evaluate strategies and identify best practices that can overcome challenges researchers may face resulting in a cycle of continuous improvement [Reference Guise, Nagel and Regensteiner29, Reference Guise32]. The BIRCWH PIs have published on best practices and what works and what does not work for team science [Reference Guise, Nagel and Regensteiner29, Reference Guise32]. In addition, ORWH has published evaluations in its annual report to the NIH, Advisory Committee for Women’s Health Research and is in the process of conducting an evaluation of the BIRCWH program over the last decade.

Meetings to Promote Communication

Although time consuming, meetings are acknowledged as an important coordination mechanism in collaborative science and are particularly important in the BIRCWH program (Table 2).

Table 2 Building Interdisciplinary Research Careers in Women’s Health (BIRCWH) meeting types and purposes

NIH, National Institutes of Health; PIs, Principal Investigators.

The BIRCWH has instituted a regular annual in-person national meeting among the BIRCWH principal investigators and scholars to allow ongoing coordination, and sharing of best practices that programs can use to design their local programs and meetings. At a local level, many BIRCWH sites have divided mentoring according to roles (eg, primary mentor, secondary mentor) to promote efficiencies and minimize conflict across mentors. In addition to one-on-one mentor meetings, programs also promote regular in-person meetings with the scholar’s entire mentoring team.

The knowledge and social capital of mentors, directors, and scholars are augmented with seminars, workshops, a virtual mentoring network, and the annual national BIRCWH meeting [Reference Guise, Nagel and Regensteiner29]. In addition to facilitating coordination, meetings are powerful organizational mechanisms that support knowledge sharing, networking, and collaboration among BIRCWH investigators and scholars, at local, regional, and national levels.

Design choices that affect knowledge flows are another important aspect of science organizations and both the BIRCWH program and the sites have developed policies that specify the timing, methods, and content of these knowledge flows [Reference Lutters and Winter24]. Here, again, meetings can play an important role and much of the mentoring takes place during face-to-face meetings. Importantly, this has been found to be the best communication method when there is a need to reduce ambiguity or equivocality [Reference Lutters and Winter24]. At a local level, BIRCWH programs hold various types of meetings including gatherings for BIRCWH scholars from disparate fields to present their research progress and receive feedback and clubs/societies such as K clubs/Socrates society that bring together junior faculty scholars from other career development programs such as the Clinical and Translational Science Awards to learn from each other. In this way, BIRCWH bridges scientific disciplines and fields and fosters cross-fertilization and exposure to variables that could impact the research question being asked.

Further, in order to ensure there is common ground on what is discussed, written communication is used to clarify expectations through email, agreement forms, and career development plans. This provides a permanent record, is better suited to handling more complex information, and can be used to guide future action.

Role Clarity in Mentoring

Mentoring is the second pillar of the BIRCWH program. Mentoring in science has traditionally cultivated independence and intellectual growth within a narrow field of inquiry. Interdisciplinary research mentoring should also cultivate mentees’ skills for managing team interactions and help identify training needs relevant to mentee roles within a team [Reference Fiore1]. For example, helping mentees understand the roles they play within a functional unit and the larger organizational context or helping mentees understand and address their weaknesses. Detailed analyses of the BIRCWH interdisciplinary mentoring program showed that clear roles should be outlined (eg, primary, career issues, or scientific content mentors). A primary mentor and mentee should meet frequently and written contracts should be used to manage expectations [Reference Guise, Nagel and Regensteiner29]. The networking ability of the mentor is also critical in promoting interdisciplinary science, so mentors need to have strong collaborative skills and the ability to help the mentee build new collaborative relationships within and outside of their discipline and organization. To ensure continual improvement, many BIRCWH sites include formal assessments of mentors’ self-efficacy in mentoring. In addition, the majority of sites conduct assessments/evaluations of how well the mentor-mentee relationship is working and provide training to develop mentoring skills [Reference Guise, Nagel and Regensteiner29].

Building Interpersonal Competencies Among Faculty and Trainees

Developing interpersonal competencies that support collaborative work [Reference Bedwell, Fiore and Salas33] and the intellectual orientation to manage the challenges of crossing disciplinary boundaries [Reference Stokols34] are foundational to team success. Interdisciplinary teams perform better when their members are motivated to acquire knowledge from other disciplines that are relevant to scientific problem solving and the skills and knowledge that are critical to synthesize varied concepts and theories. Interpersonal competencies including communication competencies advance by improving communication effectiveness and enhancing identification “with the collaborative and integrative goals of the team” [Reference Stokols34]. The design of the BIRCWH program cultivates these competencies scholars in that they are interfacing with multiple mentors, organizing meetings and coordinating feedback from multiple perspectives; working with interdisciplinary staff given their multi-faceted research; and working with other scholars in their program and nationally from other scientific domains.

Designing Promotion and Tenure and Other Organizational Processes to Support Interdisciplinary Team Science

Interdisciplinary research is one of the critical pillars of the BIRCWH program. Efforts to recognize and reward interdisciplinary research both at the national and institutional level have been made by BIRCWH programs at many sites. For example, the University of Colorado and Oregon Health & Science University (OHSU) promotion and tenure processes include explicit statements recognizing the value of interdisciplinary and collaborative science and setting out procedures for documenting team members’ individual contributions: “…additional evidence should also be provided such as letters from the PIs or research group heads with whom you have collaborated, outlining in detail your specific contributions and the unique skills that you brought to the team” (University of Colorado), and faculty are encouraged to demonstrate “leadership and innovation in contributions to collaborative research efforts” (OHSU). Similarly, BIRCWH programs contributed to national statements and processes supporting team science such as this contribution of the University of North Carolina’s BIRCWH to NIH policies: “biomedical science is placing more and more emphasis on interdisciplinary team activities. Therefore, when relevant, a faculty member’s contributions to interdisciplinary teamwork will be given careful consideration” [35]. These changes demonstrate the value and impact of programs that ignite a culture of collaborative interdisciplinary team science across academic organizations and science at a national level. Efforts to address promotion and tenure are ongoing and has been a major theme of National BIRCWH PI meetings.

Discussion

Examining the successes of the NIH ORWH BIRCWH K12 Program in promoting team science suggests 7 mechanisms for institutions and programs to support team science: (1) semiformal meta-organizational structure, (2) shared context and goals, (3) formal evaluation processes, (4) meetings to promote communication, (5) role clarity in mentoring, (6) building interpersonal competencies among faculty and trainees, and (7) designing promotion and tenure and other organizational processes to support interdisciplinary team science. Strategic choices in the design and implementation of the BIRCWH program have contributed to its track record of success. It represents a semiformal organization that spans institutions and leverages their resources to create a community of practice focused on improving women’s health through interdisciplinary research. With considerable decision making and control remaining in the hands of the individual sites, the NIH ORWH is able to play a predominantly coordinating role for the BIRCWH program standardizing core elements and encouraging team mentoring and co-support while enabling flexibility in the implementation details like the size and roles of the mentoring teams. This structure enhances the value of the meetings that are critical to coordination, dissemination of information, team mentoring, and career development.

Although the BIRCWH program has been successful in nurturing interdisciplinary science, the transformation in women’s health is not complete. A full acceptance of interdisciplinary team science will require continued changes in norms, values, and expectations that may take decades to unfold. Methods for conceptualizing and evaluating the quality of a scientific collaborative practice as a whole may need to be created, shifting our focus to the cultivation of scholars who stay active in a domain such as women’s health in an interdisciplinary fashion (rather than siloed) and move into leadership positions over time. Understanding, appreciating, and evaluating the multiple contributions members make to team success will require metrics that encompass a variety of team roles as well as accommodate team members who may specialize in a single area. Clearly, traditional technologies (eg, computers and cell phones) still feature prominently in communications (eg, email, teleconferences); however, additional attention is being given to use of webinars, videoconferencing, Wikis, YouTube channels, blogs, and tweets for training and/or connecting individuals, team, and programs. In order to extend theory and practice for enduring semiformal organizational structures, it may be helpful for BIRCWH Programs and others to examine the best use of technology across sites to inform best uses and ease adoption [Reference Lutters and Winter24, Reference Asencio36].

Limitations

Little is known about how to design effective interdisciplinary science enterprises; the NIH ORWH BIRCWH K12 Program represents an important model for organizational and team science. Although the BIRCWH program represents a long experience of large research network, it is only one example. More studies are needed to understand whether the experience of the BIRCWH holds true across other settings and programs. Furthermore, as science becomes increasingly interdisciplinary, it is unclear whether developing individuals with interdisciplinary skills, interdisciplinary teams, or both will be most effective. Future efforts and research should help identify the most effective organizational structures and infrastructures that support and incentivize interdisciplinary training, successful mentoring, and interdisciplinary teams.

Acknowledgments

None.

Author Contributions

JMG contributed to the conception and design of the study, qualitative and overall analysis and interpretation of data, drafting and revising the article for important content and final approval of the submitted version. SW contributed to the study design, theoretical analysis and interpretation of data, drafting, revising, and final approval of the manuscript. SF contributed to the study design, theoretical analysis and interpretation of data, revising the article for important content, and final approval of the manuscript. JR and JDN contributed to the conception and design of the study, analysis and interpretation of data, drafting and revising the article for important content and final approval of the submitted version.

Financial Support

BIRCWH programs are funded through the NIH ORWH and the NIH through the following Grants: OHSU K12 HD043488 (J.-M.G.), University of Colorado K12 K12HD057022 (J.G.R.). The content is solely the responsibility of the authors and does not represent the official views of the ORWH, National Institute of Child Health and Human Development, or the NIH.

Disclosures

None.

Declaration of Interest

None.

References

1. Fiore, SM. Interdisciplinarity as teamwork: how the science of teams can inform team science. Small Group Research 2008; 39: 251277.Google Scholar
2. Uzzi, B, et al. Atypical combinations and scientific impact. Science 2013; 342: 468472.Google Scholar
3. National Research Council. Convergence: Facilitating Transdisciplinary Integration of Life Sciences, Physical Sciences, Engineering, and Beyond. Washington, DC: The National Academies Press, 2014.Google Scholar
4. Wuchty, S, Jones, BF, Uzzi, B. The increasing dominance of teams in production of knowledge. Science 2007; 316: 10361039.Google Scholar
5. Winter, SJ. The rise of cyberinfrastructure and grand challenges for eCommerce. Information Systems and e-business Management 2012; 10: 279293.Google Scholar
6. Paletz, S, Smith-Doerr, L, Vardi, I. National Science Foundation Workshop Report: Interdisciplinary Collaboration in Innovative Science and Engineering Fields [Internet]. 2010 [cited Jul 27, 2016]. (http://www.bu.edu/sociology/files/2011/03/nsf-workshop-report.pdf)Google Scholar
7. Rhoten, D, Parker, A. Risks and rewards of an interdisciplinary research path. Science 2004; 306: 2046.CrossRefGoogle ScholarPubMed
8. Van Hartesveldt, C, Giordan, J. Impact of Transformative Interdisciplinary Research and Graduate Education on Academic Institutions. NSF 09-33, May 2008 Workshop Report. Arlington, VA: National Science Foundation, 2008.Google Scholar
9. Nash, JM. Transdisciplinary training: key components and prerequisites for success. American Journal of Preventive Medicine 2008; 38: S133S140.Google Scholar
10. Rhoten, D, Pfirman, S. Women, science and interdisciplinary ways of working. Inside Higher Ed. [Internet]. 2007 [cited Jul 26, 2016]. (http://www.insidehighered.com/views/2007/10/22/rhoten#sthash.VZj8M9PN.dpbs)Google Scholar
11. Salas, E, et al. Toward an understanding of team performance and training. In: Swezey RW, Salas SE, eds. Teams: Their Training and Performance. Norwood, NJ: Ablex, 1992, pp. 329.Google Scholar
12. Salas, E, Fiore, SM, Letsky, M. Theories of Team Cognition: Cross-disciplinary Perspectives. New York, NY: Routledge, 2012.Google Scholar
13. Klein, JT. A taxonomy of interdisciplinarity. In: Frodeman R, Klein JT, Mitcham C, eds. The Oxford Handbook of Interdisciplinarity. Oxford, UK: Oxford University Press, 2010, pp. 1530.Google Scholar
14. Hall, KL, et al. Assessing the value of team science: a study comparing center- and investigator-initiated grants. American Journal of Preventive Medicine 2012; 42: 157163.Google Scholar
15. Committee on Facilitating Interdisciplinary Research. Facilitating Interdisciplinary Research. Washington, DC: National Academies Press, 2004.Google Scholar
16. Stokols, D, et al. The science of team science: overview of the field and introduction to the supplement. American Journal of Preventive Medicine 2008; 35: S77S89.Google Scholar
17. Wagner, CS, et al. Approaches to understanding and measuring interdisciplinary scientific research (IDR): a review of the literature. Journal of Informetrics 2011; 5: 1426.Google Scholar
18. National Institutes of Health. RFA-OD-11-002: Building Interdisciplinary Research Careers in Women’s Health (K12) [Internet]. 2011 [cited Jul 28, 2016]. (http://grants.nih.gov/grants/guide/rfa-files/RFA-OD-11-002.html)Google Scholar
19. National Institutes of Health. NIH guide: Building Interdisciplinary Research Careers in Women’s Health [Internet]. 1999 [cited Jul 29, 2016]. (https://grants2.nih.gov/grants/guide/rfa-files/RFA-OD-99-008.html)Google Scholar
20. U.S. Department of Health and Human Services, Public Health Service, National Institutes of Health. Career issues for women scientists. In: Agenda for Research on Women’s Health for the 21st Century, A Report of the Task Force on the NIH Women’s Health Research Agenda for the 21st Century, Volume 2, NIH Publication No. 99-4386. Bethesda, MD: National Institutes of Health, 1999, pp. 187198.Google Scholar
21. U.S. Department of Health and Human Services, Public Health Service, National Institutes of Health. Multidisciplinary perspectives. In: Agenda for Research on Women’s Health for the 21st Century, A Report of the Task Force on the NIH Women’s Health Research Agenda for the 21st Century, Volume 2, NIH Publication No. 99-4386. Bethesda, MD: National Institutes of Health, 1999, pp. 223228.Google Scholar
22. Pinn, VW, Blehar, MC. Interdisciplinary women’s health research and career development. In: Rayburn WF, Schulkin J, eds. Changing Landscape of Academic Women’s Health. New York, NY: Springer, 2011, pp. 5376.Google Scholar
23. Nagel, J, et al. Building the women’s health research workforce: fostering interdisciplinary research approaches in women’s health. Global Advances in Health and Medicine 2013; 2: 2429.Google Scholar
24. Lutters, W, Winter, SJ. Virtual organizations. In: Bainbridge W, ed. Leadership in Science and Technology: A Reference Handbook. Thousand Oaks, CA: Sage Publications, 2012, pp. 334341.Google Scholar
25. Borner, K, et al. A multi-level systems perspective for the science of team science. Science Translational Medicine 2010; 2: 49cm24.Google Scholar
26. Biancani, S, McFarland, DA, Dahlander, L. The semiformal organization. Organization Science 2014; 25: 13061324.Google Scholar
27. Wenger, E. Communities of Practice: Learning, Meaning, and Identity. Cambridge, UK: Cambridge University Press, 1998.Google Scholar
28. Winter, SJ, Berente, N. A commentary on the pluralistic goals, logics of action, and institutional contexts of translational team science. Translational Behavioral Medicine 2012; 2: 441445.Google Scholar
29. Guise, JM, Nagel, JD, Regensteiner, JG. Best practices and pearls in interdisciplinary mentoring from Building Interdisciplinary Research Careers in Women’s Health Directors. Journal of Women’s Health 2012; 21: 11141127.Google Scholar
30. Winter, SJ, Butler, B. Creating bigger problems: grand challenges as boundary objects and the legitimacy of the Information Systems field. Journal of Information Technology 2011; 26: 99108.Google Scholar
31. Cummings, JN, Kiesler, S. Coordination costs and project outcomes in multi-university collaborations. Research Policy 2007; 36: 16201634.Google Scholar
32. Guise, JM, et al. Building Interdisciplinary Research Careers in Women’s Health Program Leadership. Team mentoring for interdisciplinary team science: lessons from K12 scholars and directors. Academic Medicine 2016.Google Scholar
33. Bedwell, WL, Fiore, SM, Salas, E. Developing the future workforce: an approach for integrating interpersonal skills into the MBA classroom. Academy of Management Learning & Education 2014; 13: 171186.Google Scholar
34. Stokols, D. Training the next generation of transdisciplinarians. In: O’Rourke MO, Crowley MO, Eigenbrode SD, et al. eds. Enhancing Communication & Collaboration in Interdisciplinary Research. Los Angeles, CA: Sage Publications, 2014, pp. 5681.Google Scholar
35. National Cancer Institute. UNC School of Medicine Tenure and Promotion Policy. Team Science Toolkit [Internet]. 2009 [cited Jul 26, 2016]. (http://www.teamsciencetoolkit.cancer.gov/public/TSResourceTool.aspx?tid=1&rid=1521)Google Scholar
36. Asencio, R, et al. Charting a course for collaboration: a multiteam perspective. Translational Behavioral Medicine 2012; 4: 487494.Google Scholar
Figure 0

Fig. 1 Organizational structure of the Building Interdisciplinary Research Careers in Women’s Health (BIRCWH) according to the Science of Team Science (SciTS) multi-level framework. NIH, National Institutes of Health.

Figure 1

Table 1 Multi-level mixed method analysis of strategies that promote collaborative team science

Figure 2

Table 2 Building Interdisciplinary Research Careers in Women’s Health (BIRCWH) meeting types and purposes