Hostname: page-component-848d4c4894-75dct Total loading time: 0 Render date: 2024-06-06T18:57:40.112Z Has data issue: false hasContentIssue false

174 Validating a Coding Tool for Translational Science Benefits Model (TSBM) Data: Delphi Methodology

Published online by Cambridge University Press:  03 April 2024

Nicole Miovsky
Affiliation:
University of California Irvine
Margaret Schneider
Affiliation:
University of California Irvine
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

OBJECTIVES/GOALS: To develop and validate a tool to systematically identify benefits accruing to research within the Translational Science Benefits Model (TSBM) framework. We used a Delphi panel to reach consensus among a group of experts on criteria required for a clinical, community, economic, or policy benefit to be verified as coming from research. METHODS/STUDY POPULATION: A coding tool with proposed criteria to verify each of the 30 benefits was created at UCI to confirm the TSBM benefits resulting from funded research. We convened 11 experts from 8 CTSA hubs, who consisted of evaluators (faculty and staff) with experience using the TSBM. A web-based survey was used for Round 1, followed by a panel discussion of remaining unvalidated criteria, and a Round 2 survey as the final decision for inclusion of items in the tool. Response options for each criterion were “yes, required” or “no, not required”. Criteria that reached consensus (>70% agreement) were considered validated for inclusion in the final version. Panelist suggested criteria in Round 1 were also incorporated in the Round 2 survey for consideration by the experts. RESULTS/ANTICIPATED RESULTS: In the web-based survey for Round 1, all 11 experts participated and 92% of criteria reached the determined consensus level (N = 157). The remaining 8% of the criteria (N = 13) were discussed during the panel meeting. The discussion, in which 8 experts participated, was moderated by UCI and took place virtually via Zoom. All experts were sent a recording of the discussion and given the opportunity to post comments online about the remaining criteria before, during, and for a day after the discussion. Round 2 will include 50 newly proposed criteria from panelists and the 13 criteria that did not reach consensus in Round 1. Based on the results of Round 2, the criteria that reach consensus will be included in the final version of the coding tool that can be used across all TSBM benefits. DISCUSSION/SIGNIFICANCE: Using the Delphi Methodology, we will have a standardized set of criteria that may be applied to determine whether a TSBM benefit has resulted from a specific research project or program. This standardization will allow for aggregation and comparison of data across CTSA hubs and further multi-level evaluation of impact.

Type
Evaluation
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (https://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
© The Author(s), 2024. The Association for Clinical and Translational Science