Hostname: page-component-848d4c4894-hfldf Total loading time: 0 Render date: 2024-05-31T03:19:39.337Z Has data issue: false hasContentIssue false
  • English
  • Français

Altmetric score, reads, and citations in paediatric cardiology: do they correlate and what do they mean?

Published online by Cambridge University Press:  20 June 2022

Rohit S. Loomba Open the ORCID record for Rohit S. Loomba [Opens in a new window] ,
Enrique G. Villarreal Open the ORCID record for Enrique G. Villarreal [Opens in a new window] ,
Riddhi D. Patel ,
Daniela Santos-Cantu ,
Cordelia Alanis-Garza ,
Saul Flores Open the ORCID record for Saul Flores [Opens in a new window] ,
Juan S. Farias Open the ORCID record for Juan S. Farias [Opens in a new window]  and
Jeffrey P. Jacobs
Rohit S. Loomba
Affiliation:
Division of Cardiology, Advocate Children’s Hospital, Oak Lawn, Illinois, USA Department of Pediatrics, Chicago Medical School/Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
Enrique G. Villarreal*
Affiliation:
Tecnologico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Nuevo Leon, Mexico
Riddhi D. Patel
Affiliation:
Division of Cardiology, Advocate Children’s Hospital, Oak Lawn, Illinois, USA
Daniela Santos-Cantu
Affiliation:
Tecnologico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Nuevo Leon, Mexico
Cordelia Alanis-Garza
Affiliation:
Tecnologico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Nuevo Leon, Mexico
Saul Flores
Affiliation:
Section of Critical Care Medicine and Cardiology, Texas Children’s Hospital, Houston, Texas, USA Department of Pediatrics, Baylor College of Medicine, Houston, Texas, USA
Juan S. Farias
Affiliation:
Tecnologico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Nuevo Leon, Mexico
Jeffrey P. Jacobs
Affiliation:
Congenital Heart Center, Division of Cardiovascular Surgery, Departments of Surgery and Pediatrics, University of Florida, Gainesville, Florida, USA
*
Author for correspondence: Enrique G. Villarreal, MD Tecnologico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Nuevo Leon, Mexico. Tel: (811) 324-4817; Fax: (81) 8303-1880. E-mail: quique_villarreal93@hotmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

Introduction:

The primary objective of this study was to determine whether Altmetric score, number of reads, and citations for paediatric cardiology manuscripts correlate with one another. A secondary objective was to determine the extent to which factors mediated citation number for paediatric cardiology manuscripts.

Methods:

Data for this study came from manuscripts published in Cardiology in the Young (2010–2021). Data were extracted by using data shared on the journal website. Spearman’s correlation analyses were conducted between manuscript reads, citations, and Altmetric score. Regression analyses were conducted with number of citations as the dependent variable and year of publication, publication type, number of reads, and Altmetric score as independent variables.

Results:

A total of 2642 manuscripts were included in the final analyses. Reads and citations had poor correlation (r-value 0.32); reads and Altmetric score had negligible correlation (r-value 0.26); and Altmetric score and citations had negligible correlation (r-value 0.07). Year of publication was independently associated with number of citations (β –0.95, p-value <0.01). Manuscript type was independently associated with number of citations (β 1.04, p-value <0.01). Number of reads was independently associated with citations (β 0.01, p-value <0.01). Altmetric score was independently associated with number of citations (β 0.05, p-value <0.01).

Conclusion:

This study describes the correlation of reads, citations, and Altmetric score in manuscripts published in Cardiology in the Young, demonstrating poor correlation, at best, between these metrics. Each bibliometric index seems to represent a different phenomenon of manuscript consumption. No single bibliometric index in isolation offers ample representation of manuscript consumption.

Keywords

paediatric cardiologyacademic promotioncitationAltmetric score
Type
Original Article
Information
Cardiology in the Young , Volume 33 , Issue 6 , June 2023 , pp. 872 - 877
Check for updates
Copyright
© The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Rice, DB, Raffoul, H, Ioannidis, JPA, Moher, D. Academic criteria for promotion and tenure in biomedical sciences faculties: cross sectional analysis of international sample of universities. BMJ 2020; 369: m2081.CrossRefGoogle ScholarPubMed
Loomba, RS, Anderson, RH. Are we allowing impact factor to have too much impact: the need to reassess the process of academic advancement in pediatric cardiology? Congenit Heart Dis 2018; 13: 163–166.CrossRefGoogle ScholarPubMed
Leff, AR. Impact factor and its role in academic promotion. Proc Am Thoracic Soc 2009; 6: 337–337.CrossRefGoogle ScholarPubMed
Loomba, RS, Sheikholeslami, D, Dyson, A, et al. Publishing patterns and citation performance of manuscripts relating to paediatric cardiology and congenital heart disease: comparison of paediatric and adult cardiology journals. Cardiol Young 2021; 31: 1608–1612.CrossRefGoogle ScholarPubMed
Hill, KD, Jenkins, KJ. How should we measure research impact in paediatric cardiology? Cardiol Young 2021; 31: 1205–1206.CrossRefGoogle ScholarPubMed
Seglen, PO. Citation rates and journal impact factors are not suitable for evaluation of research. Acta Orthopaedica Scand 1998; 69: 224–229.CrossRefGoogle Scholar
Nieminen, P, Carpenter, J, Rucker, G, Schumacher, M. The relationship between quality of research and citation frequency. BMC Med Res Method 2006; 6: 42.CrossRefGoogle ScholarPubMed
Mackinnon, S, Drozdowska, BA, Hamilton, M, Noel-Storr, AH, McShane, R, Quinn, T. Are methodological quality and completeness of reporting associated with citation-based measures of publication impact? A secondary analysis of a systematic review of dementia biomarker studies. BMJ Open 2018; 8: e020331.CrossRefGoogle ScholarPubMed
Patel, RB, Vaduganathan, M, Bhatt, DL, Bonow, RO. Characterizing high-performing articles by altmetric score in major cardiovascular journals. JAMA Cardiol 2018; 3: 1249–1251.CrossRefGoogle ScholarPubMed
Callaham, M. Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA 2002; 287: 2847.CrossRefGoogle ScholarPubMed
Araujo, AC, Vanin, AA, Nascimento, DP, Gonzalez, GZ, Costa, LOP. What are the variables associated with altmetric scores? Syst Rev 2021; 10: 193.CrossRefGoogle ScholarPubMed
Ruan, QZ, Chen, AD, Cohen, JB, Singhal, D, Lin, SJ, Lee, BT. Alternative metrics of scholarly output: the relationship among altmetric score, mendeley reader score, citations, and downloads in plastic and reconstructive surgery. Plast Reconstr Surg 2018; 141: 801–809.CrossRefGoogle ScholarPubMed
Mullins, CH, Boyd, CJ, Corey, BL. Examining the correlation between altmetric score and citations in the general surgery literature. J Surg Res 2020; 248: 159–164.CrossRefGoogle ScholarPubMed
Collins, CS, Singh, NP, Ananthasekar, S, Boyd, CJ, Brabston, E, King, TW. The Correlation between altmetric score and traditional bibliometrics in orthopaedic literature. J Surg Res 2021; 268: 705–711.CrossRefGoogle ScholarPubMed
Floyd, AR, Wiley, ZC, Boyd, CJ, Roth, CG. Examining the relationship between altmetric score and traditional bibliometrics in the pathology literature. J Pathol Inform 2021; 12: 8.CrossRefGoogle ScholarPubMed
Nip, I, Feng, H. Examining correlation of altmetric score and citation number in dermatology journal articles. J Dermatolog Treat 2020; 33:297–299.CrossRefGoogle ScholarPubMed
Warren, VT, Patel, B, Boyd, CJ. Determining the relationship between altmetric score and literature citations in the oral and maxillofacial surgery literature. J Oral Maxillofac Surg 2020; 78: 1460.e1461–1460.e1467.CrossRefGoogle Scholar
Rong, LQ, Lopes, AJ, Hameed, I, Gaudino, M, Charlson, ME. Examining the correlation between Altmetric score and citation count in the anaesthesiology literature. Br J Anaesth 2020; 125: e223–e226.CrossRefGoogle ScholarPubMed
Schober, P, Boer, C, Schwarte, LA. Correlation coefficients: appropriate use and interpretation. Anesth Analg 2018; 126: 1763–1768.CrossRefGoogle ScholarPubMed
Aksnes, DW, Langfeldt, L, Wouters, P. Citations, citation indicators, and research quality: an overview of basic concepts and theories. SAGE Open 2019; 9: 215824401982957.CrossRefGoogle Scholar
Ladeiras-Lopes, R, Clarke, S, Vidal-Perez, R, et al. Twitter promotion predicts citation rates of cardiovascular articles: a preliminary analysis from the ESC Journals Randomized Study. Eur Heart J 2020; 41: 3222–3225.CrossRefGoogle ScholarPubMed
Hong, JH, Yoon, DY, Lim, KJ, et al. Characteristics of the most cited, most downloaded, and most mentioned articles in general medical journals: a comparative bibliometric analysis. Healthcare 2020; 8: 492.CrossRefGoogle ScholarPubMed
Epstein, RJ. Journal impact factors do not equitably reflect academic staff performance in different medical subspecialties. J Investig Med 2004; 52: 531–536.CrossRefGoogle Scholar
Barakat, AF, Nimri, N, Shokr, M, et al. Correlation of altmetric attention score with article citations in cardiovascular research. J Am Coll Cardiol 2018; 72: 952–953.CrossRefGoogle ScholarPubMed
Fox, CS, Bonaca, MA, Ryan, JJ, Massaro, JM, Barry, K, Loscalzo, J. A randomized trial of social media from Circulation. Circulation 2015; 131: 28–33.CrossRefGoogle ScholarPubMed
Hanney, SR, Home, PD, Frame, I, Grant, J, Green, P, Buxton, MJ. Identifying the impact of diabetes research. Diabet Med 2006; 23: 176–184.CrossRefGoogle ScholarPubMed
Grant, J. Evaluating ‘payback’ on biomedical research from papers cited in clinical guidelines: applied bibliometric study. BMJ 2000; 320: 1107–1111.CrossRefGoogle ScholarPubMed
Lewison, G, Sullivan, R. The impact of cancer research: how publications influence UK cancer clinical guidelines. Br J Cancer 2008; 98: 1944–1950.CrossRefGoogle ScholarPubMed
Waltman, L, van Eck, NJ. The inconsistency of the h-index. J Am Soc for Inf Sci Technol 2012; 63: 406–415.CrossRefGoogle Scholar
Chen, WMY, Bukhari, M, Cockshull, F, Galloway, J. The relationship between citations, downloads and alternative metrics in rheumatology publications: a bibliometric study. Rheumatol 2019; 59: 277–280.CrossRefGoogle Scholar
Coats, AJ. Top of the charts: download versus citations in the International Journal of Cardiology. Int J Cardiol 2005; 105: 123–125.CrossRefGoogle ScholarPubMed
Giustini, AJ, Axelrod, DM, Lucas, BP, Schroeder, AR. Association between citations, altmetrics, and article views in pediatric research. JAMA Network Open 2020; 3: e2010784.CrossRefGoogle ScholarPubMed
Kampman, JM, Hermanides, J, Boere, PRQ, Hollmann, MW. Appreciation of literature by the anaesthetist: a comparison of citations, downloads and altmetric attention score. Acta Anaesthesiologica Scand 2020; 64: 823–828.CrossRefGoogle ScholarPubMed