Hostname: page-component-76fb5796d-45l2p Total loading time: 0 Render date: 2024-04-29T10:19:12.268Z Has data issue: false hasContentIssue false

Dr. Google’s Advice on First Aid: Evaluation of the Search Engine’s Question-Answering System Responses to Queries Seeking Help in Health Emergencies

Published online by Cambridge University Press:  11 May 2023

Alexei A. Birkun*
Affiliation:
Department of General Surgery, Anesthesiology, Resuscitation and Emergency Medicine, Medical Academy named after S.I. Georgievsky of V.I. Vernadsky Crimean Federal University, Simferopol, 295051, Russian Federation
Adhish Gautam
Affiliation:
Regional Government Hospital, Una (H.P.), 174303, India
*
Correspondence: Alexei A. Birkun, MD, DMedSc Lenin Blvd, 5/7, Simferopol 295051, Russian Federation E-mail: birkunalexei@gmail.com

Abstract

Introduction:

The ever-growing penetration of internet and mobile technologies into society suggests that people will increasingly use web searches to seek health-related information, including advice on first aid in medical emergencies. When a bystander is incompetent in first aid and has no immediate support from Emergency Medical Services (EMS), as it happens in low-resource settings or in disasters, instructions found online could be the sole driver for administering first aid before arrival of professional help.

Study Objective:

The aim of this study was to evaluate quality of advice on first aid generated by a web search engine’s question-answering system (QAS) in response to search queries concerning provision of help in common health emergencies.

Methods:

In December 2022-January 2023, an English-language search was carried out in Google with ten queries based on the keyword combinations (what to do OR how to help) AND (bleeding OR chest pain OR choking OR not breathing OR seizure). The search engine’s QAS responses (up to 11 per search query) were evaluated for compliance with the International Federation of Red Cross First Aid Guidelines 2020 using the pre-developed checklists.

Results:

Out of 98 QAS items generated by Google, 67.3% (n = 66) were excluded, mainly because the QAS answers did not address original queries. Eligible unique QAS responses (n = 27) showed poor coverage of the guideline-compliant instructions on first aid. Mean percentage of QAS responses providing a first aid instruction with complete adherence to the guidelines varied from 0.0 for choking to 19.5 for seizure. Only three (11.1%) QAS responses contained an explicit instruction to access EMS, while 66.7% (n = 18) included directions either contradictory to the guidelines and potentially harmful (eg, use of home remedies in chest pain) or inapplicable for an untrained person (eg, use of tourniquet in bleeding).

Conclusion:

Although the search engine’s QAS responds to user’s inquiries concerning assistance in health emergencies, the QAS-generated answers, as a rule, omit potentially life-saving evidence-based instructions on first aid and oftentimes give advices noncompliant with current guidelines or inadequate for untrained people, and thus create risks for causing harm to a victim.

Type
Original Research
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of the World Association for Disaster and Emergency Medicine

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Statista. Number of internet and social media users world-wide as of July 2022. https://www.statista.com/statistics/617136/digital-population-worldwide/. Accessed March 9, 2023.Google Scholar
Chiu, YL, Tsai, CC, Liang, JC. Laypeople’s online health information search strategies and use for health-related problems: cross-sectional survey. J Med Internet Res. 2022;24(9):e29609.CrossRefGoogle ScholarPubMed
Eurostat. EU citizens: over half seek health information online. https://ec.europa.eu/eurostat/web/products-eurostat-news/-/edn-20220406-1/. Accessed March 9, 2023.Google Scholar
Duut, MS, Okyere, P, Zakariah, AN, Donkor, P, Mock, C. Factors influencing willingness to intervene as bystanders among adult residents living in crash-prone areas in the Ashanti region of Ghana. Afr J Emerg Med. 2022;12(4):315320.CrossRefGoogle ScholarPubMed
Huy, LD, Tung, PT, Nhu, LNQ, et al. The willingness to perform first aid among high school students and associated factors in Hue, Vietnam. PLoS One. 2022;17(7):e0271567.CrossRefGoogle ScholarPubMed
Sajjadi, NB, Ottwell, R, Shepard, S, et al. Assessing the United States’ most frequently asked questions about osteopathic medicine, osteopathic education, and osteopathic manipulative treatment. J Osteopath Med. 2022;122(5):219227.CrossRefGoogle ScholarPubMed
Dr, Scull A.. Google will see you now: Google’s health information previews and implications for consumer health. Med Ref Serv Q. 2020;39(2):165173.Google Scholar
Liu, KY, Haukoos, JS, Sasson, C. Availability and quality of cardiopulmonary resuscitation information for Spanish-speaking population on the Internet. Resuscitation. 2014;85(1):131137.CrossRefGoogle ScholarPubMed
Burgess, JD, Cameron, CM, Cuttle, L, Tyack, Z, Inaccurate, Kimble RM., inadequate, and inconsistent: a content analysis of burn first aid information online. Burns. 2016;42(8):16711677.CrossRefGoogle ScholarPubMed
Birkun, A, Gautam, A, Trunkwala, F, Böttiger, BW. Open online courses on basic life support: availability and resuscitation guidelines compliance. Am J Emerg Med. 2022;62:102107.CrossRefGoogle ScholarPubMed
Bickmore, TW, Trinh, H, Olafsson, S, et al. Patient and consumer safety risks when using conversational assistants for medical information: an observational study of Siri, Alexa, and Google Assistant. J Med Internet Res. 2018;20(9):e11510.CrossRefGoogle ScholarPubMed
Picard, C, Smith, KE, Picard, K, Can Alexa, Douma MJ., Cortana, Google Assistant, and Siri save your life? A mixed-methods analysis of virtual digital assistants and their responses to first aid and basic life support queries. BMJ Innovations. 2020;6(1).CrossRefGoogle Scholar
GrowByData. Google Featured Snippets: SEO Guide for 2022. https://getstat.com/blog/featured-snippets/. Accessed March 9, 2023.Google Scholar
The Wall Street Journal. Google Has Picked an Answer for You—Too Bad It’s Often Wrong. https://www.wsj.com/articles/googles-featured-answers-aim-to-distill-truthbut-often-get-it-wrong-1510847867. Accessed March 9, 2023.Google Scholar
Birkun, A, Gautam, A. Dataset of analysis of search engine’s question answering system responses to queries concerning first aid in common adult health emergencies. Mendeley Data. 2023.Google Scholar
International Federation of Red Cross and Red Crescent Societies. International first aid, resuscitation, and education guidelines 2020. https://www.ifrc.org/sites/default/files/2022-02/EN_GFARC_GUIDELINES_2020.pdf. Accessed March 9, 2023.Google Scholar
Statista. Number of internet and social media users world-wide as of January 2023. https://www.statista.com/statistics/617136/digital-population-worldwide/. Accessed March 9, 2023.Google Scholar
Statista. Number of smartphone subscriptions world-wide from 2016 to 2021, with forecasts from 2022 to 2027. https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/. Accessed March 9, 2023.Google Scholar
Statcounter. Search Engine Market Share World-Wide. https://gs.statcounter.com/search-engine-market-share/. Accessed March 9, 2023.Google Scholar
Metelmann, B, Metelmann, C, Schuffert, L, Hahnenkamp, K, Brinkrolf, P. Medical correctness and user friendliness of available apps for cardiopulmonary resuscitation: systematic search combined with guideline adherence and usability evaluation. JMIR Mhealth Uhealth. 2018;6(11):e190.CrossRefGoogle ScholarPubMed
Ferhatoglu, SY, Kudsioglu, T. Evaluation of the reliability, utility, and quality of the information in cardiopulmonary resuscitation videos shared on open access video sharing platform YouTube. Australas Emerg Care. 2020;23(3):211216.CrossRefGoogle Scholar