4 results
OP62 Let's Co-design A Tool To Assess Overweight And Obesity Health Apps
- Elisa Puigdomenech Puig, Noemí Robles, Corpus Gomez, Francesc Saigí-Rubió, Alberto Zamora, Montse Moharra, Guillem Paluzié, Mariona Balfegó, Guillem Cuatrecasas, Carme Carrion i Ribas
-
- Journal:
- International Journal of Technology Assessment in Health Care / Volume 35 / Issue S1 / 2019
- Published online by Cambridge University Press:
- 31 December 2019, p. 15
-
- Article
-
- You have access Access
- Export citation
-
Introduction
There are more than 320,000 accessible health apps, with the most downloaded of those related to physical exercise and weight control. However the initiatives for their validation address only partial aspects of the evaluation. The EVALAPPS project aims to develop an assessment tool for overweight and obesity management apps, based on the evaluation of efficacy, effectiveness and safety. In the present phase of the project, the team is co-creating the assessment tool considering both the evidence and the expertise of professionals (co-creation process).
MethodsProposed co-creation methodology includes: 1) a modified Delphi process for selecting the assessment criteria. Criteria were identified through a) an exhaustive review of the criteria used by several mHealth assessment tools and b) a systematic review of efficacy, safety and effectiveness criteria used in mHealth interventions that assess overweight and obesity management. 2) a co-creation session using “Design Thinking” techniques for defining the final content and appearance of the tool (November 2018).
ResultsTen dimensions and 133 criteria were identified, both in relation to the outputs (Usability, Clinical Effectiveness, Security, Development, etc.) and the outcomes (such as weight loss, number of steps). Of those, 114 were included in the modified Delphi, in which 31 professionals participated. A set of 63 criteria were selected as candidates for being part of the tool. Criteria mainly belonged to Security (22%) and Usability dimensions (14%), followed by Quality (11%), and outcomes related to Activity (11%) and Physical status (11%). Once the co-creation session has been performed, the final tool will be developed.
ConclusionsRelevant criteria to evaluate the efficacy and safety of mHealth interventions in the management of overweight and obesity have been identified. Once the tool is developed it will be user tested and piloted on users of overweight and obesity management apps.
OP138 Stakeholders’ Involvement When Developing A mHealth Assessment Tool
- Elisa Puigdomenech Puig, Elisa Poses Ferrer, Lina Masana, Mireia Espallargues
-
- Journal:
- International Journal of Technology Assessment in Health Care / Volume 35 / Issue S1 / 2019
- Published online by Cambridge University Press:
- 31 December 2019, pp. 31-32
-
- Article
-
- You have access Access
- Export citation
-
Introduction
Due to the specific characteristics and challenges of mobile health (mHealth) technologies there is a need to have assessment tools based on their particularities to be used by health technology assessment (HTA) agencies and evaluation experts. In the development of a comprehensive and practical evaluation tool for the evaluation of mHealth solutions we aimed to include the views and opinions of key stakeholders: health professionals, developers, hospital managers, HTA agencies, patients and general public.
MethodsFocus groups and an online modification of the Delphi technique are being used to discuss and agree on domains and criteria to be included in the mHealth assessment tool. Domains and criteria used for health apps evaluation were drawn from a literature review on the topic. The initial list includes 95 criteria grouped into the following domains: purpose of the app, privacy and security, clinical effectiveness, content of the intervention, user experience and usability, interoperability, expenses, impact on the organization, and legal and ethical aspects. Data coming from focus groups is currently being analyzed from a thematic and content analysis perspective.
ResultsFocus groups with professionals have showed that the most important domains to be considered when evaluating health apps are those related with security, user experience, and clinical effectiveness. Some criteria were considered to be mandatory (mainly regarding safety issues), on which a first step assessment should indicate whether the app ‘pass or fails’ for the subsequent throughout assessment. Focus groups with patients will provide insight on critical aspects related to the choice, use and adherence to a health app.
ConclusionsInsights from main stakeholders on the design of the tool for mHealth assessment are relevant and complementary between them. Next steps include (i) the agreement of criteria by using an online modification of the Delphi Technique and (ii) piloting of the tool.
PP136 Smartphone Intervention To Promote Healthy Lifestyles Among Teenagers
- Elisa Puigdomenech Puig, Santiago Gómez, Conxa Castell, Mireia Espallargues, Toni Dedeu
-
- Journal:
- International Journal of Technology Assessment in Health Care / Volume 34 / Issue S1 / 2018
- Published online by Cambridge University Press:
- 03 January 2019, pp. 119-120
-
- Article
-
- You have access Access
- Export citation
-
Introduction:
We aimed to pilot the evaluation of the PEGASO system, a smartphone-based intervention (apps/wearables/game) to improve lifestyles and increase awareness.
Methods:We conducted a before-after quasi-experimental pilot controlled study. Teenagers aged 13–16 in a 2:1 (intervention: comparative group [IG:CG]) basis from Spain, Italy and the United Kingdom were recruited. The IG had access to the apps and game for six months, and to smart sensors for the last two months. Schools were recruited by convenience sampling. Participants in both groups undertook (i) anthropometric measurements, (ii) diet (KIDMED), physical activity (PAQ-A) and sleep (HELENA study) validated questionnaires, and (iii) ad-hoc lifestyles knowledge questionnaire. PEGASO, if used, continuously recorded diet and physical activity. User experience was assessed through focus groups.
Results:Five hundred and fifty-eight participants were included (IG:365 / CG:193). The mean (standard deviation; SD) age was 14.8 (0.8), and 52.3 percent were girls. At baseline, mean scores (SD) of KIDMED, PAQ-A and weekday and weekend sleep hours were 5.60 (2.41), 2.48 (0.66), 8.34 (1.07) and 9.99 (1.66), respectively. The percentage of correct answers of lifestyle's knowledge was 65.2 percent (range 13–100 percent). The IG and CG did not show differences for main outcome variables. At six months, a higher percentage of participants in the IG reported an increase of at least one point in the adherence to Mediterranean Diet (43.8 percent vs. 35.4). No differences were observed for other lifestyles. Focus group results showed a predisposition of adolescents to use mHealth for health promotion; the platform was considered to be useful and complete and personalized suggestions were positively valued. Participants reported few limited interest ion the game and several technical issues.
Conclusions:Although participants were motivated and excited about their involvement in the study, and that PEGASO was something desirable for them, the system only showed some impact in specific areas – namely, diet – and could improve some its technological features. Several challenges and opportunities are associated with the implementation of mHealth.
VP89 Assessing mHealth: Proposal Of A New Framework
- Elisa Puigdomenech Puig, Santiago Gómez, Carme Carrión, Cari Almazan, Mireia Espallargues
-
- Journal:
- International Journal of Technology Assessment in Health Care / Volume 33 / Issue S1 / 2017
- Published online by Cambridge University Press:
- 12 January 2018, p. 190
-
- Article
-
- You have access Access
- Export citation
-
INTRODUCTION:
The use of health apps is rapidly increasing. They intend to promote health or to treat diseases; in some cases, substituting medical duties. No specific frameworks to assess mHealth solutions in a broad scope and in a comprehensive way have been identified. We aim to propose a framework for mHealth assessment.
METHODS:The framework development was based on:
• Literature review to identify existing assessment models including the evaluation of health effects
• Exploratory analysis with experts and user group discussions
• Definition of the assessment model, following the domains of health technology assessment.
RESULTS:Existing frameworks are mainly focused on certification criteria. Professionals and users agreed on the need to undertake mHealth assessments as to better inform user decisions. Assessments should be sensible to continuous changes of these technologies and be undertaken by independent organizations.
The proposed framework offers a step-by-step process by which any mHealth solution can be categorized and analyzed, according to: (i) Risk classification matrix: combining intervention type and patient type, (ii) Users: patients, professionals, informal caregivers individually or all of these together and (iii) Integration: stand-alone, fully integrated.
The model has four evaluation domains: technical maturity, risks, benefits and resources needed, including the commonly accepted evaluation perspectives: technical, contents, clinical/health, user perspective, organizational and socio-economic. Sub-domains are defined as: end-user, organization, healthcare system and community (society as a whole). Aspects to be assessed are selected according to the purpose of the evaluation (intended use / intended impact) and vary depending on the type of the mHealth solution: product or service.
CONCLUSIONS:The mHealth assessment process is needed and should be: (i) continuous/iterative, providing timely conclusions and recommendations for improvement, (ii) inclusive/collaborative, involving all stakeholders,and (iii) constantly adapting to standards. The proposed framework is intended to support informed decisions when developing, integrating, selecting, recommending, or adopting mHealth solutions.