Introduction
Much effort is made to create and evaluate new solutions for delivering health care using digital health technologies. Such technologies range from websites and mobile applications to remote monitoring and rehabilitation, and are evolving continuously to reflect the latest technological advances, such as virtual and augmented reality, robotics, sensors and advances based on artificial intelligence (AI). Research shows that digital health technologies hold potential for improvements in the scope and sustainability of health-care services’ provision, ensuring quality services and acceptable individual outcomes (Schulz et al., Reference Schulz, Wahl, Matthews, De Vito Dabbs, Beach and Czaja2015; Czaja, Reference Czaja2017; Chen, Reference Chen2020; Corregidor-Sánchez et al., Reference Corregidor-Sánchez, Segura-Fragoso, Rodríguez-Hernández, Jiménez-Rojas, Polonio-López and Criado-Álvarez2020). However, scholars frequently point out that although the gains of digital technologies for delivering health-care services exist, they benefit only certain groups of people and in specific contexts (Mitchell et al., Reference Mitchell, Chebli, Ruggiero and Muramatsu2018; Eccles, Reference Eccles2021).
It is widely expected that digital health technologies will be progressively used for delivering health-care services, and that older people, as the main users of health-care services in general (Terraneo, Reference Terraneo2015), and as a key target for health-care provision by digital health technologies, are among those most affected (European Commission, 2018; Ekman et al., Reference Ekman, Thulesius, Wilkens, Lindgren, Cronberg and Arvidsson2019; Mitchell and Kan, Reference Mitchell and Kan2019; Coughlin, Reference Coughlin2020).
With digital technologies becoming the favoured means for access to services, including health care, older people who make no or little use of digital technologies could suffer by exclusion from services and information they need or value (Olsson et al., Reference Olsson, Samuelsson and Viscovi2019; Eccles, Reference Eccles2021; Poli et al., Reference Poli, Kostakis, Barbabella, Walsh, Scharf, Van Regenmortel and Wanka2021). Consequently, the digitalisation of health-care services in combination with the non-use of digital technologies can increase risks of social exclusion and widen inequalities among older people (Robinson et al., Reference Robinson, Cotten, Ono, Quan-Haase, Mesch, Chen, Schulz, Hale and Stern2015; Hargittai et al., Reference Hargittai, Piper and Morris2019). This is exacerbated during the COVID-19 pandemic. Due to social and physical distancing, digitalisation of services becomes a priority measure (Pérez Sust et al., Reference Pérez Sust, Solans, Fajardo, Medina Peralta, Rodenas, Gabaldà, Garcia Eroles, Comella, Velasco Muñoz, Sallent Ribes, Roma Monfa and Piera-Jimenez2020; Seifert, Reference Seifert2020).
Previous studies suggest that the use of digital technologies among older people varies by individual characteristics such as age, gender, education and work, and prior experience with such technologies (e.g. at work) (König et al., Reference König, Seifert and Doh2018; Yoon et al., Reference Yoon, Jang, Vaughan and Garcia2018; Hargittai et al., Reference Hargittai, Piper and Morris2019; Matthews et al., Reference Matthews, Nazroo and Marshall2019). Non-use can also result from an individual decision not to engage with digital technologies or to use certain technologies but not others (Wyatt, Reference Wyatt, Oudshoorn and Pinch2003; Lüders and Brandtzæg, Reference Lüders and Brandtzæg2014; Gallistl et al., Reference Gallistl, Rohner, Seifert and Wanka2020), privacy concerns (Boise et al., Reference Boise, Wild, Mattek, Ruhl, Dodge and Kaye2013; Berridge and Wetle, Reference Berridge and Wetle2019; Kim and Choi, Reference Kim and Choi2019) as well as poor health status (Gell et al., Reference Gell, Rosenberg, Demiris, LaCroix and Patel2015; Matthews et al., Reference Matthews, Nazroo and Marshall2019). Moreover, digital technology use and non-use can be influenced by the design of new technological solutions which may support or hinder adoption by older people (Czaja et al., Reference Czaja, Boot, Charness and Rogers2019; Allemann and Poli, Reference Allemann and Poli2020). However, the design is not the only factor determining the inclusivity of digital technologies and new digital-based services. Aspects related to the evaluation of new digital technologies, such as how this is conducted and who is involved as participants, are also crucial for ensuring accessibility, usage and utility (Merkel and Kucharski, Reference Merkel and Kucharski2018; Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019).
Due to selective participation in the evaluations of new digital technologies, digital health research often fails to capture the heterogeneity of the target populations of interest (Czaja, Reference Czaja2017; Merkel and Kucharski, Reference Merkel and Kucharski2018). Selective participation is established during the recruitment process of study participants through three successive selection processes, namely pre-screening, recruitment and self-selection. As a result, some individuals have a higher probability of participating in evaluations than others (Dodge et al., Reference Dodge, Katsumata, Zhu, Mattek, Bowman, Gregor, Wild and Kaye2014; Foster et al., Reference Foster, Horspool, Edwards, Thomas, Salisbury, Montgomery and O'Cathain2015; Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019, Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). The underrepresentation of some individuals can affect the evaluations as it prevents the assessment of the appropriateness of new digital health technologies against the heterogeneity of the target population, and leads to erroneous conclusions and inadequate implementation (Aner, Reference Aner2016; Czaja, Reference Czaja2017; Kandola et al., Reference Kandola, Banner, Araki, Bates, Hadi and Lear2018; Merkel and Kucharski, Reference Merkel and Kucharski2018).
The process of self-selection refers to the decision to, or not to, accept an invitation to participate in research, made by those individuals who are deemed eligible for participation (Baron et al., Reference Baron, Hirani and Newman2015; Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019). Of the other selection processes occurring during the recruitment of participants, self-selection is especially relevant as it typically implies that a number of individuals are left out. Previous studies reported that refusal rates can range from 50 per cent to more than 80 per cent (Dodge et al., Reference Dodge, Katsumata, Zhu, Mattek, Bowman, Gregor, Wild and Kaye2014; Foster et al., Reference Foster, Horspool, Edwards, Thomas, Salisbury, Montgomery and O'Cathain2015; Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016; Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). Self-selection shapes the composition of the study participants, is almost not possible to directly control and determines the extent to which a study sample mirrors the targeted population of interest.
Only a small number of studies on digital health technologies have investigated self-selection among older people. They suggest that those who decline to participate are older, less physically active and less often users of a computer than those who join (Mair et al., Reference Mair, Goldstein, Shiels, Roberts, Angus, O'Connor, Haycox and Capewell2006; Dodge et al., Reference Dodge, Katsumata, Zhu, Mattek, Bowman, Gregor, Wild and Kaye2014; Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016; Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). Findings on health status are mixed. One study reports a higher hospital admission rate among decliners (Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016), whereas significant differences in health status were not found in another study (Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). Results on gender are also inconclusive, with some studies suggesting that women are more likely to decline the invitation to participate in research on digital health technologies (Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016) while other studies find no differences between men and women (Mair et al., Reference Mair, Goldstein, Shiels, Roberts, Angus, O'Connor, Haycox and Capewell2006; Dodge et al., Reference Dodge, Katsumata, Zhu, Mattek, Bowman, Gregor, Wild and Kaye2014; Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). Lack of time, discomfort with technologies and satisfaction with current services are reported as the most common reasons for declining (Mair et al., Reference Mair, Goldstein, Shiels, Roberts, Angus, O'Connor, Haycox and Capewell2006; Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016; Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019). Overall, these studies are typically based on recruitment information only (e.g. reasons for refusal, registry-based or hospital data), or investigate self-selection as an one-off selection process rather than as part of a sequence of selection processes in the study participant recruitment.
A deeper understanding of the self-selection process among older people in digital health research is needed to inform on the inclusiveness of such studies and the generalisability of the results, and to guide both the optimisation of recruitment strategies and the implementation of sample or result adjustments (Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019). To the best of our knowledge, no studies have conducted a detailed investigation of self-selection among older people which takes into account the individual perspective on participation and non-participation and, at the same time, interprets self-selection as part of a multi-step model of selection leading to selective participation (Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019).
In this article, we aim to understand the involvement of older people in the evaluation of digital health technologies for self-care as a multi-step process from project recruitment to the individuals’ decisions to participate (i.e. self-selection) and its association with socio-demographic indicators, health, social participation and technology familiarity. Our example is participation in the evaluation of a Web-based mobile phone system for monitoring post-operative progress of patients undergoing day surgery. The underlying data were collected in Sweden which is one of the most digitally advanced countries in Europe (European Commission, 2020) and, hence, an exemplifying case of likely future conditions in other European societies. In 2019, 98 per cent of the population in Sweden indicated having access to the internet at home; 10 per cent of Swedes between 65 and 74 years and a third of the individuals in the 75–85 years group reported that they had never used the internet (Statista, 2021). First, we analyse the selection of participants by applying a multi-step conceptual model for the study of selective participation which deconstructs the latter in all its processes of selection as elaborated and detailed by Poli et al. (Reference Poli, Kelfve and Motel-Klingebiel2019). Second, we deepen the analysis of the self-selection to interpret the basis of the individual decision to participate or not. We hypothesise that higher age, low socio-economic status, poor health, low frequency of social participation as well as lower digital skills are associated with the likelihood of declining an invitation to participate in the evaluation.
Methods
Analysed data were gathered in 2018 within the context of the project ‘Mobile Phone in Recovery after Ambulatory Surgery’ (MIRAS) which evaluated a web-based mobile phone system for monitoring post-operative progress of individuals who underwent day surgery.
The MIRAS intervention study was designed as a randomised controlled trial (RCT). Eligible individuals were consecutively included and randomised either to post-operative monitoring through their mobile phone (i.e. the intervention group) or to traditional post-operative monitoring at the day surgery unit (i.e. the control group). Individuals in the intervention group were invited to answer short questions on their recovery progress online using their mobile phones on days 1–14, 21 and 28. The collected information was stored in a highly secured, password-protected database which was accessible only to the patient and the responsible health-care professional. Individuals in the control group were monitored according to the surgery units’ routines. Both individuals in the intervention and control groups were asked to answer a paper-based questionnaire on the day of the surgery and received a further paper-based questionnaire assessing key aspects of their recovery on the postoperative day 28. The allocation to intervention group or control group and the related types of interventions were not relevant to this work and its analyses, as the interest is on the MIRAS participants in general, regardless of the study groups to which they belong, and on the non-participants.
MIRAS recruitment was conducted at two Swedish public day surgery units in the cities of Linköping and Motala. The MIRAS target population consisted of individuals undergoing day surgery in the fields of orthopaedics, general surgery including breast cancer, and urology. To be eligible to take part in the MIRAS project, individuals had to meet the following criteria: (a) have a mobile phone equipped with internet connection, (b) be able to speak Swedish, (c) not show/report other health problems which could interfere with the intervention (e.g. aphasia, dementia), and (d) be older than 18. The MIRAS project received ethical approval from the competent Regional Ethical Review Board in Linköping.
In addition to the intervention study, an investigation of the involvement of older people in the evaluation of the MIRAS mobile phone system was conducted, also by means of a survey study (Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019). MIRAS intervention outcomes were not of interest for this work which looked at the phases that precede the intervention, i.e. the selection of participants.
Data
The sample for the present study consists of all individuals, 60 years and older, who were scheduled for the above-mentioned day surgeries in the two units during the recruitment time-frame of the MIRAS project. As such, this sample includes both those individuals who entered the MIRAS recruitment process and those who did not due to non-eligibility.
This study sample consists of 498 individuals in total. The mean age of the individuals in the sample is 70 years (standard deviation (SD) = 0.32); the median age is also 70 years, where about a quarter of the individuals are aged 60–64 and 65–69 years (N = 120 and N = 119, respectively). Of the 498 individuals, one-third are men (N = 168) and two-thirds are women (N = 330) (Table 1).
Recruitment groups and characteristics
Note: SD: standard deviation.
Significance levels: ** p ⩽ 0.01, *** p ⩽ 0.001.
Information on the study sample was obtained from two sources: recruitment data and individual survey data. Recruitment data include information on age, gender and recruitment status for all the individuals in the study sample (N = 498), and detailed information on reasons for non-recruitment for the 58 individuals who were not recruited.
Individuals considered eligible and, thus, invited to participate in the MIRAS project, were also invited to answer a short questionnaire that included questions on socio-demographic factors, social participation and contacts, as well as health-related aspects and technology familiarity (more details on the survey, its items and validation can be found in Poli et al. (Reference Poli, Kelfve and Motel-Klingebiel2019). This sub-group consists of 368 individuals, of whom 160 participated in MIRAS and 208 were decliners. The survey was distributed by a research nurse at the time of the invitation to the MIRAS project on the day of surgery and collected on the same day. In total, 210 individuals answered the questionnaire (response rate = 57%), including all MIRAS participants (response rate = 100%) and 50 MIRAS decliners (response rate = 24%).
The self-selection analysis
In this study, the individual decision-making process of accepting or declining the invitation to take part in the research (i.e. self-selection) was examined as a selection process occurring during the recruitment of study participants that distinguished between decliners (i.e. non-participants) and participants. First, the overall selection of participants was studied as a multi-step process (Poli et al., Reference Poli, Kelfve and Motel-Klingebiel2019, Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020) and, second, self-selection was specifically analysed for its association with key indicators.
We used the multi-step conceptual model of selective non-participation illustrated in Poli et al. (Reference Poli, Kelfve and Motel-Klingebiel2019) which here includes three processes of selection, namely pre-screening, recruitment and self-selection. In pre-screening, some individuals are screened out prior to any formal eligibility check and for no documented reasons. In the recruitment, proper screening and eligibility checks are conducted and result in eligible and ineligible individuals. In self-selection, individuals choose whether they want to be included or not. Self-selection together with pre-screening and recruitment lead to a four-group structure: a non-screened group (which was excluded prior to screening), a non-recruited group (which was screened, but not recruited), a decliner group (which was screened and recruited but declined to participate) and a participant group, which consists of those who were screened and recruited and who decided to participate. In the study sample, the participant group represented 32 per cent (N = 160) (Table 1). Over 40 per cent (N = 208) of the individuals declined to participate, 12 per cent (N = 58) were not recruited due to ineligibility and 14 per cent (N = 72) were excluded prior to being screened (i.e. non-screened group). The refusal rate (i.e. the decliners as a percentage of all individuals invited to participate) to the MIRAS project was 56 per cent (N = 208), the non-screened rate (i.e. the non-screened individuals as a percentage of all the individuals who underwent an eligible day surgery) was 14 per cent (N = 72) and the non-recruitment (i.e. the non-recruited individuals as a percentage of everyone who was screened) rate was 14 per cent (N = 58).
Outcome variables
Two main outcome variables were used: ‘recruitment group’ and ‘self-selection’.
The ‘recruitment group’ was constructed as a categorical variable which took on four categories corresponding to the four recruitment groups of which individuals could alternatively be part (i.e. non-screened, non-recruited, decliner and participant). The outcome variable ‘self-selection’ was constructed as a binary variable (i.e. refusal/participation).
Predictors
The level of education is measured by the International Standard Classification of Education, and the analyses apply two levels of education: ‘lower’ (i.e. up to 13 years of education) and ‘higher’ (i.e. more than 13 years of education). Occupational position is measured as: ‘white-collar jobs’ and ‘other positions’, while cases with missing information (N = 25) are included in a third category. Due to the low number of cases, we collapsed farmers, self-employed and blue-collar jobs into the category ‘other positions’. This allows a clear contrast to be created between the ‘white-collar jobs’ category and the rest. Partnership and co-habitation are combined in a single variable and coded as ‘having a partner and co-habiting’ and ‘other constellations’. Overall health, cognitive health and instrumental activities of daily living are combined in a single indicator ‘physical and cognitive health’: ‘better’ (based on ‘good’ or ‘very good’ overall health, ‘good’ or ‘very good’ cognitive health and ‘not limited at all’) and ‘poorer’ (all the other combinations).
Social participation, contacts with friends and neighbours, and contacts with children are aggregated in a single indicator, ‘social participation and contacts’, and coded as ‘higher frequency’ (‘every week’ or ‘daily’ participation in social activities and ‘daily’ contacts with either children or friends, or both) and ‘lower frequency’ (all other combinations).
Digital skills were defined in this work as the range of abilities and knowledge to use digital services and measured as self-rated skills in using and accessing digital services (i.e. sending and receiving emails, internet banking, reading online newspapers or magazines, buying goods or services over the internet, accessing public e-services). These form a single indicator and are coded as ‘higher’ (i.e. average answer was ‘very good’ in all the relevant items on digital skills) and ‘lower’ (i.e. for all the other combinations). The perceived usefulness of using technologies for health monitoring was defined as the degree to which an individual believes that using a certain digital health technology would be beneficial for him- or herself and was measured by a single item (i.e. ‘Do you think using a mobile phone or tablet might be useful in monitoring your health?’) as ‘high’ and ‘low’. Analyses control for age group and gender. Age is a categorical variable (60–64, 65–69, 70–74, and 75 years and over) to take into account non-linear relationships, while gender is applied as a binary category.
Missing information on any of these predictors is shown in Table 4, but is not computed in the group comparisons. Because missing values on each predictor represented a small percentage of the cases which are irrelevant for imputation, too small for a separate missing category, and typically considered as inconsequential for the results (Schafer, Reference Schafer1999; Bennett, Reference Bennett2001), missing information is merged into the largest variable category for the logistic regression analyses. The variable on occupational status is an exception as the item non-response is about 12 per cent and could not be assigned to another category of the variable; therefore, missing data were treated by creating a third category representing the missingness. This allowed the potential impact of missing data on the association between the predictor and the outcome to be isolates. There is no missing information for age group and gender.
Analyses
First, the overall selection of study participants is analysed based on the multi-step conceptual model for the study of selective non-participation as originally developed by Poli et al. (Reference Poli, Kelfve and Motel-Klingebiel2019) and extended with a further process of selection (i.e. pre-screening). Age and gender differences between the four groups: non-screened, non-recruited, decliner and participant, are tested using Pearson's chi-squared tests and one-way analysis of variance. Participation and non-participation rates are calculated for each of the four groups based on the respective sub-samples. This means that, for example, the refusal rate represents the proportion of those who declined to participate among all those invited. Moreover, a multinomial logistic regression was estimated to describe the differences between participants and non-participants (i.e. non-screened, non-recruited and decliner) regarding age and gender. Finally, the analyses of the reasons for non-recruitment were added to further explain the selection of individuals.
Second, the analysis of self-selection is deepened. Descriptive statistics are performed to show how socio-demographic indicators, health, social participation and technology familiarity characterise decliners and participants. Pearson's chi-squared tests and Student's t-test are used to test differences between decliners and participants. In addition, four logistic regression models were developed in order to investigate the association between the individual decision to decline (or not) the invitation to participate in the MIRAS project and the identified predictors. Model 1 includes three socio-demographic indicators (i.e. age, gender and main job). Thereafter, all dimensions (health, social participation and contacts, and digital skills), each of them represented by one single indicator, are included stepwise into the models. The reference category for all models is ‘participation’. All analyses are performed using Stata 15 (StataCorp, College Station, TX).
Results
Descriptive results
Mean age was significantly different between the four analysed groups (i.e. non-screened, non-recruited, decliners and participants) (Table 1). Participants were significantly younger (67 years, SD = 0.44) and non-recruited individuals were significantly older (76 years, SD = 1.09) than the individuals in the non-screened and decliner groups (71 years, SD = 0.82 and 70 years, SD = 0.48, respectively) (p < 0.001).
Participation was lowest among individuals 75 years old and older (13%, N = 16) and highest among individuals aged 60–64 (47%, N = 57) (p < 0.001). Individuals 75 years and older were significantly more often non-screened (18%, N = 23) and non-recruited (26%, N = 33) than those who were aged 60–64 (11%, N = 13 and 4%, N = 5), 65–69 (13%, N = 15 and 6%, N = 7) and 70–74 (16%, N = 21 and 10%, N = 13) (p < 0.001). Declining the invitation to participate in the MIRAS project was significantly more common among individuals 65–69 years and 75 years and older, respectively 45 per cent (N = 54) and 43 per cent (N = 54), compared to 60–64 (38%, N = 45) and 70–74 years old (41%, N = 55) (p < 0.001).
On average, it was significantly more common for women to participate (36%, N = 120) compared to men (24%, N = 40). Men were more often not screened (20%, N = 34) and not recruited (14%, N = 24) than women (12%, N = 38 and 10%, N = 34, respectively) (p < 0.05).
(Non-)Participation in the MIRAS project
The multinomial logistic regression model shows that age and gender were associated with the likelihood of being or not being a participant in the MIRAS project (Table 2). Age significantly predicted the likelihood of participating for individuals 75 years old and older. Indeed, individuals in this age group showed a higher probability of being non-screened (odds ratio (OR) = 3.80, p < 0.05), non-recruited (OR = 12.09, p < 0.001) and a decliner (OR = 2.61, p < 0.05) than of being a participant in the MIRAS project, compared to individuals aged 65–69. As regards gender, women had a lower probability of being non-screened than men, relative to being a participant in the MIRAS project (OR = 0.42, p < 0.05).
Multinomial logistic regression on the association between (non-)participation and age and gender
Notes: McFadden's pseudo R 2 = 0.05. 1. The reference category (Ref.) is participant group. OR: odds ratio. SE: standard error. CI: confidence intervals.
Significance levels: * p ⩽ 0.05, ** p ⩽ 0.01, *** p ⩽ 0.001.
Among the 58 individuals who were screened and non-recruited, the most reported reason for ineligibility to the MIRAS project was related to one eligibility criterion, namely to one's mobile phone availability or appropriateness (Table 3). This criterion included, for example, not having a mobile phone, having a faulty or too old mobile phone, and not having an internet access subscription, and was indicated for 42 individuals. Of these 42 individuals, 67 per cent (N = 28) were 75 years old or older and 21 per cent (N = 9) were 70–74. Non-recruitment due to technology-related barriers was less common among those aged 60–64 and 65–69, 2 per cent (N = 1) and 10 per cent (N = 4), respectively. The other two reasons for non-recruitment were related to language barriers and health problems. A total of nine individuals were not recruited because they could not speak fluent Swedish (60–64 years old: 22%, N = 2; 65–69 years old: 22%, N = 2; 70–74 years old: 22%, N = 2; 75 years old and older: 33%, N = 3). Eight individuals (60–64 years old: 25%, N = 2; 65–69 years old: 25%, N = 2; 70–74 years old: 25%, N = 2; 75 years old and older: 25%, N = 2) were deemed not eligible for participation because of comorbidity (e.g. aphasia, dementia, memory impairments).
Registered reasons for non-recruitment by age
Notes: N = 59. 1. Individuals could be deemed ineligible for more than one reason.
Self-selection in the MIRAS project
Self-selection was studied for 50 decliners and 160 participants who participated in the survey study. The decision to participate or not in the MIRAS evaluation phase was interpreted for its association with socio-demographic aspects, social participation and contacts, health-related aspects, and technology familiarity.
Socio-demographic characteristics
Those who participated in the MIRAS project were significantly younger than the decliners (mean = 67, SD = 0.44 versus mean = 70, SD = 0.48) (p < 0.05) (Table 4). Individuals in the age group 60–64 were significantly more often participants (88%, N = 57) compared to individuals in the older age groups (65–69 years old: 73%, N = 43; 70–74 years old: 76%, N = 44; 75 years old or older: 57%, N = 16) (p < 0.05). Moreover, individuals 75 years old and older were more often decliners (43%, N = 12) compared to individuals 60–64 years old (12%, N = 8), 65–69 years old (27%, N = 16) and 70–74 years old (24%, N = 14) (p < 0.05).
Decliners and participants comparison
Notes: 1. This group only includes those who answered the survey (i.e. 50 individuals out of 208). 2. Missing cases were not computed in the chi-squared analyses, except for the variable ‘main job’ for which the missing cases represented a large proportion of cases. 3. This category collapses farmers, self-employed and blue-collar jobs. SD: standard deviation.
Significance levels: * p ⩽ 0.05, ** p ⩽ 0.01, *** p ⩽ 0.001.
Men and women differed significantly regarding their decision to participate. Women declined less often and participated more often than men (decliners: 17%, N = 24 and 39%, N = 26, respectively; participants: 83%, N = 120 and 61%, N = 40, respectively) (p < 0.01).
Individuals who indicated they have white-collar jobs seemed to more often accept taking part in the MIRAS evaluation (82%, N = 65) compared to those individuals who reported other job positions (70%, N = 74), but this difference was not statistically significant in our study.
Social participation and contacts
Individuals who reported a higher frequency of social participation and contacts seemed to participate slightly more often (79%, N = 37) and to decline less often (21%, N = 10) than individuals who reported a lower frequency of social participation and contacts (decliners: 76%, N = 122; participants: 79%, N = 37). However, these differences were not statistically significant.
Health-related aspects
Individuals who indicated a better health status and those with a poorer health status differed significantly with regards to their decision to participate (p < 0.05). Participating in the MIRAS evaluation was significantly more common among those indicated to have a better health status (87%, N = 67) than among those with poorer health status (70%, N = 91) (p < 0.05). Those with a better health status were significantly less often decliners (13%, N = 10) than those with poorer health status (30%, N = 39) (p < 0.05).
Technology familiarity
Individuals who reported having higher digital skills accepted the invitation to participate significantly more often compared to individuals with lower self-reported digital skills (85%, N = 76 and 69%, N = 82, respectively) (p < 0.05). It was more common for individuals with lower digital skills to decide not to participate (31%, N = 36) compared to their counterparts (15%, N = 13) (p < 0.05). Moreover, accepting the invitation to participate was significantly more common among those individuals who agreed that health-monitoring technologies are useful (87%, N = 47) compared to those who did not believe this (72%, N = 107) (p < 0.05); and, it was more common among individuals who reported lower perceived usefulness of health-monitoring technologies to decline (28%, N = 41) compared to the group which reported higher perceived usefulness of such technologies (13%, N = 7) (p < 0.05).
Modelling the self-selection of the MIRAS project
We tested a model of self-selection depending on six predictors. The predictors were included in a stepwise manner in order to understand how they work together. This generated four models in total. Overall, the final model (i.e. Model 4) shows that those in younger age groups, women, with better health status and with higher digital skills had a lower likelihood of declining the invitation to participate in the MIRAS project (OR = 0.36, p < 0.05; OR = 0.30, p < 0.05; OR = 0.43, p < 0.05; OR = 0.39, p < 0.05, respectively) and thus participated more often, compared to those in older age groups, men, with poorer health status and with lower digital skills (Table 5).
Regression models on the decision to participate or not in the MIRAS project
Notes: 1. The reference category (Ref.) is participation. OR: odds ratio. SE: standard error. CI: confidence intervals.
Significance levels: * p ⩽ 0.05, ** p ⩽ 0.01, *** p ⩽ 0.001.
As a first step, we tested a model which focused on the association between the individual decision-making process regarding participation and socio-demographic aspects which included age, gender, and current or latest main job (i.e. Model 1). It reveals that women were significantly less likely to decline than to be participants in the MIRAS project (OR = 0.31, p < 0.05) compared to men. Also, individuals in white-collar jobs showed a lower likelihood of being decliners than being participants, compared to individuals in other job positions (OR = 0.44, p < 0.05).
In Model 2, frequency of social participation and contacts was added. Frequency of social participation and contacts was not significantly associated to the likelihood of declining to participate and did not contribute to the explained variance. Both the OR values and the McFadden's pseudo R 2 are similar in Models 1 and 2.
In Model 3, a measure of physical and cognitive health was added. The model shows that health significantly contributed to the decision to participate or not in the MIRAS project. Those who reported better physical and cognitive health were less likely to decline the invitation to participate in the MIRAS project compared to those who indicated a poorer health status (OR = 0.42, p < 0.05). This also resulted in a slight decrease in declining differences by gender (Model 2: OR = 0.32 versus Model 3: OR = 0.34). Also, the effect of job status on the decision to participate loses significance after introducing the health variable into the model.
As a last step, self-reported level of digital skills was included to test the final model of self-selection based on the six predictors, i.e. Model 4. Model 4 shows that the level of digital skills was significantly associated with the decision to decline or not to participate in the MIRAS project. Reporting a higher level of digital skills significantly decreased the likelihood of declining (OR = 0.39, p < 0.05), compared to indicating lower digital skills. Adding digital skills to the model resulted in a further decrease in the effect of job on the decision to decline (Model 3: OR = 0.49; Model 4: OR = 0.62) which is not significant and showed an effect of age. Individuals in the age group 60–64 were less likely to decline to participate in the MIRAS evaluation than individuals aged 65–69 (OR = 0.36, p < 0.05). There was an increment in the pseudo R 2 value in each successive model, with Model 4 showing the best fit compared to the previous models (McFadden's pseudo R 2 = 0.16).
Discussion
In this paper, we were able to develop further, and apply, the full multi-step conceptual model for the study of selective participation as elaborated in Poli et al. (Reference Poli, Kelfve and Motel-Klingebiel2019) and partially applied in Poli et al. (Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). Following that conceptualisation of selective participation, we were able to isolate the different steps of selection (i.e. pre-screening, recruitment and self-selection), to describe them, and to investigate in more detail self-selection based on both recruitment data and individual survey information. We aimed to understand the involvement of older people in the evaluation of digital health technologies for self-care as a multi-step process from project recruitment to the individual decision to participate (i.e. self-selection) and its association with socio-demographic indicators, health, social participation and technology familiarity. This was studied within MIRAS which evaluated a Web-based mobile phone system for monitoring post-operative progress of patients undergoing day surgery. MIRAS intervention outcomes were not of interest for this specific work.
Our results show that some groups of individuals are less likely to participate in digital health research. Participation is selective as a result of selections occurring in the pre-screening, recruitment and self-selection steps. Increasing age enhanced the likelihood of being non-screened, non-recruited or decliner, and those who were non-recruited were most often ineligible because of technology-related barriers.
As regards self-selection, we show that decliners and participants differed in regard to age, gender, job, health status and digital skills, but did not differ by the level of social participation. However, we cannot confirm the impact of the main job when considering health status and digital skills as well.
In line with our hypothesis, belonging to a younger age group increased the likelihood of accepting an invitation to participate in MIRAS. This agrees with previous studies (Mair et al., Reference Mair, Goldstein, Shiels, Roberts, Angus, O'Connor, Haycox and Capewell2006; Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016; Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). Also, being female increased the probability of accepting an invitation to participate. This supports what has been found in other studies that focus generally on participation in research (Glass et al., Reference Glass, Kelsall, Slegers, Forbes, Loff, Zion and Fritschi2015; Yang et al., Reference Yang, Carter, Gums, Gryzlak, Xu and Levy2017) but contrasts with previous findings which reported that females were more likely to decline than men (Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016) or there were no differences (Mair et al., Reference Mair, Goldstein, Shiels, Roberts, Angus, O'Connor, Haycox and Capewell2006; Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020). We also found that job predicted the decision to participate. Participants were more likely to indicate a white-collar job compared to decliners. This is in line with our hypothesis and can be explained by the fact that white-collar workers’ activities usually involve the use of digital technologies to a greater extent than other jobs, which predisposes white-collar workers and former white-collar workers to be more willing to use digital technologies outside their job (König et al., Reference König, Seifert and Doh2018). It is also in agreement with previous studies that describe those who volunteer to participate in digital health research as having a higher socio-economic status (van Heuvelen et al., Reference van Heuvelen, Hochstenbach, Brouwer, de Greef, Zijlstra, van Jaarsveld, Kempen, van Sonderen, Ormel and Mulder2005; Green et al., Reference Green, Anderson, Ralston, Catz, Fishman and Cook2011; Gaertner et al., Reference Gaertner, Seitz, Fuchs, Busch, Holzhausen and Martus2016) than those who refuse to participate.
In accordance with our hypothesis and previous findings (Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016), individuals reporting better health status showed a higher probability of accepting an invitation to participate in MIRAS. This contrasts with the results of a previous study (Poli et al., Reference Poli, Kelfve, Klompstra, Strömberg, Jaarsma and Motel-Klingebiel2020) in which we did not find any health effect on the decision to participate. However, that result was most likely quite specific and due to the fact that individuals with poor health status were excluded in the early phases of the recruitment process (due to exclusion criteria) and, therefore, did not receive an invitation to participate and did not have the chance to participate.
Higher levels of digital skills predicted the individual decision to participate in MIRAS. This result confirms our hypothesis and adds to previous studies which found that older decliners were more likely to be computer non-users (Dodge et al., Reference Dodge, Katsumata, Zhu, Mattek, Bowman, Gregor, Wild and Kaye2014) and more often reported technical concerns as a reason for declining to participate (Broendum et al., Reference Broendum, Ulrik, Gregersen, Hansen, Green and Ringbaek2016). Also, it agrees with the findings of other studies that involved broader target populations than older people (Palmas et al., Reference Palmas, Teresi, Morin, Wolff, Field, Eimicke, Capps, Prigollini, Orbe and Weinstock2006; Foster et al., Reference Foster, Horspool, Edwards, Thomas, Salisbury, Montgomery and O'Cathain2015).
Our results suggest that some older people, in particular, are less likely to be involved in digital health research relative to their counterparts. Being conceived and evaluated by highly selected groups of older individuals, the new digital-based services can result in not being properly accessible and usable for those older people who are typically neglected in digital health research. With more digital health research being conducted, and digital-based care provision expanding rapidly and expected to increase (Ekman et al., Reference Ekman, Thulesius, Wilkens, Lindgren, Cronberg and Arvidsson2019), this can translate into an increased risk of exclusion from digital technology and relevant resources and services for some groups of older people, further widening old-age inequalities.
We, therefore, argue that self-selection in digital health research can work as a driver of exclusion and contribute to inequalities among older people through selective non-participation and poor involvement. It limits the understanding of old-age diversity and prevents some groups of older individuals from influencing the evaluation of future services which are intended to address their needs. Those groups of older people who are less likely to be involved in digital health research may show more negative or more positive intervention outcomes compared to those who are more likely to participate. This would produce insufficient research outcomes which incorrectly inform digitalisation policies and practice.
This study has some limitations. First, the response rate to the survey study among decliners was 24 per cent. This reduced the amount of information available on decliners for use in the analyses and could have diminished or increased some predictors’ effects on the individual decision to participate. Second, reasons for declining to participate were not available. Such reasons would have further detailed the individual decision not to participate in MIRAS. Similarly, third, reasons for non-screening were not available. Having access to such reasons would have allowed a more comprehensive interpretation of the exclusion of some older individuals from even entering the recruitment phase. Fourth, women represented a larger group in the overall sample than men. This could be due to the fact that some of the eligible day surgeries for the MIRAS project mostly targeted women (e.g. breast cancer surgery). Fifth, information on the types of surgery was unsystematically collected and could not be used in the analyses. Type of surgery may be a further factor influencing self-selection as it exposes the individuals to different post-operative experiences and recovery time-frames. Depending on type of surgery, some individuals may be more or less prone to take part in an intervention study after day surgery.
Nevertheless, this study provides strong evidence that digital health research should focus more attention on self-selection and the resulting selective non-participation. First, selective involvement of older people in digital health research should be taken into account when conceptualising old-age digital exclusion and defining its underlying mechanisms. Indeed, the non-use of digital technologies can derive from poor inclusivity in evaluation phases of new digital-based services which prevents some older people from influencing both the research results and resultant conclusions. Second, research should identify what strategies can be implemented to make the recruitment processes more inclusive towards those individuals who are more likely to be excluded from participating in digital health studies, and to improve evaluation results. Third, the study of self-selection and other selection processes needs to go beyond relying only on recruitment and registry information. Our results show the importance of including the individual perspective on participation and non-participation, and provides a more comprehensive picture of the existing selectivity of older people in digital health research. However, collecting information on non-participants remains challenging, therefore future studies should invest in understanding how to improve existing instruments as well as data collection strategies. Finally, our findings are relevant beyond digital health and can be extended to other fields of research in which innovative interventions for older people are evaluated.
Author contributions
All authors have given their final approval of the version to be published and made a substantial contribution to the conception and design, or analysis and interpretation of data, and the drafting of the article or revising the manuscript critically for important intellectual content.
Financial support
This work and the MIRAS project were conducted as part of ‘Supporting Self-care by Information and Communication Technology for Older People with Long-term Conditions’ (ICT4SELFCARE) funded by the Swedish Research Council for Health, Working Life and Welfare (FORTE) (reference number 2014-4100).
Conflict of interest
The authors declare no conflicts of interest.
Ethical standards
Ethical approval was granted by the competent Regional Ethical Review Board in Linköping (dnrs 2014/422-31 and 2016/474-31).
Open access
