Access to treatment
A large number of patients suffer from depression and anxiety worldwide.Reference Richter, Wall, Bruen and Whittington1 The conditions cause extensive disability and societal costs.Reference Layard2,Reference König, König and Konnopka3 There are effective treatments for both depression and anxiety, and cognitive–behavioural therapy (CBT) is an evidence-based psychological treatment for both conditions when delivered face to face or in an internet-delivered format.Reference Carlbring, Andersson, Cuijpers, Riper and Hedman-Lagerlöf4 However, access to psychological treatment is limited for a number of reasons, such as the limited number of therapists,Reference Patel, Maj, Flisher, De Silva, Koschorke and Prince5 resulting in some patients not accessing treatment or having to wait for access. Being on the waiting list for treatment may be associated with worsening of symptoms and more suffering,Reference Furukawa, Noma, Caldwell, Honyashiki, Shinohara and Imai6 or at the very least a prolonged suffering and waste of time that could be spent starting to improve. A possible option could be to provide patients with an easily administered intervention that is scalable and requires minimal resources, while awaiting access to treatment. This could be considered part of a stepped-care model, where patients gain access to a self-care intervention early on in the care process.Reference Scogin, Hanson and Welsh7
Problem-solving therapy
Problem-solving therapy is a well-established and evidence-based intervention originally developed for depression, but also provided for patients with anxiety syndromes,Reference van Straten, Cuijpers and Smits8–Reference Warmerdam, van Straten, Twisk, Riper and Cuijpers10 and has shown to be effective in several meta-analyses.Reference Zhang, Park, Sullivan and Jing11,Reference Cuijpers, de Wit, Kleiboer, Karyotaki and Ebert12 The intervention focuses on training adaptive problem-solving skills to cope more effectively with a range of difficult and stressful situations and problems,Reference Cuijpers, de Wit, Kleiboer, Karyotaki and Ebert12 and has been delivered in a face-to-face formatReference Zhang, Park, Sullivan and Jing11 as well as a digital format.Reference Kleiboer, Donker, Seekles, van Straten, Riper and Cuijpers9 When delivered in a digital format, the intervention has been delivered both with therapist guidance and in a self-guided format.Reference Kleiboer, Donker, Seekles, van Straten, Riper and Cuijpers9
Although the problem-solving intervention has shown to be more effective in reducing symptoms of depression and anxiety when delivered in a therapist-guided format compared with a self-guided format,Reference Kleiboer, Donker, Seekles, van Straten, Riper and Cuijpers9 the intervention has not yet been assessed in a self-guided format with the addition of automated features and monitoring of patients’ symptoms. There are indications that such features could enhance the effects of self-guided interventions.Reference Titov, Dear, Johnston, Lorian, Zou and Wootton13,Reference Titov, Dear, Staples, Terides, Karin and Sheehan14
A problem-solving intervention with online written therapist guidance has been tested on patients with symptoms of depression and anxiety on the waiting list for treatment at a Dutch mental health centre.Reference Kenter, Warmerdam, Brouwer-Dudokdewit, Cuijpers and van Straten15 In this study, around half of patients opted to receive the therapist-guided problem-solving intervention while waiting for treatment. In addition to this published study, a protocol of a guided digital intervention, including problem-solving components, for patients with major depression who were on the waiting list for treatment has also been published.Reference Reins, Ebert, Lehr, Riper, Cuijpers and Berking16 Problem-solving has furthermore been shown to be an acceptable part of a video-based intervention provided for patients in a psychiatric waiting room area.Reference Naeem, Munshi, Gratzer, Rodie, Irfan and Rao17 Moreover, some design implications of a digital intervention supporting patients during pre-therapy waiting periods have been described in a conference presentation,Reference Neben, Seeger, Kramer, Knigge, White and Alpers18 but this intervention has not yet been empirically examined. It is, however, still unclear whether a digital problem-solving intervention provided in a self-guided format with automated features is feasible in a routine psychiatric care setting.
Feasibility aspects
When delivering healthcare interventions in a digital format, treatment adherence has been shown to increase when patients are content with the intervention and delivery mode.Reference Beatty and Binnion19 Thus, when developing new digital healthcare interventions, it is important to involve patients and consider their perspectives on the intervention and treatment format.Reference Ossebaard, Seydel and van Gemert-Pijnen20
A factor strongly linked to treatment satisfaction and adherence is treatment credibility, referring to an individual's belief in an intervention.Reference Alfonsson, Olsson and Hursti21 Perceiving an intervention to be credible has shown to be positively related to adherence and treatment outcome, and negatively related to dropping out of treatment.Reference Alfonsson, Olsson and Hursti21,Reference El Alaoui, Ljótsson, Hedman, Kaldo, Andersson and Rück22 Other specific factors associated with increased adherence is if the intervention is perceived as helpful and relevant to the patient's problems.Reference Beatty and Binnion19
Since digital interventions can be efficient only if patients interact with them,Reference Ossebaard, Seydel and van Gemert-Pijnen20 a vital factor when delivering digital healthcare is the ease of use of a system, also known as usability.Reference Davis23 As with insufficient treatment credibility, inadequate usability has been linked to both non-usage and low adherence to treatment.Reference Eysenbach24,Reference Torous, Nicholas, Larsen, Firth and Christensen25
Assesing the behavioural engagement with an intervention is a useful complement to the perceived satisfaction with an intervention and its format.Reference Perski, Blandford, West and Michie26 Conventionally, behavioural engagement with digital interventions is measured by the completion of intervention-related content and/or exercises, as well as by the number of logins to the treatment platform.Reference Alberts, Law, Chen, Ritterband and Palermo27 Furthermore, although the focus of a feasibility evaluation should be on whether the intended intervention and study procedure is feasible in a particular setting, rather than on treatment effectiveness, intended outcome measures should be included to enable the evaluation of the assessment procedures.Reference Abbott28
Aim
The aim of this study was to evaluate the feasibility of a self-guided and monitored digital problem-solving intervention for patients with symptoms of depression or anxiety who are awaiting treatment in routine psychiatric care in Sweden. Feasibility was to be measured by self-rated treatment credibility and usability, behavioural engagement and preliminary effects on symptoms of depression and anxiety.
Method
Setting and study design
This study investigated the feasibility of a self-guided and monitored digital problem-solving intervention provided to patients with symptoms of depression or anxiety who are between the assessment phase and the treatment phase within routine psychiatric care in Sweden.
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All procedures involving human patients were approved by the Swedish National Ethical Review Board (identifier 2019-05911). This trial was pre-registered on ClinicalTrials.gov (identifier NCT04277793) on 20 February 2020.
Participants and recruitment
The recruitment was conducted within a routine psychiatric care unit in Sweden during the spring and autumn of 2020. Participants were informed of the study through information from the healthcare personnel at the psychiatric care unit. During the recruitment period, restrictions relating to the COVID-19 pandemic were introduced into Swedish healthcare, resulting in fewer patient visits at the unit, and prolonging the planned recruitment period by around 4 months.
Inclusion criteria were as follows: age ≥18 years; on the waiting list for treatment within routine psychiatric care; and presence of clinically significant symptoms of depression or anxiety, as measured by scoring ≥5 points on the standardised and self-assessed questionnaires Patient Health Questionnaire-9 (PHQ-9)Reference Kroenke, Spitzer and Williams29 and/or Generalized Anxiety Disorder-7 (GAD-7).Reference Spitzer, Kroenke, Williams and Löwe30 Exclusion criteria were as follows: insufficient knowledge of the Swedish language, lack of access to mobile or desktop device with an internet connection, lack of access to a telephone that could receive calls and text messages, severe suicidal ideation as measured by ≥4 points on the ninth item of Montgomery–Åsberg Depression Rating Scale – Self Assessment (MADRS-S)Reference Svanborg and Åsberg31 and psychiatric or somatic difficulties that should be prioritised or would constitute an obstacle for the intervention.
Procedures
Study registration was self-administered online on a secure platform. All individuals who registered to the study were contacted and informed of whether they qualified to participate. Those who were included received a brief introduction to the intervention by telephone. Written informed consent was obtained from all patients digitally. A total of 18 persons from the psychiatric care unit registered to the study. Six individuals were excluded from the study because they met the exclusion criterion concerning severe suicidal ideation. Thus, a total of 12 participants were included in the study and received access to a self-guided and monitored digital problem-solving intervention for a period of 4 weeks. See Figure 1 for the study flow chart.
Fig. 1 Flow chart.
Intervention
The problem-solving intervention was hosted on a secure digital treatment platform and could be accessed via both computer and mobile devices connected to the internet. The content was based on an already existing digital problem-solving intervention used as a component in internet-based CBT in Swedish regular healthcare for individuals with major depression,Reference Hedman, Ljótsson, Kaldo, Hesser, El Alaoui and Kraepelien32 and was adapted for self-guidance.
The intervention comprised psychoeducational texts, treatment rationale, examples of problems and suggestions of solutions, illustrative pictures, instructions and problem-solving exercises. All content was presented in Swedish, and the intervention consisted of about 4800 words. Reminders to remember to use the intervention were sent to all participants by mobile text messages during the access period. In addition, an automated e-mail was sent to all participants each week during the access period, containing a weekly suggestion related to the intervention.
The user interface of the intervention was developed in collaboration with experts on user experience design, to make the intervention simple and intuitive to use in a self-guided format. Several features were built into the intervention to facilitate self-guided usage. First, because of increased mobile device usage,Reference Parasuraman, Sam, Yee, Chuon and Ren33 the user interface was designed with the responsive design method mobile-first, meaning that the mobile version of the product was designed first, and was thereafter expanded to a desktop version. Second, the navigation menu comprised text accompanied by pictograms, to visually differentiate content. Third, content was divided into different sections, subsections, pages and expandable learn-more options for the purpose of limiting the amount of content displayed simultaneously. This made it possible to present the content in small chunks. Fourth, the intervention itself was presented in a stepwise fashion. Each step in the problem-solving intervention came with its own instructions, and every new step was depended on information that had been entered in previous steps. Finally, automatic pop-ups were built into the intervention to expose the participants to helpful questions related to the exercises, as well as encouragement to keep on working with the exercises. See Figure 2 for a visual presentation of parts of the problem-solving intervention.
Fig. 2 Main menu (left) and the first step of the problem-solving intervention (right), in Swedish.
Measurements
When registering to the study, participants completed a digital assessment with questions regarding demographics, as well as inclusion and exclusion criteria. As a part of the assessment of eligibility, participants completed the standardised and self-assessed questionnaires PHQ-9Reference Kroenke, Spitzer and Williams29 and GAD-7,Reference Spitzer, Kroenke, Williams and Löwe30 measuring symptoms of depression and anxiety, respectively, and the ninth item of MADRS-S,Reference Svanborg and Åsberg31 concerning suicidal ideation. The PHQ-9 ranges from 0 to 3 points per item and 0 to 27 points in total. The corresponding points for the GAD-7 are 0–3 points per item and 0–21 points in total. The higher score on the PHQ-9 and GAD-7, the more symptoms on the respective scale. The MADRS-S ninth item scores from 0 to 6, with a higher score indicating higher severity of suicidal ideation.
After the 4 weeks of access to the intervention, participants completed two standardised self-assessed questionnaires measuring treatment credibility and usability. A five-item version of Credibility/Expectancy Questionnaire (CEQ)Reference Borkovec and Nau34 was used for measuring treatment credibility, and the System Usability Scale (SUS)Reference Lewis35 was used for measuring usability. The CEQ ranges from 0 to 10 points per item and 0 to 50 points in total, where a higher score reflects better treatment credibility. The SUS consists of ten items, with a range of 0–4 points per item. The items are summed up and calculated with a formula resulting in a total score between 0 and 100, with a higher score reflecting better system usability. Recent research suggests that individual items of the SUS can be a valuable addition to the total score.Reference Lewis and Sauro36
Measures on behavioural engagement with the intervention were retrieved from the treatment platform after the 4 weeks of access to the intervention. The following measures were retrieved: the number of logins to the platform, the number of participants who used the intervention at least once, the number of problem-solving attempts initiated, the total number of generated solutions, the mean number of generated solutions per initiated problem-solving attempt and the number of participants who completed at least one evaluation of a problem-solving attempt.
Before treatment started, participants again completed the PHQ-9,Reference Kroenke, Spitzer and Williams29 GAD-7Reference Spitzer, Kroenke, Williams and Löwe30 and the ninth item of the MADRS-S,Reference Svanborg and Åsberg31 and did so at the end of every week during access to the intervention, including after the final week. While the ninth item on MADRS-S (suicidal ideation) was only assessed for health-monitoring reasons, the scores on the PHQ-9 and GAD-7 were used to assess treatment improvement. During the end of the second and fourth week, participants completed the standardised and self-assessed 20-item version of the Negative Effects Questionnaire (NEQ),Reference Rozental, Kottorp, Forsström, Månsson, Boettcher and Andersson37 measuring negative effects of psychological interventions. The total score of the NEQ ranges from 0 to 80 points, and a higher score reflects more negative effects.
After using the intervention, participants completed a study-specific questionnaire concerning perceived user experience. This questionnaire comprised four questions focusing on whether the intervention was perceived as likable, whether the intervention was easy to understand, whether examples given felt relevant and whether functionality and information contributed to the participant feeling overwhelmed. All questions were answered on a four-point scale ranging from 0 (strongly disagree) to 3 (strongly agree). It was optional to add a free-text comment to the responses, as well as suggestions of overall improvements.
Finally, participants were contacted by telephone after the intervention access period, for a semi-structured interview concerning the experience of the intervention and format.
Data analysis
Descriptive data were reported for all variables. The scores on the SUS were compared with a cut-off score of 50.9, reflecting the usability being perceived as ‘okay’, and a cut-off score of 71.4, reflecting the usability being perceived as ‘good’.Reference Lewis35 Clinical improvement was measured by at least 20% symptom reduction on the PHQ-9 or GAD-7.Reference Kounali, Button, Lewis, Gilbody, Kessler and Araya38 Recovery was defined as at least 50% symptom reduction on the same measures.Reference Richards and Suckling39 Since there are no current cut-off scores or consensus on how to interpret scores from the NEQ, descriptive statistics were used. Illustrative free-text comments from the study-specific questionnaire, as well as illustrative recurring comments from the interviews, were selected by the authors A.H. and M.K.
Participants who did not complete the SUS, CEQ and study-specific questionnaire could not be included in the summary or analyses of that data. For the PHQ-9 and GAD-7, participants who did not complete the post-treatment assessment were included in the analyses of the number of participants who reached a 20% and 50% symptom improvement, respectively. Missing data were, in those cases, conservatively handled as no symptom improvement. In the remaining results of the PHQ-9 and GAD-7, all available data were used. Behavioural engagement data were available for all participants, and thus no participant was excluded from the summary of those data.
Results
Demographics
The majority of participants were in a relationship and experienced both symptoms of depression and anxiety. See Table 1 for complete sample characteristics. Additionally, during the assessment, four out of 12 reported that they had attention-deficit hyperactivity disorder.
Table 1 Baseline characteristics of participants
PHQ-9, Patient Health Questionnaire-9; GAD-7, Generalized Anxiety Disorder-7; MADRS-S, Montgomery–Åsberg Depression Rating Scale – Self Assessment.
Missing data
The number of participants who had missing values at post-treatment assessment on the CEQ, SUS and the study-specific questionnaire was two (17%). Three (25%) participants had missing values on the PHQ-9 and GAD-7 after the first week of the intervention, five (42%) participants had missing values after the second week of the intervention, four (33%) participants had missing values after the third week of the intervention and two (17%) participants had missing values after the fourth week of the intervention (i.e. post-treatment assessment). At the midpoint assessment of the NEQ, four individuals (33%) had missing values, and two individuals (17%) had missing values at the post-treatment assessment of NEQ. Only one person did not complete the telephone-based interview post-treatment. Behavioural engagement data were available for all participants.
Treatment credibility and usability
The mean for the sum of the CEQ among those who completed the post-treatment assessment (n = 10) was 33.4 (s.d. 15.3, range 5–48, median 39.5). See Figure 3 for scores on the CEQ and SUS for each individual, and Table 2 for outcomes on each item of the CEQ.
Fig. 3 Scores on the Credibility/Expectancy Questionnaire and System Usability Scale for each individual.
Table 2 Outcomes on items of the Credibility/Expectancy Questionnaire, ranging from 0–10 points, with a higher score indicating a better treatment credibility (N = 10)
Among those who completed the post-treatment assessment (n = 10), the mean for the sum of the SUS was 68.5 (s.d. 29.6, range 5–97.5, median 76.3). One individual was an extreme outlier, with a score of five. Without this individual (n = 9), the mean for the sum of the SUS was 75.6 (s.d. 20.6, range 40–97.5, median 77.5). See Table 3 for outcomes on each item of the SUS. A total of eight out of ten individuals (80%) scored equal to or above the cut-off value indicating ‘okay’ usability. A total of six out of ten individuals (60%) scored equal to or above the cut-off value indicating ‘good’ usability.
Table 3 Outcomes on items of the System Usability Scale, ranging from 0 to 4 points, with a higher score indicating a better system usability (N = 10)
a. Reversed item, with a higher score indicating better system usability.
Behavioural engagement
A total of nine out of 12 individuals used the intervention at least once. Out of these nine participants, five individuals completed at least one evaluation of a problem-solving attempt. See Table 4 for outcomes on the behavioural engagement measures.
Table 4 Outcomes on behavioural engagement measures (N = 12)
Symptoms of depression and anxiety
The participants with post-treatment assessment data (n = 10) showed a median symptom improvement on the PHQ-9 from screening to post-treatment of 2 points (16% improvement, interquartile range (IQR) = −0.5 to 4.8). The corresponding median symptom improvement on the GAD-7 was 3.5 points (22% improvement, IQR = −0.8 to 4.0).
From pre-treatment to post-treatment, participants who completed the post-assessment (n = 10) showed a median symptom improvement on the PHQ-9 of 0.5 points (3% improvement, IQR = −2.5 to 2.8). On the GAD-7, participants showed a median symptom deterioration from pre-treatment to post-treatment of 0.5 points (3% deterioration, IQR = −4.0 to 1.0). See Table 5 for the number of participants who reached at least 20% and 50% symptom improvement on the PHQ-9 and GAD-7, respectively, and Figures 4 and 5 for individual change in scores on these scales.
Fig. 4 Individual change in scores on the Patient Health Questionnaire-9 at all measurement points.
Fig. 5 Individual change in scores on the Generalized Anxiety Disorder-7 at all measurement points.
Table 5 Number of participants who reached a 20% and 50% symptom improvement on the Patient Health Questionnaire-9 and Generalized Anxiety Disorder-7, respectively, from screening to post-treatment and pre- to post-treatment
PHQ-9, Patient Health Questionnaire-9; GAD-7, Generalized Anxiety Disorder-7.
Negative effects
The mean score on the NEQ at the mid-assessment (n = 8) was 4.9 points (s.d. 1.9, range 3–9, median 4 points). At the post-assessment (n = 10), the mean score was 6.3 points (s.d. 4.9, range 3–17, median 4 points).
No serious negative effects were reported. Among the free-text reports on the NEQ, it was pointed out by a few participants that not being able to spend as much time as intended with the intervention generated a certain amount of guilt or stress.
Experience with the intervention
See Table 6 for outcomes on the study-specific questionnaire.
Table 6 Outcomes on the study-specific questionnaire ranging from 0 (strongly disagree) to 3 (strongly agree) points (N = 10)
Participants reported positive and negative aspects of the intervention, as well as suggestions of improvements, in the free-text section. See Table 7 for selected illustrative quotes.
Table 7 Illustrative quotes from the free-text section in the study-specific questionnaire
The average time for each interview was 10 min. In the interviews, most participants reported that they found the intervention helpful and that they appreciated the possibility to divide problems and solutions into manageable chunks. However, many stated that they did not use the intervention as much as they would have wanted. Some participants could not give any meaningful report because of insufficient usage of the intervention. A few participants said that they had expected that the intervention would generate solutions to their unique problems. However, some of these participants did state that after they had started to use the intervention, they were pleased with being prompted to reflect on their problems by themselves. One suggestion was to add more examples of problems and solutions.
One participant reported that although the intervention was easy to use, they had problems with motivation and keeping focus, and did not find the intervention helpful for staying concentrated and remembering to complete tasks. Among those who experienced difficulties remembering to use the intervention, one suggestion was to implement a function making it possible to choose intervals for getting reminders concerning remembering to work with the intervention.
Discussion
This study aimed to evaluate the feasibility of a self-guided and monitored digital problem-solving intervention for patients awaiting treatment for depression or anxiety in routine psychiatric care. The patients were recruited from a Swedish routine psychiatric clinic, and most participants experienced symptoms of both depression and anxiety.
A majority of the participants found the intervention to be both credible and usable. A total of six out of ten individuals scored equal to or above the treatment credibility mean score of 33.03 points (s.d. 8.47) reported in internet-based CBT for depression in Swedish routine psychiatric care.Reference El Alaoui, Ljótsson, Hedman, Svanborg, Kaldo and Lindefors40 Although participants found the intervention to be credible overall, they were not convinced that they would reach a high symptom improvement after having engaged with the intervention. One explanation to this could be the framing of the intervention as an intervention for the phase in-between assessment and treatment. It is unclear whether it would have made any difference to participants’ expectations of symptom improvement if the intervention would have been introduced as a possible replacement to the treatment they were awaiting.
A majority of the participants rated the usability above the threshold for ‘good’. When the extreme outlier was withdrawn from the analysis, the average usability score corresponded with this, with a value of 75.6 out of 100. This value is comparable to the total mean score of 67.85 points (s.d. 16.28) on the SUS found in a study among mental health professionals rating the usability of internet-based CBT for depression.Reference Mol, van Schaik, Dozeman, Ruwaard, Vis and Ebert41 The result is also comparable to the ratings of participants with clinical depression in a study investigating the usability of a self-guided mobile app-based intervention for depression, where the total mean score on the SUS was 86.00 (s.d. 10.84).Reference Fuller-Tyszkiewicz, Richardson, Klein, Skouteris, Christensen and Austin42 It should, however, be noted that the sample of end-users in that study consisted of a total of five participants, who were paid after they completed the trial.
Among the participants in the current study, a few items on the SUS stood out as especially positive. For example, participants did not, on average, feel like they were in the need of technical support to be able to use the intervention and its system. Furthermore, the participants felt very confident using the system, and they did not find too much inconstancy in the system. This is encouraging, since a psychiatric population may experience cognitive difficulties affecting the daily life, such as focusing on and processing information.Reference Knight and Baune43 The scoring indicating low need of technical support can be interpreted as the intervention being delivered in a way that is easy enough to process in a self-guided format for a psychiatric population.
With an average of around 11 logins to the treatment platform and three problem-solving attempts, the engagement level can be considered encouraging compared with other self-guided interventions. As a contrast, there was a 7-week self-guided intervention in Sweden that targeted mental health problems, where the average number of logins was six and participants on average completed 0.2 treatment modules.Reference Nilsson, Sörman, Klingvall, Ovelius, Lundberg and Hellner44 This intervention did not, however, include clinical monitoring of symptoms, which may have driven the higher behavioural engagement in our study. Another relevant comparison would be the online therapist-guided problem-solving intervention that was evaluated for patients on the waiting list for routine mental healthcare in The Netherlands, by Kenter et al.Reference Kenter, Warmerdam, Brouwer-Dudokdewit, Cuijpers and van Straten15 That study reported higher engagement level than we observed in our study, with two-thirds of participants completing three or more problem-solving lessons. Notably, therapists in the intervention studied by Kenter et al spent approximately 40 minutes per lesson on feedback (a majority of patients completed three or more lessons), whereas the intervention in our study was completely self-guided.
Symptoms of depression and anxiety were overall stable among the sample during the intervention period. Only a few participants reached the threshold for clinical improvement on symptoms of depression or anxiety. Some individuals did reach some symptom improvement, but for most participants, this intervention was not a substitute for the regular treatment they were waiting for. Furthermore, some individuals deteriorated slightly on depression or anxiety symptom scores, but we did not find any evidence of this being a result of negative effects from the intervention. However, these clinical effects should be regarded as preliminary because of the small sample size and uncontrolled study design. Should a future randomised clinical trial show a similar trend in treatment effects of this intervention, it would indicate that the value of using this kind of intervention as a part of a stepped-care model might be limited.Reference Bower and Gilbody45 Taking into account the sufficient credibility and usability ratings of the intervention, and relatively high behavioural engagement, the intervention could still be of value as a meaningful activity for patients awaiting treatment for their psychiatric conditions, potentially decreasing the risk of prolonged or increased suffering. In its current state, the problem-solving intervention should be considered as an addition to, rather than replacement for, other psychiatric services.
Finally, suggestions of possible improvements of the intervention from the patients included more flexible options of reminders to remember to work with one's problems and an improved overview of the solutions chosen to work with. In an improved version of the problem-solving intervention, these suggestions should be considered to be implemented.
This study investigated the feasibility of providing a self-guided and monitored digital problem-solving intervention for patients awaiting treatment for depression or anxiety in routine psychiatric care. Participants found the intervention both credible and usable, and the engagement with the intervention was comparable to other self-guided interventions deemed sufficient. In summary, a problem-solving intervention in a self-guided and monitored format may be a beneficial intervention for patients in-between the phase of assessment and access to psychiatric treatment within regular healthcare.
Limitations
This study had several limitations that need to be acknowledged. First, this study was a feasibility study, uncontrolled and consisted of a small sample size. Therefore, all effect estimates must be considered very preliminary. Second, since the aim of this study was to conduct an initial evaluation of whether the intervention was feasible in the current context, the period of usage of the intervention was chosen to be limited to 4 weeks. In an improved trial of the potential benefit of the intervention as a part of a stepped-care model or help during the waiting period for treatment, the intervention could be chosen to be provided during the complete waiting period, whether that would be over weeks or months. Third, a significant number of participants assessed for eligibility were excluded because of severe suicidal ideation, leaving the results deprived of input from patients with such problems. Finally, a majority of the participants were university educated, making the data representative for similar populations.
Clinical implications and future research
The results from this study indicate that a self-guided and monitored digital problem-solving intervention could be a feasible intervention to provide for patients in routine care while they are awaiting psychiatric treatment. However, future studies concerning treatment effects are needed.
The effects of the intervention on symptoms of depression and anxiety need to be evaluated. Preferably, the intervention could be evaluated when provided to patients during the complete waiting period in-between assessment and access to treatment, rather than during a specific number of weeks.
Data availability
Deidentified participant data will be made available upon reasonable request to the corresponding author, A.H.
Acknowledgements
This work used the BASS platform from the eHealth Core Facility at Karolinska Institutet, which is supported by the Strategic Research Area Healthcare Science (SFO-V).
Author contributions
A.H. performed the literature search, statistical analyses and drafted the manuscript. A.H. and M.K. selected illustrative quotes. A.H., M.K. and B.L. contributed to the acquisition of data. A.H., E.F., B.L., N.L. and M.K. were involved in the study design, contributed to the interpretation of data, and have read, revised and approved the manuscript. A.H., M.K. and B.L. verify the accuracy of the underlying data.
Funding
This work was supported by the Government of Sweden, Ministry of Health and Social Affairs. The funding source of this study did not have any role in the study design; the collection, analysis or interpretation of data; study recruitment; writing of the paper or the decision to submit the paper for publication.
Declaration of interest
B.L. is a shareholder of DahliaQomit AB, a company specialising in online psychiatric symptom assessment, and Hedman-Lagerlöf och Ljótsson psykologi AB, a company that licenses cognitive–behaviour therapy manuals. The remaining authors have no competing interests to declare.
Open access
eLetters
No eLetters have been published for this article.