The Covid-19 crisis necessitated the rapid adoption of remote consultations across the National Health Service (NHS), including in child and adolescent mental health services (CAMHS).Reference Wherton, Shaw, Papoutsi, Seuren and Greenhalgh1 Although there is a growing evidence base describing the effectiveness of video consultation for CAMHS, questions remain regarding effectiveness and acceptability, as well as how to address engagement, risk management and attrition.Reference Välimäki, Anttila, Anttila and Lahti2,Reference Martin, McBride, Masterman, Pote, Mokhtar and Oprea3 We lack consensus on implementation, so adoption in many countries (including the UK) has been slow.Reference Wherton, Shaw, Papoutsi, Seuren and Greenhalgh1 Cultural, organisational, and technological challenges seem prominent.Reference Greenhalgh, Shaw, Wherton, Vijayaraghavan, Morris and Bhattacharya4 We need more information about the clinical settings and patient groups for whom remote consultation is most appropriate. In CAMHS, the therapeutic alliance greatly influences treatment outcomes,Reference Horvath, Del Re, Flückiger and Symonds5 and implementation of remote consultations is hampered by clinicians’ concerns about safety, effectiveness, technological challenges and rapport with patients.Reference Martin, McBride, Masterman, Pote, Mokhtar and Oprea3,Reference Fletcher, Hogan, Keegan, Davis, Wassef and Day6
We lack information about clinicians’ experience of remote healthcare delivery with which to inform service improvements,Reference Shulman, John and Kane7 so it is imperative that we learn from the current rapid implementation of remote consultations. We aimed to understand practitioners’ experience across CAMHS in one NHS trust in the east of England, to inform subsequent platform development and service delivery.
Method
As this was a formal service evaluation, ethical approval was not required, but we provided clinicians with information sheets that explained our aims and informed them that their responses would be analysed for publication inside and outside the service.
We defined remote delivery as the use of telephone calls or videoconferencing for patient- or carer-facing clinical activity. We used a survey of clinicians as an initial approach to gather feedback from clinicians on their experience of remote consultations. Practitioners from all locality-based community teams and two trust-wide specialist teams (eating disorders and substance misuse) were invited to complete the survey (available from the authors on request) using Microsoft Forms after each consultation. Initially, the questionnaire focused mainly on ‘assessment’ as part of a planned move to virtual assessment that was expedited owing to Covid-19-related restrictions on face-to-face appointments (n = 102; 19 March 2020 to 1 April 2020). After feedback from clinicians, very shortly after lockdown we modified the questionnaire to cover all types of clinical consultations (n = 202; 2 April 2020 to 23 May 2020). We report findings from both versions of the survey, with collated responses where possible.
Results
We were able to calculate an approximate response rate of 25% of consultations conducted during the survey period, based on the data available. The number of remote contacts was estimated from the total contacts (n = 1226) recorded in electronic case notes. We assumed that all contacts were remote contacts, as electronic case records did not differentiate, and received a mean of 3.5 responses per member of clinical staff (n = 87).
As shown in Table 1, 21% of responses related to assessments, 34% to reviews and 44% to treatment, while 68% of remote consultations were conducted over the telephone and 31% via videoconference. Of the two modalities, patients preferred the telephone. There was no significant difference in clinicians’ views with respect to rapport or safeguarding assessment. The mode used most commonly reflected patient choice (48%), compared with clinician choice (18%) or therapeutic need (34%). Only 15% of remote assessments were estimated to take longer than if conducted face-to face, whereas 24% were perceived to have been quicker and 61% to have been the same duration. Twenty-eight per cent of respondents reported technical difficulties. There was no effect on rapport for 63% of consultations, whereas a negative or positive effect was reported for 26% and 10%, respectively. Practitioners were mostly confident that they were able to perform safeguarding procedures and risk assessments. Clinicians reported that they were able to see the young person alone in three-quarters of cases when this was considered necessary, although this varied by team.
Illustration of responses to survey questions and results of statistical tests
F2F, face-to-face; na, not applicable; VC, videoconference.
a. Frequencies and percentages have been rounded to one significant figure (the nearest whole number).
b. N = 303 for modality as one face-to-face contact was excluded as it was not possible to perform analysis.
c. N = 304 results were reported by collating responses from versions 1 and 2 of the questionnaire. N = 102 results were reported from version 1 only. N = 202 results were reported from version 2 only.
Other experiences varied by team (Table 1), including the type of consultation, the modality chosen and the reason provided for this choice. The substance misuse team and eating disorder team reported opposite effects on rapport: negative for 18% and 39% of their consultations and positive for 47% and 0%, respectively. Two-thirds (65%) of reports from the substance misuse team suggested that young people and families perceived the remote consultations positively, whereas those from the eating disorders and neurodevelopmental pathways were mostly neutral (61% and 64%, respectively) and those from locality teams were most likely to be negative (23%).
Discussion
Our findings provide valuable insights into CAMHS clinicians’ experiences of remote consultations during the Covid-19 lockdown. Clinicians’ reports were positive overall in our survey; importantly, however, their experience varied by team. CAMHS’ clientele includes many children, young people and families for whom remote consultation is a viable and perhaps even preferred option. For most consultations, meeting remotely did not take more time or adversely affect rapport, safeguarding or risk assessment. There were, however, clear differences between teams and, notably, none of our participating teams reported a wholly positive experience. Differences between teams are likely to reflect variation in clinical needs but also team culture and experience, and a challenge remains to determine for whom, and in which circumstances, remote consultation is more or less effective than face-to-face consultation.Reference Wilkinson8 Reduced travel time for clinicians as well as for families may increase capacity if clinical effectiveness can be preserved.
Our survey was small and used a bespoke questionnaire, and we lacked comparison data on rapport, safeguarding and risk management arising from face-to-face consultations. Data were collected from one NHS trust in a particular region of England, during a pandemic, and for only one-quarter of consultations, although the response rate may have been underestimated given that there were probably a few face-to-face consultations that still had to go ahead for clinical reasons. Our findings may not therefore be generalisable to other areas or circumstances. In particular, clinicians were not only offering virtual consultations but were doing so from home, which is a different experience to working from a team base, where colleagues from the multidisciplinary team would be more readily available to discuss concerns and provide support. Given the lack of evidence and high levels of anxiety about the effects of remote consultations, these preliminary findings are important and reassuring; however, others may wish to replicate and expand them.
The current restrictions on face-to-face working have greatly increased exposure to remote consultations, which given, our more positive than expected reports from clinicians, could have been because clinicians were able to adapt their behaviour and communication style.Reference Simpson and Reid9 This enforced move to remote practice is likely to improve confidence as well as willingness to experiment with remote modes of service delivery.
Future directions
Some interventions and formal assessments may need adaptation for remote consultations, and for others it may not be possible, e.g. the autism diagnostic observation schedule (ADOS). The limited available evidence should encourage clinicians and researchers to explore this further.Reference McEwen, Bosqui, Chehade, Saad, Rahman and Skavenski10 New research for treatment evaluation should incorporate remote consultations or a blended approach in study designs to gain information on the effectiveness of remote delivery. We should identify clinicians’ training needs and determine how to support those among the populations that we serve who experience problems with access or engagement, or raise safeguarding concerns. Mixed-methods studies, including surveys, ethnographic observations and focus groups, with input from young people, parents and referrers, could be used to co-produce guidelines on how to optimise virtual consultation and treatment, as well as how to manage engagement, risk and safeguarding. It is critical that we learn the lessons of what works for whom, so that we can retain the benefits and mitigate the risks of virtual treatment, particularly given the challenge that CAMHS face in meeting demand. Economic evaluations of whether remote working adds to efficiency are also needed, and the influence of remote working on team dynamics and culture needs further evaluation. A blended approach of remote and face-to-face service delivery in different combinations, tailored to clinical need, may optimise access and capacity while retaining effective and safe care.
Data availability
The data that support the findings of this study are available from the corresponding author (L.C.) upon reasonable request.
Acknowledgements
R.N.C.'s research was supported by the UK Medical Research Council (grant MC_PC_17213). A.B. is supported by a grant from the National Institute for Health Research (NIHR) and funding from the Clinical Research Network. The authors also thank the Cambridge Applied Research Centre, who support T.F.'s research, and the NIHR Cambridge Biomedical Research Centre, who fund L.C.'s time. This work used data from the CPFT Research Database, supported in part by the NIHR Cambridge Biomedical Research Centre. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.
Author contributions
The study was conceived by A.B. with support from A.M. Data collection and extraction was conducted by A.B., C.B. and R.C. Analysis and reporting of findings were led by A.B. and A.M., with support from R.C., C.B. and T.J.F. Manuscript preparation was coordinated by L.C. All authors contributed to and approved the final version.
Funding
This research received no specific grant from any funding agency, commercial or not-for-profit sectors.
Declaration of interest
None of the authors has any direct conflicts of interest.
ICMJE forms are in the supplementary material, available online at https://doi.org/10.1192/bjo.2020.160.
Open access
eLetters
No eLetters have been published for this article.