Introduction
More than 97% of children with CHD live well into adulthood. Reference Mandalenakis, Giang and Eriksson1 However, 35.1% are diagnosed with or treated for a mental health disorder by 18 years of age. Reference Miles, Farkas, Laugesen, Sørensen, Kasparian and Madsen2 Compared to the general population, they have higher rates of neurodevelopmental disorders, including autism spectrum disorder and attention deficit hyperactivity disorder, Reference Miles, Farkas, Laugesen, Sørensen, Kasparian and Madsen2–Reference Gu, Katyal, Zhang, Chung, Franciosi and Sanatani4 severe stress reactions, tic disorders, attachment disorders, and eating disorders, Reference Miles, Farkas, Laugesen, Sørensen, Kasparian and Madsen2 whereas data on anxiety and depression are conflicting. Reference Lau-Jensen, Berg, Hejl, Baker, Rask and Hjortdal3 Even those with simple CHDs have a higher burden of mental health disorders in adulthood with higher use of psychotropic medication, lower work participation, and a higher use of social benefits. Reference Nyboe, Udholm, Larsen, Rask, Redington and Hjortdal5–Reference Eckerström, Hjortdal, Rask and Nyboe7 Early detection and evidence-based treatment are therefore crucial to lower the risk of repercussion into adulthood Reference Mojtabai, Stuart, Hwang, Eaton, Sampson and Kessler8,Reference Currie9 and shared care between mental healthcare- and CHD healthcare professionals have been called upon. Reference Kovacs, Brouillette and Ibeziako10
Recommendations for neurodevelopmental and psychiatric screening in children with CHD exist, Reference Ilardi, Sanz and Cassidy11–Reference Marino, Lipkin and Newburger13 but their clinical implementation is sparse. Reference Miller, Sadhwani and Sanz14 Furthermore, the majority of healthcare professionals as well as families are unaware of the need for such evaluations of children with CHD. Reference Patel, Ilardi and Kochilas15 Also, healthcare professionals in cardiology settings may hesitate to address this issue due to unclear responsibilities and the fear of uncovering psychosocial needs they lack the time, skills, and referral options to manage. Reference Abell, Rodwell and Eagleson16 Especially adolescents may also hesitate to seek professional help due to stigma, poor mental health literacy, and a preference for self-reliance. Reference Gulliver, Griffiths and Christensen17 In summary, there is an unmet need for disseminating knowledge about neurodevelopmental and mental health disorders in children and adolescents with CHD to both healthcare professionals and affected families to support early identification and reduce stigma. Online resources can provide easily accessible, tailored information and are, along with the paediatric cardiologist, the most used source of information about CHD and associated challenges for parents. Reference Kasparian, Lieu, Winlaw, Cole, Kirk and Sholler18 Additionally, adolescents generally find online mental health resources useful. Reference Pretorius, Chambers, Cowan and Coyle19 We could only identify four English-language information sites targeted adolescents with CHD and their families on psychological aspects of living with CHD and with succinct information on stress, anxiety, and depressive symptoms. Despite attention deficit hyperactivity disorder and autism being the most well-documented neurodevelopmental comorbidities of CHD, no information hereof was identified.
This study aimed to (1) develop and (2) test the usability and acceptability of a website with Danish informational material on neurodevelopmental disorders mental health disorders, targeting adolescents, parents of children and adolescents with these problems, and various professionals.
Materials and method
Setting and project group
This study, approved by the Data Protection Agency at Aarhus University and Central Denmark Region, is part of the Mind the Heart project (ClinicalTrials.gov Identifier: NCT05709470), which aims to test the feasibility of an online screening programme for common mental health disorders in children and adolescents with CHD. The website was collaboratively developed by the Department of Child and Adolescent Psychiatry at Aarhus University Hospital Psychiatry, Denmark, and the Department of Cardiothoracic Surgery at Rigshospitalet, Copenhagen, Denmark. The project group included specialists in child and adolescent psychiatry and CHDs.
Study design
To integrate needs, perspectives, and lived experiences of proposed end-users, the website, named Mind the Heart, was developed in an iterative design process aided by (1) parents of children and adolescents aged 0–17 with CHD, (2) adolescents aged 13 – 17 with CHD, (3) and professionals from different health care sectors, working with young people with CHD. The development included three phases: (A) preparation, (B) iterative cycles to develop first prototype, and (C) evaluation by end-users (See Figure 1).
Development of the first prototype of the mind the heart website.
Phase A: preparation
Review of existing literature and online resources
This step involved publication of a systematic review on mental health disorders in children and adolescents with CHD. Reference Lau-Jensen, Berg, Hejl, Baker, Rask and Hjortdal3 Additional searches covered existing online materials on mental health issues in this group (see Supplementary 1), browsing relevant terms such as “CHD,” “young,” “adolescent,” “mental,” and “coping.” Scientific literature on potential aetiological factors and Danish national treatment guidelines for mental health disorders in young people were also reviewed. Reference Howell, Zaccario, Kazmi, Desai, Sklamberg and Mally20
Interviews with end-users
Website content was shaped by insights from interviews with three key user groups. Parents (n = 7) of children and adolescents with CHD and current/prior mental health issues (as defined by parental reports of child difficulties in the areas of emotions, concentration, behaviour or ability to get on with others) and adolescents (n = 2) with CHD and current/prior mental health issues (as defined by self-report). Parents and adolescents were recruited through a Danish online magazine for parents of children with CHD, a paediatric cardiology outpatient clinic at Aarhus University Hospital, and professional networks. The participating parents had a median age of 46 (range 39–57), with 85.7% being female. Their children had a median age of 13 (range 7–17); 37.5% had simple CHD, and 62.5% had complex CHD or cardiomyopathy diagnosed within the first year. Healthcare professionals (n = 9) were recruited through professional networks and represented different sectors (three [33.3%] from primary care, six [66.6%] from tertiary care) and professions (paediatric cardiologists [n = 3], general practitioners [n = 2], paediatric cardiology nurses [n = 3], and school psychologist [n = 1]). Seven (77.8%) were female, and five (55.5%) worked full-time in the field of paediatric cardiology.
A semi-structured interview guide was created for each group of end-users. For parents and adolescents, it had two parts: one on lived experiences (parents’ guide for the qualitative study on lived experiences Reference Hejl, Hulgaard, Rasmussen, Larsen and Rask21 accessible at Open Science Framework, https://doi.org/10.17605/OSF.IO/93NB6), and another on their needs and preferences for information on the new website. The guide for healthcare professionals focused on their experiences with young CHD patients with mental health disorders and the information they deemed important for the website for both professionals and families. All interviews were performed by JLH and SLJ and took place either online or in a hospital setting from November 21 to September 2022. Key points for each group of end-users were synthesised and categorised by JLH, then combined across user types. The final website categories were discussed by the entire research group.
Phase B: iterative development
The website content was generated based on Phase A results through iterative discussions and rewrites within the project group. A social worker specialised in child and adolescent psychiatry provided further insights on social support. The Patient Education Materials Assessment Tool Reference Shoemaker, Wolf and Brach22 was used as a guide to increase clarity and understandability, resulting in a first draft, which was subsequently refined and shortened by two communication specialists at Rigshospitalet in Copenhagen, Denmark.
Phase C - evaluation
In phase C, the first prototype of the website was evaluated based on a questionnaire survey targeting parents of children with a CHD and healthcare professionals working in the field of paediatric cardiology in Denmark.
Participant recruitment
Parents of children with CHD were recruited via flyers at two outpatient tertiary children’s cardiology departments and a Danish Heart Foundation event in August 2023. Paediatric cardiologists, cardiologists, and cardiology nurses seeing children with CHD were recruited from all centres in Denmark.
Usability and acceptability
Two measures were applied to assess usability and acceptability of the website prototype:
-
(1) The System Usability Scale, translated and validated for use in Danish, Reference Hvidt, Christensen, Sibbersen, Helweg-Jørgensen, Hansen and Lichtenstein23 consists of 10 items rated from strongly disagree (1) to strongly agree (5). Each item is a simple statement about usability (e.g., “I thought the system was easy to use”). The System Usability Scale score is calculated in two steps by adding odd-numbered questions (one subtracted from the response) with even-numbered questions (response subtracted from 5) and multiplying the total by 2.5. The total System Usability Scale score ranges from 0 to 100, with higher scores indicating better usability. A mean score above 71 is considered good. Reference Lewis24 In this study, the System Usability Scale was adapted by replacing “system” with “website” in each item.
-
(2) A de novo questionnaire with 9 items rated on a 5-point Likert scale (from 1 [strongly disagree] to 5 [strongly agree]) to cover readability, satisfaction, and perceived usefulness of the website. The items were inspired by questions used in a similar study Reference Ashford, Olander, Rowe, Fisher and Ayers25 and the Danish version of the Experience of Service Questionnaire. Reference Johnsen, Arendt and Thastum26 Two final questions were open-ended and included “What did you find really good about the website?” and “Was there anything you didn’t like or anything that needs improving?”. The questionnaire was pilot-tested prior to the study’s commencement.
Usage
Usage of the Mind the Heart website was measured using the objective Siteimprove Analytics data.
Data collection and analysis
Parents and healthcare professionals completed electronic questionnaires using the secure, web-based software RedCap (Research Electronic data capture), Reference Harris, Taylor and Minor27 hosted by Aarhus University. Parents accessed the questionnaire anonymously via a QR code, while professionals used a personal access code and received four personalised reminders to boost participation.
Statistics
Data from Phase C are presented descriptively with numeric data presented as mean (Standard Deviation) and categorical data presented as numbers (%). Analyses were performed using STATA version 18.0 for Windows. 28
Results
Phase A – preparation
Interviews with healthcare professionals, parents, and adolescents identified four key themes for the website: (1) Common signs and symptoms, (2) Information on aetiology, (3) Coping with mental health issues and seeking help, and (4) Dispelling stigma and misconceptions. Healthcare professionals emphasised not causing unnecessary worry and reducing shame while instilling hope. Some were concerned about redundant psychologisation of the children. Parents requested information on preventing mental health issues by reducing psychological distress during postoperative recovery and wanted evidence-based information on the causes of mental health disorders linked to CHD. Both parents and professionals suggested including personal stories from adolescents and families.
Phase B: iterative development
The first prototype of the website was launched in February 2023 and hosted at Rigshospitalet, Denmark, where surgical/interventional treatment of all children in Denmark with CHD is located (Figure 2).
The website covers the four themes identified in Phase A, with customized language and content tailored specifically for professionals, parents, and adolescents. Adolescent content is shorter and simplified, while professional content avoids medical jargon for readability to teachers and psychologists. The first prototype focuses on four neurodevelopmental and mental health disorders: attention deficit hyperactivity disorder, autism, anxiety, and depression, detailing common signs and symptoms and explanations of the multifactorial nature of these disorders and their potential links to CHD. It provides coping strategies and treatment information for parents and adolescents, while offering professionals advice on supporting families, details about the stepped-care model in mental health care, and guidance on further assistance. Invented narratives based on interviews with parents and adolescents are included to dispel stigma, offer hope, and reassure families that they are not alone (see Supplementary 2 for details). Further, links to other relevant websites are included to provide easy access to sites with more detailed information and self-help resources on mental health disorders in general, i.e., Mindhelper.dk.
Phase C - evaluation of the Mind the Heart website
A total of 84 eligible paediatricians, cardiologists, and cardiology nurses were invited to participate in the survey, with 40 (47.6%) responding. Thirty-eight parents entered the survey, where two provided incomplete data leaving 36 participants for the analyses. Participant characteristics and demographics are summarised in Table 1.
Participant characteristics and demographic details in Phase C
** 1 = not at all experienced, 5 = very experienced.
***1 = not at all experienced, 5 = very experienced.
****Simple CHD included atrial and ventricular septal defect. Complex CHD included atrioventricular septal defects (AVSD), transposition of the great arteries (TGA), univentricular heart, coarctation of aorta, tetralogy of Fallot, congenitally corrected transposition of the great arteries (CCTGA), hypertrophic and dilated cardiomyopathy, TGA with VSD and pulmonary stenosis and valve disease.
Usability and acceptability
Results on usability and acceptability are summarised in Table 2. The average System Usability Scale scores indicated a good usability. Some of the parents (n = 22) and healthcare professionals (n = 28) commented in the open-ended questions on what they found good about the website, which concerned usability (easy to navigate) and acceptability (easy to understand, relevant information, differentiated content to end-users). Comments on desired improvements from parents (n = 18) and healthcare professionals (n = 20) concerned readability (simplify language, short videos as a supplement to the written), design (more pictures and colours), and content (more invented narratives, more information including on more types of mental health disorders (not specified) and developmental delays, similar information on mental health disorders in adults with CHD), and usability (better navigation options between subpages, assistive tools for dyslexic readers). Four healthcare professionals expressed worries that the website might cause unnecessary worry and lead to psychologisation of children with CHD.
End user survey results (Phase C)
*1 = strongly disagree, 5 = strongly agree.
Usage
From launch in January 2022 to July 2024, the website had 10,667 visits from 9,300 unique visitors. The subpages on attention deficit hyperactivity disorder and autism were visited the most.
Discussion
The website provides information on attention deficit hyperactivity disorder, autism, anxiety, and depression to increase awareness and knowledge on presentation, coping strategies, and support resources for these disorders. Invented narratives are included to reduce stigma and offer hope, and explanations on the multifactorial nature of mental disorders and their potential links to CHD might further reduce self-blame and guilt. In general, the website was usable and acceptable to parents and professionals. The identified topics were based on end-user interviews and included classical components of psychoeducation. Reference Sarkhel, Singh and Arora29 The content for adolescents was aligned with Lal et al.’s findings, which indicated that young adults experiencing first-time psychosis valued peer-lived experiences and factual information about symptoms, coping strategies, and treatment. Reference Lal, Nguyen and Theriault30 Similarly, personal stories of hope eased feelings of being alone and hopelessness in adolescents with juvenile arthritis and their parents. Reference Stinson, McGrath and Hodnett31 Parents in this study especially appreciated personal stories from other families, links to additional websites, and updates on the latest research, which aligned with the findings on eHealth preferences in parents to children with complex CHD by Kasparian et al. Reference Kasparian, Lieu, Winlaw, Cole, Kirk and Sholler18 Mothers of children with CHD found that personal stories on CHD experiences reduced feelings of isolation, boosted hope, and enhanced their understanding of their child’s condition, Reference DeMaso, Gonzalez-Heydrich, Erickson, Grimes and Strohecker32 and invented narratives in Mind the Heart might affect parents of this study in a similar matter. Some healthcare professionals expressed concerns that the website might cause unnecessary worries or psychologisation. Such concerns could potentially hinder a greater focus on the psychosocial well-being of children and adolescents in CHD clinics and warrant further investigation.
Not all aspects suggested in Phase A were included on the website. Thus, parents requested information on preventing mental health issues by reducing child postoperative psychological distress. Research indicates encouraging effects of family centred care in the paediatric cardiac ICU, Reference Kasparian, Kan, Sood, Wray, Pincus and Newburger33,Reference Ferentzi, Rippe and Latour34 and research and implementation of effective practices in paediatric cardiac ICU are strongly encouraged. However, such initiatives are too complex to be distilled into concrete advice on a website and further require specific training of paediatric cardiac ICU health professionals. Likewise, parents requested information on developmental delays. Survivors with complex CHD have significantly higher risks of developmental delays in language and motor skills and cognitive deficits, Reference Howell, Zaccario, Kazmi, Desai, Sklamberg and Mally20 and parents to children with CHD are reported to normalise their child’s developmental delays and mental health issues, which might dissuade them from seeking help and thus delay timely support. Reference Hejl, Hulgaard, Rasmussen, Larsen and Rask21,Reference Lee and Rempel35,Reference Rempel, Harrison and Williamson36 Thus, increased awareness of these issues as well is warranted.
As parents struggle assessing the credibility of online information and view endorsement by health institutions as a mark of quality, Reference Kasparian, Lieu, Winlaw, Cole, Kirk and Sholler18 hosting the site at an official health institution in Denmark was important despite constraining overall design to the institutional visual identity. Analytics data revealed 9,300 unique visitors since its launch in January 2022. Denmark has about 5,000 children aged 5–17 with CHD, so the 9,300 visitors indicate strong end-user interest and effective dissemination of the website’s existence. Preferred pages include those on attention deficit hyperactivity disorder and autism, which fits with estimates of high prevalence of these particular disorders in the CHD population. Reference Lau-Jensen, Berg, Hejl, Baker, Rask and Hjortdal3,Reference Gu, Katyal, Zhang, Chung, Franciosi and Sanatani4
Strengths and limitations
Some limitations should be mentioned. Recruiting adolescents for Phase A was challenging, limiting their input on the website content. Adolescents are reported to prefer more engaging, interactive material like videos, animations, and peer communication. Reference Reen, Muirhead and Langdon37 However, this study prioritised a less costly resource that could cater to a wider range of end-users. Only paediatric cardiology professionals participated in Phase C, leaving usability and acceptability for other potential users, like teachers and psychologists, unexplored. Further, approximately 50% of invited healthcare professionals in Phase C participated, so we cannot confirm if they represented the entire group. Additionally, both parents and healthcare professionals were experienced internet users. Parents’ recruitment at a related seminar may have influenced their interest and understanding of the website. Lastly, more systematic end-user involvement at every development step might have optimised the content and usability further. The study also had several strengths. The research team included researchers with experience in child and adolescent psychiatry (CUR and JLH) and in CHD (VH and SLJ), respectively, ensuring expert knowledge in both fields. Further, participating parents and healthcare professionals in Phase A constituted a heterogenous group thus broadening perspectives. In Phase C, all medical doctors and nurses in Denmark working in paediatric cardiology were invited to participate, further broadening perspectives on website acceptability and usability.
Clinical implications
Improved awareness and information on mental health disorders in children and adolescents with CHD among healthcare professionals and families may be an important first step towards better psychosocial care for these individuals.
Conclusion and perspectives
In a three-phase process informed by target end-users, we designed a novel website with informational material for professionals and families of children with CHD, covering attention deficit hyperactivity disorder, autism, anxiety, and depression. This first-of-its-kind website offers information on symptoms, aetiology, coping, and treatment of common neurodevelopmental and mental health disorders in this patient group, enabling actions to improve their mental well-being. Evaluations showed parents and healthcare professionals found the content useful, suitable, and understandable but suggested further improvements in navigation, language, and content. They also worried it might be too text-heavy for adolescents, recommending complementary videos. Moving forward, these suggestions will be considered, along with more narratives and information on developmental delays and various mental disorders as requested by parents.
The front-page of the Mind the Heart website. The front-page of the website prototype 1. The three types of end-users are addressed in separate sections where separate buttons indicate the entry for “Adolescents” (Ung→), “Parents” (Forældre→) and “Professionals” (Fagpersoner→). The button named Help (Hjælp→) contains information on where and how to get help. The button named “Contact” (Kontakt→) contains contact information and “About us” (Om os→) provides information on the overall Mind the Heart project.
Supplementary material
The supplementary material for this article can be found at https://doi.org/10.1017/S1047951124035960.
Acknowledgements
We thank all the parents and health professionals participating in this study, and Anne Holme Hansen, social worker from Aarhus University Hospital Psychiatry, for revising the social support sections on the website.
Financial support
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article. Mind the Heart received funding from the Danish Heart Foundation and the Danish Heart Foundation’s local association Esbjerg/Fanø (JLH and SLJ, grant number 20-R143-A9431-22160) and the Jasha Foundation (JLH, grant number R. no. 2023–0288).
Competing interests
The authors declare none.
Ethical standards
The authors assert that all procedures contributing to this work comply with the ethical standards of the Danish Research Ethics Committee (case no. 1-10-72-274-21) and with the Helsinki Declaration of 1975, as revised in 2008, and has been approved by the Data Protection Agency at Aarhus University (journal no. 2016-051-000001, 2730) and at Central Denmark Region (case no. 759727).
During the preparation of this work, the authors used ChatGPT 4.0 in order to improve language. After using this tool, the authors reviewed and edited the content as needed and took full responsibility for the content.
Open access
