Indicated approaches in clinical high risk for psychosis (CHR-P) individuals is one of the most established primary prevention strategies in mental health [Reference Fusar-Poli, McGorry and Kane1]. The CHR-P paradigm is grounded on three components: detection, prognosis, and intervention, which have been recently appraised by an umbrella review [Reference Fusar-Poli, Salazar de Pablo, Correll, Meyer-Lindenberg, Millan and Borgwardt2]. CHR-P individuals are young, and they accumulate risk factors for psychosis [Reference Fusar-Poli, Tantardini, De Simone, Ramella-Cravaro, Oliver and Kingdon3–Reference Oliver, Reilly, Baccaredda Boy, Petros, Davies and Borgwardt5] that enrich their level of risk for developing psychosis [Reference Fusar-Poli, Rutigliano, Stahl, Schmidt, Ramella-Cravaro and Hitesh6], leading to attenuated psychotic symptoms [Reference Fusar-Poli, Raballo and Parnas7], and impairments in functioning [Reference Fusar-Poli, Rocchetti, Sardella, Avila, Brandizzi and Caverzasi8]. Psychometric instruments are employed to formulate a group-level prognosis, which reaches very good accuracy [Reference Fusar-Poli, Cappucciati, Rutigliano, Schultze-Lutter, Bonoldi and Borgwardt9]. CHR-P individuals frequently seek help [Reference Falkenberg, Valmaggia, Byrnes, Frascarelli, Jones and Rocchetti10] at specialized mental health clinics [Reference Salazar de Pablo, Estradé, Cutroni, Andlauer and Fusar-Poli11].
Transition to psychosis from a CHR-P stage has represented the core primary outcome in preventive research in the field [Reference Fusar-Poli, De Micheli, Patel, Signorini, Miah and Spencer12]. Meta-analytical risk of transition to psychosis from a CHR-P stage in observational studies has been estimated as 25% at 3 years follow-up [Reference Salazar de Pablo, Radua, Pereira, Bonoldi, Arienti and Besana13]. The most recent network meta-analysis and Cochrane pairwise meta-analysis of randomized clinical trials (RCTs) independently showed that there is no evidence to favor specific preventive interventions over each other or over control conditions for the prevention of transition to psychosis in CHR-P individuals [Reference Davies, Cipriani, Ioannidis, Radua, Stahl and Provenzani14, Reference Bosnjak Kuharic, Kekin, Hew, Rojnic Kuzman and Puljak15]. Similarly, there is no evidence of efficacy on secondary outcomes [Reference Fusar-Poli, Davies, Solmi, Brondino, De Micheli and Kotlicka-Antczak16], such as attenuated positive psychotic symptoms [Reference Davies, Radua, Cipriani, Stahl, Provenzani and McGuire17], negative symptoms [Reference Devoe, Peterson and Addington18], functional status [Reference Devoe, Farris, Townes and Addington19, Reference Schmidt, Schultze-Lutter, Schimmelmann, Maric, Salokangas and Riecher-Rössler20], or depressive symptoms [Reference Stafford, Jackson, Mayo-Wilson, Morrison and Kendall21]. However, the confidence intervals of these meta-analytic estimates are wide, suggesting uncertainty of evidence [Reference Fusar-Poli, Davies, Solmi, Brondino, De Micheli and Kotlicka-Antczak16]. A potential explanation for this may be the lack of sufficient statistical power associated with a reduced risk of transition to psychosis in RCTs.
In patients with early psychosis, those who participated in neurobiological research had a lower rate of history of offenses, but a higher rate of past psychiatric treatment and substance use disorders compared to those who did not participate [Reference Golay, Baumann, Jenni, Do and Conus22]. Meanwhile, differences regarding positive symptoms, negative symptoms or depressive symptoms were not found during the follow up [Reference Golay, Baumann, Jenni, Do and Conus22]. However, it is not known whether CHR-P individuals who participate in those RCTs are truly representative of the general CHR-P population. The level of risk enrichment, which is a core determinant of the probability of transitioning to psychosis [Reference Fusar-Poli, Schultze-Lutter, Cappucciati, Rutigliano, Bonoldi and Stahl23], is expected to be lower in RCTs because of the stringent intake criteria compared to observational cohorts [Reference Laursen, Holmvang, Lønborg, Køber, Høfsten and Helqvist24, Reference Pakozdi, Rajakariar, Pyne, Cove-Smith and Yaqoob25]. A differential level of risk enrichment, documented by lower transition risk of CHR-P individuals recruited in RCTs (under the control condition or placebo arm), compared to the risk observed in observational cohorts—which may reflect real world clinical care—may indicate sampling biases during RCT recruitment. To the best of our knowledge, no systematic review and meta-analysis has ever examined the presence of this potential bias, which would be essential to inform the next generation of interventional research.
The primary aim of this meta-analysis was to compare the risk of transition to psychosis in individuals at CHR-P in RCTs and observational cohorts, to investigate the presence of potential sampling biases. We additionally explored associated sociodemographic and clinical characteristics and conducted meta-regressions to examine further factors determining this potential bias.
Material and Methods
The protocol for this study was registered on PROSPERO (CRD42021229223), accessible at https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=229223. This study was conducted in accordance with the “Preferred Reporting Items for Systematic reviews and Meta-Analyses” (PRISMA) 2020 item checklist [Reference Page, McKenzie, Bossuyt, Boutron, Hoffmann and Mulrow26] (Table S1), the “Meta-analysis Of Observational Studies in Epidemiology” (MOOSE) [Reference Stroup, Berlin, Morton, Olkin, Williamson and Rennie27] (Table S2) and the “Reporting Tool for Practice Guidelines in Health Care” (RIGHT) [Reference Chen, Yang, Marušic, Qaseem, Meerpohl and Flottorp28] statements.
A multistep literature search was performed by independent researchers (GSP&CD) in PubMed and the Web of Science database (Clarivate Analytics). Web of Science (all databases option) incorporates the Web of Science Core Collection, MEDLINE, KCI-Korean Journal Database, BIOSIS Citation Index, Russian Science Citation Index, and SciELO Citation Index. All articles from inception until November 1, 2020 were screened. The following search terms, which have been previously validated [Reference Fusar-Poli, Salazar de Pablo, Correll, Meyer-Lindenberg, Millan and Borgwardt2, Reference Catalan, Salazar de Pablo, Vaquerizo Serrano, Mosillo, Baldwin and Fernández-Rivas29], were applied: “risk” OR “prodrom*” OR “prediction” OR “onset” OR “ultra-high risk” OR “clinical high risk” OR “attenuat*” OR “APS” OR “high risk” OR “BLIPS” OR “brief limited” OR “brief intermittent” OR “genetic high risk” OR “GRD” OR “at risk mental state” OR “risk of progression” OR “progression to first-episode” OR “basic symptoms” AND “psychosis” OR “schizophrenia” OR “schizoaffective”. Articles identified were screened as abstracts, and after the exclusion of those that did not meet our inclusion criteria, the full texts of the remaining articles were assessed for eligibility and decisions were made regarding their inclusion in the review. We manually reviewed the references of previously published articles and included those that were relevant.
Condition and individuals being studied
Studies included were (a) original publications, including abstracts, conference proceedings, or unpublished data, (b) conducted in individuals meeting CHR-P criteria, as assessed with established CHR-P psychometric instruments (Methods S1), (c) providing longitudinal data on the transition to psychosis at 0.5, 1, 2, and/or more than 2 years follow-up in either (c.1) RCTs of pharmacological and/or nonpharmacological interventions for CHR-P individuals (results from control conditions including placebo or needs-based intervention arms were included only), or (c.2) observational cohorts, and (d) published in English. Studies excluded were (a) reviews, clinical cases, study protocols, (b) studies conducted in individuals not formally assessed with CHR-P instruments, such as those at genetic risk for psychosis (twins, first-, or second-degree relatives) or with a schizotypal personality disorder, but without a low or decreased functioning, (c) cross-sectional studies, or (d) studies in languages other than English. When there were ≥ 2 overlapping studies at the same timepoint (different studies from the same sample could provide independent data at different time points), we clarified with corresponding authors whether there was overlap or not. When we found evidence that an RCT overlapped with an observational cohort, we included the RCT to increase the potency of our analyses since we expected the number of RCTs gathered to be smaller. Otherwise, the study with the largest sample size was included. Disagreements in selection criteria were resolved through consensus. Whenever data for the total individuals that participated in the study or the total individuals that fulfilled CHR-P criteria were missing, authors were contacted.
Measures and data extraction
Two independent researchers (GSP & HdD) extracted data for all the included studies into an excel file. Disagreements were resolved through consensus. From each study, we extracted a predetermined set of variables to describe the main characteristics of the studies or conduct meta-regressions: first author and year of publication, country, study design (RCTs vs. observational cohort), proportion of Attenuated Psychotic Symptoms (APS), proportion of Brief Limited Intermittent Psychotic Symptoms (BLIPS/BIPS), proportion of Genetic Risk and Deterioration syndrome (GRD), proportion of Basic Symptoms (BS), CHR-P sample size, age, proportion of females, CHR-P assessment instrument, duration of follow-up, study quality (see below), continent, duration of untreated attenuated psychotic symptoms, proportion of different baseline (ICD/DSM) comorbid mental disorders, and proportion of interventions at baseline and follow-up (Methods S2). Furthermore, we extracted the main outcome variable: the raw number of CHR-P individuals transitioning to psychosis at 0.5, 1, and 2 years follow-up. Transition data were extracted from the text or from the Kaplan–Meier curves, following a procedure previously validated by our group [Reference Salazar de Pablo, Radua, Pereira, Bonoldi, Arienti and Besana13]. Transition to psychosis was operationalized as defined by each CHR-P instrument (Methods S1).
Strategy for data synthesis
The results were first systematically presented, followed by a meta-analysis. The primary effect size was the cumulative meta-analytical risk of transition to psychosis at 0.5 years (from 3 to 8.9 months), 1 year (from 9 to 17.9 months), and 2 years (from 18 to 29.9 months) follow-up overall, in RCTs, and in observational cohorts. Within-subgroup heterogeneity was evaluated to look at differences between the groups. Other secondary outcomes evaluated by stratified analysis (RCTs vs. observational cohorts) and within-subgroup heterogeneity, for which enough data were available, were (a) age, (b) sex, (c) proportion of APS, (d) proportion of BLIPS/BIPS, (e) proportion of GRD, (f) proportion of mood disorders, (g) proportion of anxiety disorders, (h) proportion of other substance use disorders, (i) proportion of antipsychotics at baseline, (j) proportion of antidepressants at baseline, and (k) proportion of other psychotropics at baseline. The effect size for “a” was mean ± standard deviation (SD); the effect size for “b–k” was the meta-analytic proportion (with 95% confidence intervals [CI]). Stratified analyses were carried out according to the availability of data (at least seven studies providing data for each variable was required) [Reference Salazar de Pablo, Radua, Pereira, Bonoldi, Arienti and Besana13]. Because the studies were expected to be heterogeneous, meta-analytical random-effects models were used. Heterogeneity among study point estimates was assessed with the Q statistic and with the I 2 index [Reference Lipsey and Wilson30]. We did not evaluate publication bias because studies included in the meta-analyses of proportions are noncomparative; thus, there are no “negative” or “undesirable” results or study characteristics like significance levels that may have biased the publications [Reference Maulik, Mascarenhas, Mathers, Dua and Saxena31, Reference Salazar de Pablo, Vaquerizo-Serrano, Catalan, Arango, Moreno and Ferre32].
Meta-regression analyses on factors that may modulate transition risk were performed when at least seven studies were available [Reference Salazar de Pablo, Radua, Pereira, Bonoldi, Arienti and Besana13]: study design, mean age, proportion of females, proportion of APS, proportion of BLIPS/BIPS, proportion of GRD, proportion of BS, year of publication, CHR-P assessment instrument, study quality (two independent meta-regressions: categorical meta-regression of high risk of bias vs. unclear risk of bias vs low risk of bias for RCTs; continuous meta-regression with Newcastle-Ottawa Scale [NOS] scores for observational studies), continent, duration of untreated attenuated psychotic symptoms, proportion of baseline comorbid (ICD/DSM) mental disorders, and proportion of interventions at baseline and follow-up. The Meta and Metaprop packages of Stata statistical software version 16 (StataCorp) and Comprehensive Meta-Analysis Version 3 software [Reference Borenstein, Hedges, Higgins and Rothstein33] were used for the analyses [Reference Nyaga, Arbyn and Aerts34]. All tests were two sided, and the p-value for significance was set to p < 0.05.
The quality of the included RCTs was evaluated using the Cochrane Risk of Bias tool (RoB2) [Reference Higgins, Altman, Gøtzsche, Jüni, Moher and Oxman35] to assess the risk of bias. For RoB2, a judgment was made about whether each study had a high, unclear or low risk of bias in each of the following six domains: random sequence generation, allocation concealment, blinding of participants and study personnel, blinding of outcome assessments, incomplete outcome data, and selective outcome reporting (see Methods S3).
The quality of the included observational cohorts was evaluated using a modified version of the NOS for cohort studies, which has been repeatedly used for systematic reviews and meta-analysis in the field [Reference Fusar-Poli, Tantardini, De Simone, Ramella-Cravaro, Oliver and Kingdon3, Reference Fusar-Poli, Rocchetti, Sardella, Avila, Brandizzi and Caverzasi8, Reference Salazar de Pablo, Radua, Pereira, Bonoldi, Arienti and Besana13, Reference Catalan, Salazar de Pablo, Vaquerizo Serrano, Mosillo, Baldwin and Fernández-Rivas29, Reference Salazar de Pablo, Catalan and Fusar-Poli36] (see Table S3). Studies were awarded a maximum of eight points on items related to representativeness, exposure, outcomes, follow-up period, and loss to follow-up.
The literature search yielded 72,162 citations, which were screened; 1,752 full-text articles were assessed for eligibility. After excluding those that did not meet our inclusion criteria (several of them were overlapping with larger studies), 94 independent studies (24 RCTs and 70 observational studies) were included in at least one of the follow-up meta-analysis (Figure 1 PRISMA flowchart). The overall database included 74 cohorts. Considering the study with the largest sample size from each cohort, 9,243 individuals were included (mean age = 20.1 ± 3.0 years; 43.7% females). Most studies were carried out in North America (n = 39, 41.5%) and Europe (n = 35, 37.2%), followed by Asia (n = 15, 16.0%), Australia (n = 9, 9.6%), more than one continent (n = 4, 4.2%), and South America (n = 2, 2.1%). Most studies (n = 44, 46.8%) used the “Structured Interview for Prodromal Syndromes” (SIPS), followed by the “Comprehensive Assessment of At Risk Mental States” (CAARMS; n = 38, 40.4%), the “Positive and Negative Syndrome Scale” (PANSS; n = 3, 3.2%), the Early Recognition Inventory (ERIraos; n = 2, 2.1%), and a combination of the SIPS/SOPS or the CAARMS and other CHR-P instruments (n = 7, 7.4%): two studies (2.1%) used the SIPS/SOPS and the CAARMS; two (2.1%) studies used the SIPS/SOPS and the “Schizophrenia Proneness Instrument” (SPI); one (1.1%) study used the SIPS/SOPS and the “Bonn Scale for the Assessment of Basic Symptoms” (BSABS); one (1.1%) study used the CAARMS and the SPI; and one study (1.1%) used the SIPS/SOPS, the BSABS and the SPI. The mean duration of follow-up in the included studies was 25.5 ± 27.2 months (range 3–192 months; Table S4). Insufficient data were available after 2 years of follow-up.
Sociodemographic and clinical characteristics of CHR-P individuals participating in RCTs and observational cohorts
CHR-P individuals in RCTs were 20.1 ± 0.9 years and 43.6% (95% CI = 41.3–45.9%) were female. 84.7% (95% CI = 79.1–89.0%) fulfilled APS criteria, 7.8% (95% CI = 4.6–13.0%) BLIPS/BIPS criteria and 12.3% (95% CI = 4.6–29.0%) GRD criteria. 38.4% (95% CI = 34.1–42.8%) had comorbid mood disorders, 27.4% (95% CI = 14.5–45.8%) anxiety disorders and 3.4% (95% CI = 0.8–12.7%) other substance use disorders. At baseline 20.9% (95% CI = 14.7–28.8%) were on antipsychotics, 31.7% (95% CI = 14.6–55.8%) on antidepressants, and 17.2% (95% CI = 9.5–29.1%) on other psychotropics (see Table 1 and Table S5). CHR-P individuals in observational cohorts were 20.0 ± 0.3 years and 45.2% (95% CI = 44.0–46.4%) were female. 83.5% (95% CI = 82.1–84.7%) fulfilled APS criteria, 6.4% (95% CI = 4.4–9.2%) BLIPS/BIPS criteria and 11.3% (95% CI = 8.4–15.1%) GRD criteria. 49.1% (95% CI = 34.4–64.0%) had comorbid mood disorders, 29.3% (95% CI = 23.2–36.2%) anxiety disorders and 16.8% (95% CI = 13.3–21.0%) other substance use disorders. At baseline, 26.5% (95% CI = 20.0–34.1%) were on antipsychotics, 29.6% (95% CI = 23.8–36.2%) on antidepressants and 16.0% (95% CI = 8.1–29.2%) on other psychotropics (see Table 1 and Table S5). The proportion of CHR-P individuals with other substance use disorders was higher in observational cohorts than in RCTs (Q = 5.6, p = 0.018). There were no statistically significant differences between individuals at CHR-P in observational studies and RCTs in age, sex, % APS, % BLIPS/BIPS, % GRD, % BS, % mood disorders, % anxiety disorders, % exposure to antipsychotics, % exposure to antidepressants, or % exposure to other psychotropics at baseline (all p > 0.05).
Abbreviations: APS, attenuated psychosis symptoms; BLIPS, brief limited intermittent psychotic symptoms; CHR-P, clinical high risk of psychosis; CI, confidence intervals; GRD, genetic risk and deterioration syndrome; RCT, randomized clinical trial; SD, standard deviation.
a Excluding alcohol use disorders and cannabis use disorder.Bold values indicate p<0.05.
Meta-analytic transition to psychosis from a CHR-P state in RCTs vs observational cohorts
The meta-analytical risk of transitioning to psychosis from a CHR-P stage was 0.091 (95% CI = 0.068–0.121, k = 17, n = 964) at 0.5 years, 0.140 (95% CI = 0.101–0.191, k = 15, n = 869) at 1 year and 0.165 (95% CI = 0.097–0.267, k = 6, n = 416) at 2 years follow-up in RCTs (Table 2 and Figure 2). The meta-analytical risk of transitioning to psychosis from a CHR-P stage was 0.081 (95% CI = 0.067–0.099, k = 31, n = 6,327) at 0.5 years, 0.138 (95% CI = 0.114–0.167, k = 44, n = 6,318) at 1 year and 0.174 (95% CI = 0.156–0.193, k = 41, n = 7,102) at 2 years follow-up in observational cohorts (Table 2 and Figure 2). There were no differences in the transition risks between the groups (all p > 0.05).
Abbreviations: CHR-P, clinical high risk of psychosis; CI, confidence intervals; RCT, randomized clinical trial.
Heterogeneity and quality assessment
Heterogeneity across the included studies was statistically significant (I 2: from 42.0 to 87.0%, p < 0.001). According to the RoB results, 11 (45.8%) RCTs had a high risk of bias, 9 (37.5%) RCTs had an unclear risk of bias, and 4 (16.7%) RCTs had a low risk of bias. The mean NOS score was 4.5 (±0.8) and ranged from 3 to 7 (Table S4).
Transition risk increased with an increasing proportion of BLIPS/BIPS (β = 0.0182; 95% CI = 0.0094–0.0270; Z = 4.0589; p < 0.0001; Table S6). There was no association between transition to psychosis and any other evaluated meta-regressors (all p > 0.05; Table S6). There were not enough studies providing this data to evaluate the influence of other factors, including the proportion of BS, duration of untreated attenuated psychotic symptoms, comorbid disorders, and interventions (Table S6).
To the best of our knowledge, this is the first meta-analysis empirically testing the presence of sampling biases in RCTs of individuals at CHR-P. Contrary to our hypothesis, we found no differences in the meta-analytical cumulative risk of transition to psychosis between RCTs and observational cohorts. We also did not find a significant impact for moderating factors outside BLIPS/BIPS.
The current database is globally representative with 94 studies from 74 cohorts and 9,243 individuals. However, while the geographical distribution in global clinical CHR-P research conducted over the past two decades (Europe 51%, North America 17%, Asia 17%, Australia 6%, South America 6%, and Africa 2%) [Reference Kotlicka-Antczak, Podgórski, Oliver, Maric, Valmaggia and Fusar-Poli37] is comparable to the number of CHR-P clinical services established (Europe 58.8%, North America 25.5%, Australia 7.8%, Asia 5.9%, and South America 2.0%) [Reference Salazar de Pablo, Estradé, Cutroni, Andlauer and Fusar-Poli11], in the current study this distribution changed, gaining North America predominance (North America 41.5%, Europe 37.2%, Asia 16.0%, Australia 9.6%, more than one continent 4.2%, and South America 2.1%). This difference is likely due to the greater number of RCTs conducted in North America (almost half of all the RCTs included), in line with research in other areas of medicine [Reference Jeong, Sohn, Kim, Ko, Seo and Song38], and probably due to economic factors allowing more RCTs to be conducted in that continent. The need to promote the active participation of currently practically unrepresented continents such as Africa (as also observed in the current study), has been detected, and programs to act as a blueprint for organizations to increase the contributions of these regions are being promoted [Reference Graef, Okoye, Ohene Oti, Dent and Odedina39].
The main finding of the current meta-analysis is that we found no evidence for sampling biases in RCT studies of CHR-P individuals compared to observational studies. In the short term (0.5 years), the meta-analytical cumulative risk of transition to psychosis from a CHR-P stage was not different in RCTs than in observational cohorts. In RCTs, conditions are typically strict, and clinical monitoring needs to be frequent. In fact, weekly assessments are not uncommon at the beginning of the RCTs once interventions are provided [Reference Amminger, Schäfer, Papageorgiou, Klier, Cotton and Harrigan40, Reference Kantrowitz, Woods, Petkova, Cornblatt, Corcoran and Chen41]. This frequent monitoring and higher frequency of appointments provided by researchers in RCTs may have facilitated an early and quicker detection of transitions to psychosis in CHR-P individuals. This hypothesis is supported by previous evidence suggesting that a rapid response [Reference Pruessner, Faridi, Shah, Rabinovitch, Iyer and Abadi42] and flexibility when this is required [Reference Broome, Woolley, Johns, Valmaggia, Tabraham and Gafoor43]—typically seen in RCTs—is associated with better patient engagement. In line with this, CHR-P individuals may not disclose all of their experiences in their first assessment or the first time they present them. In fact, services like “Outreach and Support in South London” [Reference Fusar-Poli, Spencer, De Micheli, Curzi, Nandha and McGuire44] frequently offer an extended assessment to facilitate CHR-P individuals to disclose their experiences in greater detail and have the requisite space and time to do so.
While the above findings may be associated with the transition risk observed in the short-term, evidence of sampling bias in RCTs in the medium term (1 or 2 year follow-up) was not found either. The presence of sampling bias affecting the CHR-P paradigm has been suggested independently from RCTs [Reference Fusar-Poli, Schultze-Lutter, Cappucciati, Rutigliano, Bonoldi and Stahl23, Reference Fusar-Poli, Palombini, Davies, Oliver, Bonoldi and Ramella-Cravaro45]. Substantial risk enrichment during the recruitment of young individuals undergoing CHR-P assessment has been observed in observational cohorts [Reference Fusar-Poli, Rutigliano, Stahl, Schmidt, Ramella-Cravaro and Hitesh6, Reference Rice, Polari, Thompson, Hartmann, McGorry and Nelson46]. Lack of differences between observational cohorts and RCTs suggest substantial risk enrichment is also present in RCTs. However, we cannot rule out that after 2 years, this difference may become evident. Notably, control conditions, including the needs-based interventions provided in some RCTs, may decrease transition risk because they include an active component. However, our results support that there is no robust evidence to favor any specific intervention over the others for preventing psychosis in CHR-P individuals [Reference Davies, Cipriani, Ioannidis, Radua, Stahl and Provenzani14, Reference Bosnjak Kuharic, Kekin, Hew, Rojnic Kuzman and Puljak15]. Currently, needs-based interventions are recommended, along with psychological interventions [Reference Fusar-Poli, Salazar de Pablo, Correll, Meyer-Lindenberg, Millan and Borgwardt2].
Our results align with the finding that individuals who do not engage or who drop out share similar demographic characteristics with those that remain engaged in longitudinal cohorts [Reference Stowkowy, Liu, Cadenhead, Tsuang, Cannon and Cornblatt47]. Greater severity of disorganized symptoms in individuals who drop out from CHR-P services has also been detected when compared to CHR-P individuals who remain engaged [Reference Leanza, Studerus, Mackintosh, Beck, Seiler and Andreou48]. Although the engagement of individuals at CHR-P in RCTs is even more challenging as the conditions are stricter and the need for continuous clinical monitoring and monitoring of side effects greater, these factors did not have a substantial effect on the transition risk.
We also found similar characteristics regarding the proportion of individuals within each CHR-P subgroup, the proportion of individuals with baseline comorbid disorders or the proportion of individuals exposed to different interventions in RCTs and observational cohorts, which support that there is no sampling bias. An exception for this was the proportion of other substance use disorders (excluding alcohol use disorders and cannabis use disorder, which could not be evaluated due to limited evidence providing this data), which were less frequent in CHR-P individuals evaluated in RCTs. However, some RCTs include substance use disorders within their exclusion criteria [Reference Bechdolf, Müller, Stützer, Wagner, Maier and Lautenschlager49], which explains the difference better than the presence of sampling bias.
We also confirmed that a higher proportion of Brief Limited Intermittent Psychotic Symptoms was associated with higher transition risk [Reference Fusar-Poli, Salazar De Pablo, Rajkumar, López-Díaz, Malhotra and Heckers50]. This finding is in line with recent large-scale individual studies [Reference Menghini-Müller, Studerus, Ittig, Heitz, Egloff and Andreou51]. In fact, the presence of short-lived psychotic episodes has consistently been associated with a very high risk of transition to psychosis [Reference Fusar-Poli, Salazar De Pablo, Rajkumar, López-Díaz, Malhotra and Heckers50, Reference Fusar-Poli, Cappucciati, Bonoldi, Hui, Rutigliano and Stahl52, Reference Fusar-Poli, Cappucciati, De Micheli, Rutigliano, Bonoldi and Tognin53], as well as with seriously disorganizing features [Reference Fusar-Poli, Cappucciati, De Micheli, Rutigliano, Bonoldi and Tognin53]. Furthermore, only a minority of patients fulfilling BLIPS/BIPS criteria receive the appropriate dose of cognitive behavioral therapy, and their needs are unmet by current interventions [Reference Fusar-Poli, De Micheli, Chalambrides, Singh, Augusto and McGuire54]. Although umbrella reviews have consolidated male gender as an established prognostic factor for psychosis (Incidence Rate Ratio for males vs. females: 1.34) [Reference Radua, Ramella-Cravaro, Ioannidis, Reichenberg, Phiphopthatsanee and Amir4], our meta-regression did not detect any impact of sex on the risk of transition to psychosis. Other factors, including the CHR-P instrument used, the presence of nonpsychotic comorbid disorders at baseline, or the exposure to medication at baseline, were also not impacting transition risks, in line with previous meta-analyses [Reference Fusar-Poli, Cappucciati, Rutigliano, Schultze-Lutter, Bonoldi and Borgwardt9, Reference Fusar-Poli, Nelson, Valmaggia, Yung and McGuire55, Reference Boldrini, Tanzilli, Pontillo, Chirumbolo, Vicari and Lingiardi56] and original studies [Reference Youn, Phillips, Amminger, Berger, Chen and de Haan57].
This study has some limitations that must be taken into consideration when interpreting its results. First, we could not evaluate differences in transition after 2 years of follow-up because of limited data on RCTs after this period. Furthermore, only data from six RCTs were available at 24 months follow-up, while the number of observational cohorts was significantly higher. Second, the duration of follow-up was short in some of the included studies, particularly in RCTs. Third, some analyses may have been underpowered due to limited RCTs providing data for some of the outcomes. Fourth, our decision to include RCTs rather than observational cohort studies in case of overlap of samples, in order to increase the statistical power of the analyses, may have affected the findings. However, the 2-year transition risk observed in the cohort studies falls within the meta-analytic 95%CIs previously observed in the whole observational studies [Reference Fusar-Poli, Bonoldi, Yung, Borgwardt, Kempton and Valmaggia58] (see eTable 4 in [Reference Fusar-Poli, Cappucciati, Borgwardt, Woods, Addington and Nelson59]). Fifth, there were too few primary studies including individuals with BS as part of their inclusion criteria. Sixth, there was high heterogeneity in the included studies; we accounted for it in meta-regression analyses. Seventh, the confidence intervals for RCT estimates were broad, suggesting that some uncertainty exists, and that caution is needed when interpreting the findings. Finally, we could not conduct meta-regressions for the duration of untreated attenuated psychotic symptoms, several baseline comorbid mental disorders and baseline and follow-up interventions for the same reason (limited data).
There is no meta-analytic evidence supporting sampling biases in RCTs of CHR-P individuals. We found no differences in transition risks between observational cohorts and RCTs. Further RCTs are needed to detect effective interventions to prevent psychosis in this at-risk group.
This study is funded by the PSYSCAN project to PFP through the European Commission. GSP is supported by the Alicia Koplowitz Foundation.
Conflict of Interest
G.S.P. has received honoraria from Janssen Cilag outside the current study. M.S. received honoraria/has been a consultant for Angelini and Lundbeck outside the present study. P.F.P. has received research fees from Lundbeck and honoraria from Lundbeck, Angelini, Menarini, and Boehringer Ingelheim outside the current study.
Data Availability Statement
The studies included in this review were publicly available. The lead author can be contacted.
To view supplementary material for this article, please visit http://dx.doi.org/10.1192/j.eurpsy.2021.2222.