To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This chapter addresses diagnostic studies, which evaluate the performance of clinical tests and tools used to detect disease. The concepts of sensitivity, specificity, positive predictive value, and negative predictive value are explained in detail, highlighting how these metrics guide clinicians in interpreting test results. The role of prevalence in influencing predictive values is emphasised, underlining the need to consider population context when applying diagnostic tools. Receiver operating characteristic (ROC) curves are introduced as a method to assess test performance across varying thresholds, enabling identification of optimal cut-off points. The chapter also explores likelihood ratios, which integrate sensitivity and specificity into a single measure to support diagnostic decision-making. Strengths of diagnostic studies include their direct clinical relevance and utility in evaluating new technologies or biomarkers. Limitations include potential spectrum bias, verification bias, and challenges in defining an appropriate gold standard. Examples from infectious disease testing and mental health screening illustrate the practical implications of study design and interpretation. The chapter concludes by positioning diagnostic research as critical for improving clinical decision-making, resource allocation, and patient outcomes. This chapter maps to syllabus sections 3.2.5–3.2.8, which cover diagnostic accuracy measures including sensitivity, specificity, predictive values, likelihood ratios, and ROC curves.
This chapter offers readers a transparent view into the research methodology used to investigate mathematics anxiety and assess the impact of a targeted pedagogical intervention on students’ reported anxiety and attitudes towards statistics and quantitative research methods. It provides a detailed account of the research participants, ethical considerations, and the multi-mixed methods approach employed. The chapter also critiques the validity, reliability, and trustworthiness of the research design and findings, ensuring methodological rigour. A candid discussion of the study’s limitations further strengthens its credibility. It is an essential reading for educators, researchers, and anyone committed to evidence-based improvements in mathematics education.
Over 45 years ago, William Revelle proposed a reliability measure based on the worst split-half of a test or scale, commonly known as Revelle’s beta, to assess the general factor saturation. However, to this day, there is no reliable method for computing this measure, as existing approaches are either computationally infeasible or insufficiently accurate in identifying the worst split-half. This difficulty arises because the number of candidate splits increases exponentially with the number of items. In this article, we show that computing Revelle’s beta is conceptually equivalent to divisive (“top-down”) hierarchical clustering. This insight allows us to reduce the number of candidate splits to a quadratic problem, making the computation feasible. We specify theoretical conditions under which this approach is guaranteed to recover the worst split-half. To validate the efficiency of our approach, we conduct simulation studies and analyze real-world data. Code implementations accompanying this work are available online, together with Supplementary Material.
Defined by DSM-5-TR as a neurodevelopmental disorder, attention-deficit/hyperactivity disorder (ADHD) has attracted ever-mounting attention from the public, coupled with a growing interest from clinicians, researchers, and patients. This is reflected in significantly higher demand for clinical assessments and frequent media reports of a surge in ADHD cases across the lifespan. These trends are puzzling as it is unknown what they truly reflect: an improvement in clinical detection or a concerning degree of overdiagnosis? A key reason for this uncertainty is our limited understanding of the disorder and imprecision of the diagnosis – a long-running subject of criticism. To better understand these issues, in this article, we deconstruct ADHD through the lens of its DSM-5-TR diagnostic criteria – the basis upon which the diagnosis is routinely made. Our in-depth analysis reveals major problems associated with the diagnostic criteria with respect to their arbitrariness, vagueness, redundancy, and context-dependent normality, which together substantially undermine the validity and reliability of the diagnosis, and the ADHD construct itself, blunting the precision of ADHD research, clinical decisions, and the effectiveness of treatment – all of which are contingent on having a robust diagnosis in the first place. Hence, our detailed deconstruction of the diagnosis of ADHD is critical as it provides the necessary groundwork for its accurate reconstruction – an essential step towards developing a valid, reliable, and clinically meaningful diagnostic foundation that will inform research and improve clinical care for patients with attentional and hyperactivity–impulsivity problems.
Pfadt et al. present accessible methods for estimating conditional standard errors of measurement (CSEMs) and implement them in the open-source software JASP. Their emphasis on individual-level precision represents an important contribution to applied measurement practice. This commentary discusses several conceptual issues that clarify and extend the authors’ treatment of dimensionality, error definition, and score interpretation. The aim is to strengthen alignment between CSEM estimation and the interpretive purposes for which test scores are used.
A discussion is provided of several issues related to behavioral measurement that arise from Pfadt et al. (2026, Psychometrika, 2026, 1–35). The note may be viewed in part as a complement to their developments regarding precision estimation for individual test scores.
This study aimed to adapt the Chronic Conditions Physician–Patient Relationship Scale (CC-PPR) into Turkish and to examine its validity and reliability among patients with chronic diseases receiving care from family physicians.
Methods:
A methodological study was conducted with 254 adult patients attending the Family Medicine Centers between May 01-October 01, 2025. The adaptation process followed World Health Organization guidelines. Construct validity was examined using confirmatory factor analysis (CFA), and reliability was assessed through internal consistency (Cronbach’s α, McDonald’s ω) and item–total correlations.
Results:
The CFA supported the original one-factor, 22-item structure with an excellent model fit (χ2[209] = 59.847, p = 1.000; comparative fit index [CFI] = 1.000; Tucker–Lewis index [TLI] = 1.016; root mean square error of approximation [RMSEA] = 0.000; standardized root mean square residual [SRMR] = 0.048). Sampling adequacy was good (Kaiser–Meyer–Olkin [KMO] = 0.970; Bartlett’s χ2[231] = 5934.429, p < 0.001). All standardized factor loadings were high (0.63–0.81, p < 0.001). Internal consistency was excellent (Cronbach’s α = 0.977; McDonald’s ω = 0.976), and corrected item–total correlations ranged from 0.74 to 0.86. Marital status, employment status, and type of health institution were significantly associated with relationship scores (p < 0.05).
Conclusion:
The Turkish version of the CC-PPR is a psychometrically robust, unidimensional, and reliable tool for evaluating the quality of family physician–patient relationships among individuals with chronic conditions. It can be used to assess communication and relational competencies of family physicians, support patient-centred care initiatives in chronic disease management.
Edited by
Daniel Naurin, University of Oslo,Urška Šadl, European University Institute, Florence,Jan Zglinski, London School of Economics and Political Science
The chapter discusses the creation and maintenance of databases offering accurate, research-ready data for multidisciplinary use. It draws on the experience with the IUROPA CJEU Database Project (IUROPA), which has collected data about the decision-makers and the decisions of the Court of Justice of the European Union (CJEU). IUROPA and similar multi-user databases must live up to four criteria for databases, as proposed by Weinshall and Epstein. First, they must address real-world problems. Second, they must be open and accessible. Third, they must deliver reliable and reproducible data. Fourth, they must be ageless and easily calibrated to research purposes unknown at the time of data collection and cleaning. These criteria involve trade-offs: the quest for reliability may, first, precipitate difficult choices such as whether to discard or improve upon ‘imperfect’ data or tempt creators to endlessly postpone publication of ‘incomplete’ data; second, sustainability and human intervention are inversely proportionate when it comes to database maintenance; finally, a fledgling discipline like empirical legal studies in EU law imposes a disproportionate time commitment and financial responsibility on a small group of researchers.
Edited by
Daniel Naurin, University of Oslo,Urška Šadl, European University Institute, Florence,Jan Zglinski, London School of Economics and Political Science
Empirical legal studies in EU law routinely, if not inevitably, engage with text. From the decisions of national courts applying EU law, applicants’ case filings, to the Court’s own jurisprudence, these texts are an invaluable source of information for researchers seeking to understand the dynamics involved in the shaping of EU law and its broader societal impact. Distilling relevant information from legal texts, however, is anything but trivial. Intended to serve as a reference manual, the chapter offers detailed guidelines to researchers of both law and political science interested in employing a text-as-data approach to the study of EU law. To this end, we elaborate on how to conceptualise real-life phenomena in a way that renders them conducive to measurement, providing practical guidance on hand-coding and the use of deep learning classifiers. Further, we address potential challenges arising in the specific context of EU law. This includes limitations to access to relevant documents, as well as ensuring inter-coder reliability in data collection efforts that require specialised legal expertise.
Intraclass correlation coefficient (ICC) estimates are necessary for several statistical techniques. Researchers need accurate ICC estimates when conducting prospective power analyses for clustered data scenarios. In addition, meta-analysts require reasonable ICC values when adjusting effect size estimates to account for clustered primary study data or to correct for psychometric artifacts when using the ICC as a reliability measure. The validity of these analyses hinges on the accuracy of the ICC estimate. Beyond these secondary analyses, ICC estimates have been used as the focal outcome of meta-analysis itself to obtain a pooled measure of agreement, reliability, or the influence of a cluster’s effect. This study evaluates how well meta-analytically pooled ICC estimates recover the population ICC parameter value when using different ICC variance formulas as the inverse variance weights used in the pooling. We found that the variance formula that uses a normalizing transformation performs best across most conditions.
This study aimed to culturally adapt the Self-Blame Attributions for Cancer Scale (SBAC) into Turkish and evaluate its psychometric properties, including validity and reliability.
Method
This methodological study enrolled 161 patients from both inpatient and outpatient oncology departments of a university hospital during a 1-year observation period (March 2024–March 2025). Participant data were obtained by using 2 instruments: a demographic questionnaire and the adapted Turkish version of “the SBAC.”
Results
Confirmatory factor analysis revealed strong factor loadings ranging from 0.670 to 0.850, indicating good item reliability. Model fit statistics demonstrated excellent psychometric properties (χ2/df = 2.00; root mean square error of approximation = 0.079; Comparative Fit Index = 0.99; standardized root mean square residual = 0.042; Tucker–Lewis Index = 0.98; root mean square residual = 0.042). The scale showed high internal consistency, with a total Cronbach’s α of 0.93 and subscale α coefficients ranging from 0.85 to 0.90. The original 2-factor structure of the SBAC was supported.
Conclusion
The study confirmed the bidimensional structure (11 items) of SBAC’s Turkish version with excellent validity and reliability indices, supporting its cultural and psychometric adequacy for Turkish samples.
Beginning with the eerie history of Edinburgh’s South Bridge vaults, Chapter 3 investigates how supernatural encounters are often reported in places associated with death, decay, and sensory uncertainty. Here, we explore the connection between electromagnetic fluctuations, ambiguous sensory experiences, and supernatural perceptions. The chapter explores the human tendency to assign meaning to ambiguous stimuli and introduces key concepts in measurement science, such as reliability and validity. It also addresses the limited evidence for human sensitivity to EMF changes. Disruptions in spatial and body awareness in the brain can lead to experiences like feeling a presence or seeing a shadow figure. Together, these ideas offer plausible brain-based explanations for some ghostly encounters and demonstrate how the brain strives to make sense of the unknown when sensory information is unclear.
The Canadian Ultra-Processed Product Screener (CUPS) was developed to rapidly assess ultra-processed food (UPF) and drink product intake among Canadian adults. The CUPS is an online self-administered screener that includes twenty-eight questions and assesses the intake of a variety of UPF available in Canada, both in French and English. This study aimed to assess the construct validity and reliability of the CUPS among a sample of adults in Canada.
Design:
Cross-sectional study (between July and November 2023).
Settings:
Participants completed the online CUPS screener in three versions (1-d (twice), 7-d and 30-d CUPS) and three 24-h dietary recalls (24HR) (the reference measure) over the course of 26–28 d.
Participants:
354 Canadians aged 18–60 years
Results:
The CUPS had an acceptable construct validity, with moderate correlation coefficients between the CUPS score and UPF consumption level measured using multiple 24HR (from 0·33 to 0·44). Reproducibility was also acceptable (intraclass correlation = 0·61) and internal consistency ranged from good to excellent (Cronbach’s α = 0·72 for the 1-d and 0·86 for the 30-d CUPS). CUPS scores were also associated with higher intake of added sugars, saturated fats and Na.
Conclusions:
This study provides evidence supporting the construct validity and reliability of the CUPS among Canadian adults. The CUPS is useful for identifying low and high consumers of UPF and could serve as a proxy measure for one key dimension of diet quality, which is the type of food processing.
Punching shear failure in slab-column connections is a brittle collapse mode that threatens the safety of flat reinforced concrete (RC) slabs. Conventional design provisions are generally conservative but exhibit inconsistencies across geometric and material variations. This study develops an eXtreme Gradient Boosting (XGBoost) model to predict the ultimate punching shear capacity of flat RC slabs, using a database of experimental results categorized by four different geometric domains, including square slab with square column, circular slab with circular column, square slab with circular column, and circular slab with square column, covering the geometric, materials strength, and reinforcement properties of input parameters. The model achieved high predictive accuracy across the domains with coefficient of determination (R2) values > 0.930 in unseen testing datasets with minimal bias (0.994–1.006) and reduced scatter. Model interpretability, addressed through the SHapley Additive exPlanations analysis, confirmed slab thickness and average effective depth as the most critical predictors of shear capacity, followed by concrete strength and reinforcement parameters, while boundary condition parameters showed negligible influence due to the predominance of interior column cases. These findings demonstrate that XGBoost provides accurate, reliable, and interpretable predictions of punching shear capacity, offering a data-driven alternative to code-based methods and supporting safer and more consistent design of flat RC slabs.
Following a trend across the sciences, recent studies in lithic analysis have embraced the ideal of replicability. Recent large-scale studies have demonstrated that high replicability is achievable under controlled conditions and have proposed strategies to improve it in lithic data recording. Although this focus has yielded important methodological advances, we argue that an overemphasis on replicability risks narrowing the scope of archaeological inquiry. More specifically, we show (1) that replicability alone does not guarantee reliability, interpretive value, or cost effectiveness, and (2) that archaeological data often involve unavoidable ambiguity due to preservation, analyst background, and the nature of lithic variability itself. Instead of allowing replicability to dictate research priorities, we advocate for a problem-driven, pluralistic approach that tailors methods to research questions and balances replicable measures with interpretive depth. This has practical implications for training, publishing, and funding policy. We conclude that Paleolithic archaeology must engage with the replicability movement on its own terms—preserving methodological diversity while maintaining scientific credibility.
Bilinguals vary in their daily-life language use and switching behaviours, which are also frequently studied in relation to other processes (e.g., executive control). Measuring daily-life language use and switching often relies on self-reported questionnaires, but little is known about the validity of these questionnaires. Here, we present two studies examining test–retest reliability and validity of language-use questionnaires (relative to Ecological Momentary Assessment, Study 1) and language-switching questionnaires and tasks (relative to recorded daily-life conversations, small-scale Study 2). Test–retest reliability and validity of the LSBQ (Anderson et al., 2018) were high and moderate, respectively, suggesting this questionnaire can capture daily-life language use well. Although only examined with a small sample size, Study 2 suggested relatively low validity of most language-switching questionnaires, with short language-production tasks potentially offering a more valid assessment. Together, these studies suggest that tools are available to reliably capture language use and switching with (a certain degree of) validity.
Mental health conditions among youths are increasing rapidly, taking into consideration their biological, psychological and social development in the time of technological advancement with its associated challenges. Therefore, this study examined the psychometric properties of eight mental health scales among Ghanaian youth. A total of 708 youths (62.1% females; 10–29 years) from junior high schools, senior high schools and a university were recruited to respond to measures on depression, anxiety, somatic symptoms, obsessive–compulsive symptoms, insomnia, smartphone application-based addiction, internet addiction, life satisfaction, stress and cognitive fatigue. Confirmatory factor analysis (CFA) and Pearson’s r were used to analyse the data. The findings indicated acceptable CFA fit for all scales (comparative fit index [CFI] >0.9, Tucker–Lewis index [TLI] >0.9, root mean square error of approximation [RMSEA] <0.08 and standardized root mean square residual [SRMR] <0.08), and internal reliability was satisfactory (Cronbach’s α = 0.774–0.868 and McDonald’s ω = 0.775–0.870). Correlation analyses showed significant relationships between all the measures except for life satisfaction and internet addiction, and stress and life satisfaction. Both the CFA indices and correlation analyses indicate that all the mental health measures demonstrate acceptable initial evidence of reliability and construct validity.
This chapter explores how to get and prepare quantitative data prior to analysis. Use theory to identify the unit of analysis for your study, then determine the population and sample for your study. Be sure to capture appropriate variation in the DV and be alert for selection bias in how cases enter the sample. Issues of validity and reliability can potentially cause major problems with your analysis. Again, use your theory to carefully match indicators to concepts to minimize the risk of these problems. Think through the data collection process and plan ahead to maximize efficiency; gather all data for control variables and robustness checks in a single sweep, if possible. Much data, particularly for standard indicators of common concepts, is freely available online through a variety of sources, and your library probably also subscribes to other quantitative databases. Collecting new data is substantially more time-consuming than using previously-gathered data, but it is often necessary to test novel theories. Whether you use existing data or novel data, be sure to define your data needs list before beginning data collection, allow sufficient time, and document and back up everything.
When using tests to assess individuals, precision of individual test scores is of great importance. Although it is generally known that different test scores are measured with varying precision, traditionally, measurement precision is quantified using a single value known as the standard error of measurement. In the practice of testing, the standard error of measurement is used as a one-size-fits-all measure for each test score. This practice emphasizes the need for a conditional precision estimate that shows which scores are precise and which scores lack precision. We discuss several conditional precision estimates based on classical test theory and item response theory, and provide open-source statistical software included in the software package JASP that enables computation of these estimates. Using conditional precision estimates, decisions based on test scores are expected to show less bias than the common unconditional standard error of measurement.
We revisit the question of how to include parameter uncertainty in univariate parametric models of losses and loss ratios. We first review the statistical theory for including parameter uncertainty based on right Haar priors (RHPs), which applies to many commonly used models. In this theory, the prior is chosen in such a way as to ensure matching between predicted probabilities and the relative frequencies of future outcomes in repeated tests. This property is known as reliability, or calibration. We then test priors for including parameter uncertainty in a number of models not covered by RHP theory. For these models, we find priors that generate predictions that are more reliable than predictions based on maximum likelihood, although they are not perfectly reliable. We discuss numerical schemes that can be used to generate Bayesian predictions, including a novel use of asymptotic expansions, and we include an example in which we show the impact of including parameter uncertainty in the modeling of extreme hurricane losses. The tail loss estimates show material increases due to the inclusion of parameter uncertainty. Finally, we describe a new software library that makes it straightforward to apply the methods we describe.