To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
Suicide is a significant global public health concern, and conventional clinical risk assessment is constrained by workforce availability, scalability, and clinician variability. The classic suicidality risk evaluation is largely dependent on clinical judgment, which, although helpful, can demonstrate a ceiling effect in its predictive validity. AI-driven chatbots, conversational systems that engage users in real-time natural language dialog, have emerged as candidate tools for augmenting suicide risk detection and prevention. This narrative review aimed to: evaluate the performance of AI-driven chatbots in detecting and assessing suicidal ideation relative to clinical benchmarks; examine the effectiveness of chatbot-based interventions for suicide prevention; and identify ethical, cultural, and implementation challenges limiting clinical translation. Six electronic databases were searched, with the initial search conducted in 2024 and updated in 2026 through targeted monitoring, with no upper cutoff date applied. A thematic narrative synthesis approach was applied across five domains. Eleven primary studies met eligibility criteria and were included in the synthesis. Chatbot-based risk assessment showed adequate response alignment with expert judgment at the extremes of suicide risk, but consistently failed to distinguish intermediate risk levels across multiple model families. Across 29 tested commercial chatbot agents, none met the criteria for an adequate suicidal crisis response. A clinically designed, framework-anchored chatbot achieved high efficacy across six outcome domains. Three percent of social chatbot users reported halted suicidal ideation, and a purpose-built clinical chatbot in emergency department settings significantly improved evidence-based care delivery. Systematic risk severity underestimation and the absence of cross-cultural evaluation were identified across all studies. AI-driven chatbots show potential as adjunctive tools across the suicide care continuum. Clinically designed, evidence-anchored chatbots demonstrate feasibility and meaningful benefit; commercially deployed chatbots without clinical validation demonstrate near-universal crisis response inadequacy. Mandatory clinical validation prior to public release, clinician oversight, and crisis system integration are prerequisites for responsible deployment.
Gauging the extent of public acceptability of reforms is an important concern for policymakers. Timely insights into public perceptions can illuminate how reforms are received and how attitudes evolve over time. In this study, we build on the OECD’s Public Acceptability Tool, a framework encompassing four key dimensions of reform acceptability—Economic, Fairness, Behavioural, and Process—to evaluate the public acceptability of policy reforms. We take the 2023 French pension reform as a relevant case study, using online media articles and parliamentary speeches as indicators of discourse surrounding the reform. Using word embeddings, we classify these texts according to the four dimensions and apply matrix factorisation topic algorithms to uncover the latent themes within each. Our analysis shows that the Process dimension dominated media coverage during the discussion and legislative phases of the reform, consistent with previous literature on pension reforms. In contrast, no particular dimension was predominant in parliamentary speeches, suggesting a mismatch between policy and public debates. Finally, we identify the main topics driving public discussion within each dimension, highlighting notable differences between media narratives and parliamentary discourse that offer further insight into the dynamics of public acceptability.
Linguistic abnormalities in schizophrenia (SCZ) span morphological, syntactic, semantic, and discourse levels. Converging cross-linguistic evidence suggests that SCZ may involve semantic narrowing alongside reduced syntactic differentiation, yet how these changes co-occur across linguistic domains and whether they represent core, task-general disturbances remains unclear. We applied a multilevel NLP framework to a large Japanese dataset to identify structurally related linguistic markers of SCZ across elicitation contexts.
Methods
Speech from 104 patients with SCZ and 101 healthy controls was collected through semi-structured interviews. Transcripts from free conversation, storytelling, and picture description were analyzed using GiNZA, Word2Vec, TF-IDF, and SentenceBERT to extract 76 morphosyntactic, semantic, and discourse features. Factor analysis identified representative features independent of diagnosis, which were tested using generalized estimating equations and validated with bootstrap and permutation procedures. Cross-task stability was examined to determine core linguistic markers.
Results
In free conversation, reduced Case-particle (Kakujoshi) and Adverb use and increased Mean Pairwise Word Similarity were strongly associated with SCZ (AUC = 0.87, 95% CI: 0.74–0.97). Adverbial, case-particle, and semantic-network measures functioned as cross-task markers.
Conclusions
SCZ involves multidimensional language disturbances characterized by a tripartite linguistic phenotype of diminished morphosyntactic explicitness, semantic narrowing, and reduced modification-based contextual modulation in spontaneous discourse. Extending cross-linguistic evidence, our results indicate that lexical-semantic contraction co-occurs with reduced overt marking of argument relations in Japanese, alongside weakened adverbial elaboration and framing – suggesting convergent, largely task-general dimensions of SCZ language pathology, most evident in free conversation.
This chapter examines distributed semantics and language models, Word2Vec and BERT, for obtaining word and sentence embeddings to extract knowledge representations from naturalistic stimuli in behavioural data science applications. These representations enable large-scale study of human cognition and behaviour, providing insights into higher-level psychological processes. Utilising distributed semantics is cost-effective due to pretrained language models’ availability. However, integrating perceptual data with semantic representations is crucial, as these representations are experience-based and may not fully capture complex sentences’ meaning. Future research can address questions like memorability using semantic representations and explore individual differences by training models on data from distinct sub-populations. High-dimensional representations from embedding models offer numerous opportunities to study human behaviour on a larger scale than previously possible.
Recent advances in data-driven behavioural science and, particularly, in Behavioural Data Science, saw the rise of applying natural language processing techniques to understanding and modelling human behaviour, algorithmic behaviour, as well as behaviour of complex human–machine systems. From associative modelling in the standard psychological experiments to understanding emotional arcs in novels and movies through the way humans, algorithms and complex systems use language, this chapter demonstrates how computational linguistics methods allow behavioural methodology to go beyond the ‘sterile’ laboratory environments into the field using data, test hypotheses at scale and have scalable practical impact. This chapter also shows how language-based modelling can shed light on cognition, decision-making, judgements and cultural evolution. Using empirical example of a large-scale Behavioural Data Science study, this chapter also demonstrates how language analysis can be used as a ‘truth serum’, helping to obtain underlying human preferences from subjective judgements usually provided in surveys.
The rise of social media as big social data offers opportunities for behavioural science and Behavioural Data Science researchers. The availability of large volumes of data generated by users of social media opens up the possibility of being able to study human behaviour in detail, at scale and in real-time. Stimulated in part by such opportunities, machine learning and natural language processing (NLP) techniques have advanced rapidly. Applications of social media analytics now range from attitude extraction, sentiment analysis and behavioural monitoring, to rumour verification, event prediction, detection and tracking. However, the challenges have also grown and opinions on the value of social media analytics remain divided, with some seeing great potential while others express concerns about, for example, the absence of transparency in machine learning and NLP models and problems of bias in – and ethics of – harvesting social media data. Some are also concerned about the lack of methodological rigour and even question whether social media analytics is capable of delivering meaningful and robust insights into human behaviour. If they are to address these issues, then behavioural science researchers will need to master the skills and knowledge that will be needed to choose and apply machine learning and NLP techniques in ways that can guarantee robust and scientifically valid findings.
Behavioural Data Science has become a crucial tool in finance, helping researchers and practitioners understand the behaviours of individuals and markets. This chapter investigates how unstructured customer feedback data, collected from the online review platform Trustpilot, can be used to model consumer behaviour in financial services. Through a large-scale text analysis of customer reviews, we examine (i) the differences in how customers perceive traditional financial institutions compared to fintech firms; (ii) the predictive power of context-dependent sentiment in forecasting customer satisfaction; and (iii) the methodological advantages of using real-time, unstructured behavioural data for improving customer experience analytics. Our findings indicate that traditional financial service providers and fintech companies often elicit orthogonal sentiment patterns from customers – even when offering similar services – highlighting the importance of brand identity and user expectation in behavioural outcomes. We also demonstrate that models trained on Trustpilot-derived textual data outperform conventional natural language processing approaches in predicting customer satisfaction. By embedding sentiment analysis within a broader Behavioural Data Science framework, this chapter illustrates how financial institutions can more accurately interpret and respond to consumer feedback, contributing to more adaptive, customer-centric service design in both traditional and emerging financial ecosystems.
This chapter explores the use of natural language processing and large databases of digitised text to make inferences about the psychology of authors, including their emotional state, cognitive abilities and beliefs. By analysing longitudinal data, researchers can investigate how behaviour, psychology and culture change over time. The chapter addresses various research questions, including how language evolves, how mental health and rationality change over time and the relationship between mental suffering and artistic output. The chapter aims to provide readers with an understanding of the methodologies, workflows and resources used to conduct this type of research, as well as potential pitfalls and ways to avoid them. It also highlights exceptional work in this field. The chapter emphasises that natural language processing and behavioural insights are allowing researchers to answer questions about human psychology and culture at an unprecedented scale.
Printed media can shape its audience’s political preferences. Research on governments influencing their narrative focuses on censorship of political scandals but largely ignores day-to-day political content. We analyze opinion columns from Mexico, a country with a democratic culture where outright censorship is unfeasible, and yet there is journalistic evidence on the government “sponsoring” the media to communicate messages with a less negative tone. We estimate the negative tone of over 200,000 opinion pieces from Mexico’s eight most prominent newspapers using sentiment analysis. We propose a novel metric of media capture that conveys the over-favoring of publicity spending by the government in news outlets. We find that captured media are less negative about the incumbent president and more negative about their main political rival, suggesting media organizations adapt their content to their advertisers’ preferences. The results are validated by rare qualitative evidence that uncovers the blacklisting of media deemed too negative of the incumbent.
Natural language processing (NLP) technologies increasingly shape public life, yet their deployment for social good remains unevenly distributed across domains, languages, and geographies. This piece inaugurates the NLP for Social Good column in this journal. In this piece, I map the current state of NLP for Social Good (NLP4SG) across nine application domains. The picture that emerges is one of striking imbalance: AI harms, inclusion, and digital violence attract the bulk of research attention, while poverty, peacebuilding, and environmental protection remain critically underexplored. I argue that the field must address three structural gaps, domain coverage, linguistic diversity, and evaluation methodology, if NLP is to fulfil its potential as a force for equitable social progress. The piece concludes with five directions that I believe will define the next chapter of NLP4SG research.
This study addresses the challenges of performing narratological analysis on low-resource languages, with a focus on Old Church Slavonic. Understanding the roles, interactions, and networks of persons is central to narrative analysis, yet such investigation is hindered by the scarcity of experts and the limited availability of annotated resources. We explore both established natural language processing (NLP) methods and large language models (LLMs) for analyzing pre-modern Slavic Lives of Saints, including several Slavic versions, the Greek original, and an English translation. Pre-modern Slavic texts pose particular difficulties due to rich morphology, orthographic variation, and limited standardization, which complicate the application of both traditional NLP tools and off-the-shelf LLMs. Through experiments using annotated and non-annotated ground truth data, we demonstrate that while conventional NLP methods often reach their limits on such low-resource, highly variable texts, LLMs provide complementary capabilities that can support narratological insights, especially in tracking persons and their interactions, albeit with important caveats regarding accuracy and coverage.
Democratic resilience is as much about the narratives of our nation we affirm, as the institutions that enshrine our values and laws, a fact re-affirmed by scholarship across many branches of social science in recent decades. For policymakers and quantitative social scientists, analysing or tracking public discourse through the lens of narrative and framing has historically involved the annotation of texts by hand, placing severe limitations on the scale and modality of discourse under inquiry. Yet, a revolution is at hand—a transformer revolution: first arising in computer science, and now enabling a new kind of automated narrative analysis at scale, transformers are opening up new horizons for the tracking of public narratives of democratic resilience. Here, we: formulate a conceptual framework linking computational language methods to democratic resilience analysis; introduce transformer-based artificial intelligence (AI) methods as a third wave in natural language processing technology; and demonstrate two practical applications of transformer methods to democratic narrative analysis. Finally, we conclude by contributing data and research recommendations which flow naturally from the opportunities unlocked by transformer methods for public stakeholders who wish to see these opportunities realised. Together, we suggest that, perhaps for the first time, the “holy grail” of the quantitative social scientist is near: the ability to identify, accurately, and efficiently, nuanced narratives in text, at scale.
Women politicians report that social media abuse harms their personal and professional lives. However, prior text-based research finds that men receive more general online hostility than women – except among the most visible politicians. I hypothesize that backlash to perceived gender-role violations – such as public visibility – will include distinctly gendered content, such as slurs and references to appearance. Using a novel and replicable method, I analyze hostile and gendered language in three million social media mentions of US state representatives. I find that hostility towards visible women differs from men in content, not volume. Visible women face similar volumes of generic hostility but twice as much gender-specific abuse as men. This pattern holds across two alternate measures of perceived conformity to traditional gender roles: legislator tone and the presence of women in the chamber. Incorporating gendered content into text-based analyses reconciles discrepancies between observational and self-reported data and validates women politicians’ reports.
The rise of health care AI raises concerns over whether patent disclosure supports reproducibility and legal validity. This study analyzes 865 granted medical AI patents (2015–2025) from the US, China, and the EU using a five-dimensional framework (algorithm transparency, training data accessibility, model reproducibility, result verifiability, and mathematical support) implemented through NLP-assisted expert scoring. Results suggest limited technical transparency; approximately 40% of patents score zero in at least two dimensions. Performance varies significantly: algorithm transparency is relatively strong (>60% score 2), while training data accessibility is less prevalent (4.6% score 2) and mathematical support is frequently omitted (39.4% score 0). Statistical testing indicates US patents significantly outperform Chinese patents (p < 0.001), while EU results remain exploratory (N = 31, mean 6.2). These patterns appear associated with institutional factors, strategic applicant behaviour, and technical complexity. Such limitations may pose risks to enforceability and market development, highlighting the need for targeted disclosure improvements. This study contributes a replicable framework for translating legal standards into measurable indicators, providing cross-jurisdictional evidence to guide examination, litigation, and policy refinement in medical AI governance.
Advances in content analysis present significant opportunities for social scientists who develop and analyze concepts. This chapter introduces some basic approaches for formalizing and sharing conceptual frameworks (i.e., sets of terms, classes, properties, etc.) and demonstrates some dividends of such formalization for both scholars and their audiences in the field of comparative law. Specifically, the chapter describes an experiment in systematizing the concepts that represent ideas in national constitutions using a set of methods proposed for modern web design. In general, these machine-friendly approaches to concepts – which may be summarized as “digital semantics” – represent a natural extension of traditional concept analysis, much of which is focused on coordinating vocabulary among scholars. Since “concepts about concepts” can themselves be opaque, a glossary with key terms is appended.
Construction safety inspections typically involve a human inspector identifying safety concerns on-site. With the rise of powerful vision language models (VLMs), researchers are exploring their use for tasks such as detecting safety rule violations from on-site images. However, there is a lack of open datasets to comprehensively evaluate and further fine-tune VLMs in construction safety inspection. Current applications of VLMs use small, supervised datasets, limiting their applicability in tasks they are not directly trained for. In this article, we propose the ConstructionSite 10 k, featuring 10,000 construction site images with annotations for three inter-connected tasks, including image captioning, safety rule violation visual question answering (VQA), and construction element visual grounding. Our subsequent evaluation of current state-of-the-art large pre-trained VLMs shows notable generalization abilities in zero-shot and few-shot settings, while additional training is needed to make them applicable to actual construction sites. This dataset allows researchers to train and evaluate their own VLMs with new architectures and techniques, providing a valuable benchmark for construction safety inspection.
This article examines the use of neural networks in electromechanical sound art and music, where sound is materially enacted through physical means such as motors, solenoids, and physical resonators. It begins with a survey of documented works, outlining a range of current strategies and discussing how technical, material, and performative factors influence their design. Identifying natural language processing as underexplored in this domain, a practice-based case study, Seven Studies for Electric Motors, develops one such language-based approach. The project embeds a small language model for real-time sentence generation, extracts syntax structures, and translates these into patterns of motor-driven sound. Taken together, the survey and case study offer a picture of how machine learning has been integrated into electromechanical practices over the past decade and point to possible directions for further work.
Manual submission of clinical trial data to the ClinicalTrials.gov registry is labor-intensive and error-prone, contributing to variability in the completeness and consistency of registry entries. To explore whether recent advances in large language models could support this process, we developed ChatCT, a pilot retrieval-augmented system that drafts ClinicalTrials.gov registry elements.
Methods:
We evaluated ChatCT-generated registry elements across three dimensions: 1. semantic similarity to the public ClinicalTrials.gov record, 2. formatting compliance with ClinicalTrials.gov requirements, and 3. coverage of key trial biomedical concepts.
Results:
ChatCT-generated registry elements were highly semantically similar to human-authored ClinicalTrials.gov records (median BERTScore F1 ≈ 0.82). Formatting compliance was high for structured elements, including Study Design (91% of required fields present; mean completeness 0.897) and Arms/Interventions (75%; 0.772), while narrative sections showed greater variability, including Outcome Measures (79%; 0.929) and Study Description (57%; 0.784). Ontology-based concept extraction and matching demonstrated consistently high precision, with scores ranging from 90% to 100%.
Conclusions:
A retrieval-augmented large language model can generate ClinicalTrials.gov registry drafts that preserve essential protocol details and adhere to most formatting requirements. However, light post-processing (e.g., automated schema validation) remains necessary for full submission readiness. This proof-of-concept evaluation suggests that ChatCT-assisted drafting could support registry reporting by improving consistency between protocol documents and publicly reported trial information.
Comorbid obsessive–compulsive disorder (OCD) or obsessive–compulsive symptoms (OCS) are common in people with severe mental illness (SMI; including schizophrenia, bipolar disorder and schizoaffective disorder), with little known about associations with smoking.
Aims
To estimate the association between OCD/OCS and smoking status among people with SMI in a huge electronic database.
Method
Using the Clinical Records Interactive Search (CRIS) platform for data of service users in the South London and Maudsley (SLaM) NHS Foundation Trust, tobacco smoking status was retrospectively detected through an algorithm of natural language processing technique, categorising into ‘current smoker’, ‘ex-smoker’ and ‘non-smoker’ by the clinical notes of SMI individuals during 2007–2015. A hierarchical assignment rule was applied following the order of ‘smoker’, ‘ex-smoker’ and then ‘non-smoker’ in an individual. Logistic regression was used to examine the association between smoking and OCS in people with SMI for univariable and multivariable analyses.
Results
We identified 15 479 SMI individuals (56% male; mean age 41 years old), with 90.4% ever smoked. Among them, 2320 (15%) had OCS (without OCD), while 2174 (14%) had a clinical diagnosis of comorbid OCD. After adjusting for demographics and functional status as confounders, both SMI individuals with OCS only and an OCD diagnosis were significantly more likely to have ever smoked (adj. odds ratio 1.47, 95% CI 1.23, 1.76 and adj. odds ratio 1.33, 95% CI 1.11, 1.60, respectively) compared with those without OCD/OCS.
Conclusions
In this large-scale analysis of people with SMI, we found that individuals with OCS or OCD were more likely to have ever smoked.
Emphasizing how and why machine learning algorithms work, this introductory textbook bridges the gap between the theoretical foundations of machine learning and its practical algorithmic and code-level implementation. Over 85 thorough worked examples, in both Matlab and Python, demonstrate how algorithms are implemented and applied whilst illustrating the end result. Over 75 end-of-chapter problems empower students to develop their own code to implement these algorithms, equipping them with hands-on experience. Matlab coding examples demonstrate how a mathematical idea is converted from equations to code, and provide a jumping off point for students, supported by in-depth coverage of essential mathematics including multivariable calculus, linear algebra, probability and statistics, numerical methods, and optimization. Accompanied online by instructor lecture slides, downloadable Python code and additional appendices, this is an excellent introduction to machine learning for senior undergraduate and graduate students in Engineering and Computer Science.