Emergency department (ED) visits for epilepsy are common, costly, and often clinically unnecessary. Configuration of care pathways (CPs) that could divert people away from ED offer an alternative. The aim was to measure patient and carer preferences for alternative CPs and to explore the feasibility of implementing the preferred CPs in the National Health Service (NHS) England with a wider group of stakeholders.

Formative work (provider survey, service-user interviews, knowledge exchange, and think-aloud piloting) informed a discrete choice experiment (DCE) with six attributes: access to care plan, conveyance, time, epilepsy specialist today, general practitioner (GP) notification, and epilepsy specialist follow-up. This was hosted online with random assignment to two of three scenarios (home, public, or atypical). Logistic regression generated preference weights that were used to calculate the utility of CPs. The highest ranked CPs plus a status quo were discussed at three online knowledge exchange workshops. The nominal group technique was used to ascertain stakeholder views on preference evidence and to seek group consensus on optimal feasible alternatives.

A sample of 427 people with epilepsy and 167 friends or family completed the survey. People with epilepsy preferred paramedics to have access to care plan, non-conveyance, one to three hours, epilepsy specialists today, GP notification, and specialist follow-up within two to three weeks. Family and friends differed when considering atypical seizures, favoring conveyance to urgent treatment centers and shorter time. Optimal configuration of services from service users’ perspectives outranked current practice. Knowledge exchange (n=27 participants) identified the optimal CP as feasible but identified two scenarios for resource reallocation: care plan substitutes specialist advice today and times of strain on NHS resources.

Preferences differed to current practice but had minimal variation by seizure type or stakeholder. This study clearly identified optimal and feasible alternative CPs. The mixed-methods approach allowed for robust measurement of preferences, whilst knowledge exchange examined feasibility to enhance implementation of optimal alternative CPs in the future.

Detailed, precise information on a pharmaceutical’s projected therapeutic use is required for horizon scanning. Inferring an estimated indication from trial protocols is a key skill of horizon scanners. The International Horizon Scanning Initiative (IHSI) database utilizes semi-automated data collection. This pilot aimed to verify that the extraction of relevant word sets to generate an estimated indication could be semi-automated.

Ten drugs approved in Europe in 2021 were selected as the pilot test set. The test set included drugs approved for the treatment of rare diseases (n=4), haemato-oncology (n=3), and non-oncology conditions (n=3). Eight of the drugs were approved based on phase III trials. The assessment comprised a review of the pivotal trial that supported product registration for these drugs. We undertook a comparison between a human curator and a natural language processing (NLP) algorithm in generating granular tags relating to key aspects of the drugs’ estimated indication (stage of disease, patient-specific subgroup, and place in treatment).

In 50 percent of cases, the NLP accurately tagged a word or word set related to stage of disease, patient-specific subgroup, or place in treatment, which was also tagged by human curators. In 50 percent of cases, the NLP did not identify words or word sets tagged by human curators. Where relevant, the NLP successfully tagged the same word sets relating to stage of disease for all drugs in the test set. The same word sets relating to patient-specific subgroup were successfully tagged for three drugs in the set. NLP successfully tagged word sets relating to place in treatment for two drugs.

The NLP algorithm is successful in extracting relevant word sets, which can be used to generate an estimated indication in an automated or semi-automated process. The pilot highlighted that further testing is required to advance the sensitivity of the algorithm. Further piloting exploring both unsupervised and supervised modeling approaches (named entity recognition and deep neural networks, respectively) is planned.

Patients with hematological malignancies are at high risk of infections due to both the disease and the associated treatments. The use of immunoglobulin (Ig) to prevent infections is increasing in this population, but its cost effectiveness is unknown. This trial-based economic evaluation aimed to compare the cost effectiveness of prophylactic Ig with prophylactic antibiotics in patients with hematological malignancies.

The economic evaluation used individual patient data from the RATIONAL feasibility trial, which randomly assigned 63 adults with chronic lymphocytic leukemia, multiple myeloma, or lymphoma to prophylactic Ig or prophylactic antibiotics. The following two analyses were conducted to estimate the cost effectiveness of the two treatments over the 12-month trial period from the perspective of the Australian health system:

(i) a cost-utility analysis (CUA) to assess the incremental cost per quality-adjusted life-year (QALY) gained using data collected with the EuroQol 5D-5L questionnaire; and

(ii) a cost-effectiveness analysis (CEA) to assess the incremental cost per serious infection prevented (grade ≥3) and per infection prevented (any grade).

The total cost per patient was significantly higher in the Ig arm than in the antibiotic arm (difference AUD29,140 [USD19,000]). There were non-significant differences in health outcomes between the treatment arms: patients treated with Ig had fewer QALYs (difference −0.072) and serious infections (difference −0.26) than those given antibiotics, but more overall infections (difference 0.76). The incremental cost-effectiveness from the CUA indicated that Ig was more costly than antibiotics and associated with fewer QALYs. In the CEA, Ig costed an additional AUD111,262 (USD73,000) per serious infection prevented, but it was more costly than antibiotics and associated with more infections when all infections were included.

These results indicate that, on average, Ig prophylactic treatment may not be cost effective compared with prophylactic antibiotics for the group of patients with hematological malignancies recruited to the RATIONAL feasibility trial. Further research is needed to confirm these findings in a larger population and over the longer term.

Detail on a technology’s projected therapeutic use is required for horizon scanning. The International Horizon Scanning Initiative (IHSI) database will utilize natural language processing (NLP) augmented by human curation to generate an estimated indication for technologies in development. We compared the estimated indication, generated as a test-set for NLP, with health technology developers’ (HTDs) proposed indications identified from Ireland’s horizon scanning system (HSS).

Eight oncology technologies common to both Ireland’s HSS and the IHSI database were analyzed. The analysis included unlicensed technologies in late-stage development that have not submitted a European marketing authorization application. Ireland’s HSS receives data on proposed indications for technologies from HTDs. IHSI database curators extract and convert terms from clinical trials into structured inputs (condition, combination therapy, stage of disease, place in treatment, patient/disease-specific subgroups) to produce an estimated indication for a technology. We sought to identify, by structured input, the degree of alignment between HTDs’ proposed indications with the IHSI database’s estimated indication.

There was 100 percent alignment between the HTD’s proposed indication and the estimated indication generated in the IHSI database for five of the eight included technology records. There was 83 percent alignment for two records and 67 percent alignment for one record. Across all records there was full alignment on condition, combination therapy details, patient-specific subgroup, disease-specific subgroup, and place in treatment. Stage of disease was the only element where data was either not generated for the IHSI database’s estimated indication, not aligned with the HTD’s proposed indication, or reported in an incorrect field.

There is a high degree of alignment between an HTD-proposed indication and the IHSI-estimated indication. The processes for generating an estimated indication will involve both NLP-generation and human co-curation. The current (curator-selected) elements are being used to train the NLP engine. Thereafter, the engine will process clinical trial data to surface tags for human selection to generate the structured inputs.

Inappropriate diagnosis and treatment of urinary tract infections (UTIs) contribute to antibiotic overuse. The Inappropriate Diagnosis of UTI (ID-UTI) measure uses a standard definition of asymptomatic bacteriuria (ASB) and was validated in large hospitals. Critical access hospitals (CAHs) have different resources which may make ASB stewardship challenging. To address this inequity, we adapted the ID-UTI metric for use in CAHs and assessed the adapted measure’s feasibility, validity, and reliability.

Retrospective observational study

10 CAHs

From October 2022 to July 2023, CAHs submitted clinical information for adults admitted or discharged from the emergency department who received antibiotics for a positive urine culture. Feasibility of case submission was assessed as the number of CAHs achieving the goal of 59 cases. Validity (sensitivity/specificity) and reliability of the ID-UTI definition were assessed by dual-physician review of a random sample of submitted cases.

Among 10 CAHs able to participate throughout the study period, only 40% (4/10) submitted >59 cases (goal); an additional 3 submitted >35 cases (secondary goal). Per the ID-UTI metric, 28% (16/58) of cases were ASB. Compared to physician review, the ID-UTI metric had 100% specificity (ie all cases called ASB were ASB on clinical review) but poor sensitivity (48.5%; ie did not identify all ASB cases). Measure reliability was high (93% [54/58] agreement).

Similar to measure performance in non-CAHs, the ID-UTI measure had high reliability and specificity—all cases identified as ASB were considered ASB—but poor sensitivity. Though feasible for a subset of CAHs, barriers remain.

In response to the COVID-19 pandemic, we rapidly implemented a plasma coordination center, within two months, to support transfusion for two outpatient randomized controlled trials. The center design was based on an investigational drug services model and a Food and Drug Administration-compliant database to manage blood product inventory and trial safety.

A core investigational team adapted a cloud-based platform to randomize patient assignments and track inventory distribution of control plasma and high-titer COVID-19 convalescent plasma of different blood groups from 29 donor collection centers directly to blood banks serving 26 transfusion sites.

We performed 1,351 transfusions in 16 months. The transparency of the digital inventory at each site was critical to facilitate qualification, randomization, and overnight shipments of blood group-compatible plasma for transfusions into trial participants. While inventory challenges were heightened with COVID-19 convalescent plasma, the cloud-based system, and the flexible approach of the plasma coordination center staff across the blood bank network enabled decentralized procurement and distribution of investigational products to maintain inventory thresholds and overcome local supply chain restraints at the sites.

The rapid creation of a plasma coordination center for outpatient transfusions is infrequent in the academic setting. Distributing more than 3,100 plasma units to blood banks charged with managing investigational inventory across the U.S. in a decentralized manner posed operational and regulatory challenges while providing opportunities for the plasma coordination center to contribute to research of global importance. This program can serve as a template in subsequent public health emergencies.

Asymptomatic bacteriuria (ASB) treatment is a common form of antibiotic overuse and diagnostic error. Antibiotic stewardship using the inappropriate diagnosis of urinary tract infection (ID-UTI) measure has reduced ASB treatment in diverse hospitals. However, critical access hospitals (CAHs) have differing resources that could impede stewardship. We aimed to determine if stewardship including the ID-UTI measure could reduce ASB treatment in CAHs.

From October 2022 to July 2023, ten CAHs participated in an Intensive Quality Improvement Cohort (IQIC) program including 3 interventions to reduce ASB treatment: 1) learning labs (ie, didactics with shared learning), 2) mentoring, and 3) data-driven performance reports including hospital peer comparison based on the ID-UTI measure. To assess effectiveness of the IQIC program, change in the ID-UTI measure (ie, percentage of patients treated for a UTI who had ASB) was compared to two non-equivalent control outcomes (antibiotic duration and unjustified fluoroquinolone use).

Ten CAHs abstracted a total of 608 positive urine culture cases. Over the cohort period, the percentage of patients treated for a UTI who had ASB declined (aOR per month = 0.935, 95% CI: 0.873, 1.001, P = 0.055) from 28.4% (range across hospitals, 0%-63%) in the first to 18.6% (range, 0%-33%) in the final month. In contrast, antibiotic duration and unjustified fluoroquinolone use were unchanged (P = 0.768 and 0.567, respectively).

The IQIC intervention, including learning labs, mentoring, and performance reports using the ID-UTI measure, was associated with a non-significant decrease in treatment of ASB, while control outcomes (duration and unjustified fluoroquinolone use) did not change.