Hostname: page-component-76d6cb85b7-6jg5l Total loading time: 0 Render date: 2026-07-17T13:22:02.648Z Has data issue: false hasContentIssue false

Interpretable machine learning for CMIP6 multi-model ensembles

Published online by Cambridge University Press:  15 July 2026

Siyi Wu*
Affiliation:
University of Toronto, Canada
Steve M. Easterbrook
Affiliation:
University of Toronto, Canada
*
Corresponding author: Siyi Wu; Email: reyna.wu@mail.utoronto.ca

Abstract

Multi-model ensembles are widely used in climate science, yet Coupled Model Intercomparison Project Phase 6 (CMIP6) models are neither independent nor equally skillful. We present a framework for interpretable ensemble learning that improves prediction while making model contributions explicit. Using monthly CMIP6 near-surface temperature and precipitation (1948–2014) against ERA5, we compare arithmetic multi-model ensemble (AMME) averaging with Ridge regression, random forest, and a continuous gating mixture that adaptively interpolates between them. On held-out test years (2006–2014), gating achieves the best temperature performance and improves precipitation distributional behavior relative to both AMME and individual learners. We trace these gains back to individual models and space: dominant-cluster and dominant-model maps show that gating reallocates trust in regionally coherent patterns rather than collapsing to a single best model, while entropy-based diagnostics quantify where trust is concentrated versus distributed. These analyses provide a practical pathway for transparent ensemble learning that supports both predictive skill and scientific accountability.

Information

Type
Application Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press
Figure 0

Table 1. Average silhouette scores for k$ k $-means clustering of CMIP6 models based on climatological mean temperature and precipitationTable 1. long description.

Figure 1

Figure 1. Clustering of CMIP6 models based on climatological mean temperature (left) and precipitation (right), using k$ k $-means with k=4$ k=4 $. Models are ordered by their climatological temperature value on the shared y-axis, so that color changes at the same y-position (between the two panels) indicate that a model’s cluster assignment differs between the two variables. The red dashed line indicates the ERA5 climatological mean. Colors indicate cluster membership (consistent with all subsequent figures).Figure 1. long description.

Figure 2

Table 2. Global prediction performance for near-surface temperature (tas) on the test period 2006–2014Table 2. long description.

Figure 3

Table 3. Global precipitation prediction performance on the test period 2006–2014Table 3. long description.

Figure 4

Table 4. Stability of global temperature RMSE across n=10$ n=10 $ random seedsTable 4. long description.

Figure 5

Figure 2. Global mean near-surface temperature time series and test-period comparison. (a) All 25 CMIP6 model time series color coded by normalized Ridge regression weight: red indicates high positive weight, blue indicates negative or near-zero weight. ERA5 is shown in black. Training/validation/test periods are delineated by vertical dashed lines. (b) Same time series color coded by RF variable importance (yellow = low, red = high). (c) Predicted vs. observed global mean temperature for AMME (dashed pink) and Gating (solid red) on the test period 2006–2014. Ridge and Gating closely track ERA5, while AMME exhibits a systematic warm bias.Figure 2. long description.

Figure 6

Table 5. Top ten CMIP6 models by global Ridge weight for temperature, together with their cluster assignment (consistent with the fixed-seed clustering reported in Section 3)Table 5. long description.

Figure 7

Figure 3. (a) Normalized Ridge regression weights (blue) and RF variable importances (orange) for all 25 CMIP6 models, sorted by Ridge weight. The dashed gray line shows the uniform AMME weight (1/25). (b) Scatter of normalized Ridge weight vs. RF importance per model (Pearson r=0.52$ r=0.52 $). Models above the diagonal are more trusted by RF than Ridge; the six models with RF importance >2×$ >2\times $ Ridge weight are labeled. The partial agreement indicates that the two learners identify overlapping but non-identical sets of informative models.Figure 3. long description.

Figure 8

Figure 4. (Left) Dominant CMIP6 model cluster per grid cell, defined by the cluster whose models receive the highest mean per-model gating weight. (Right) Dominant individual CMIP6 model per grid cell, defined by the model with the maximum average gating weight. Results show strong spatial structure in ensemble trust, with different clusters and models preferred across distinct dynamical regimes. Cluster IDs: 0 = MIROC family (2 models), 1 = large mid-bias group (14 models), 2 = HadGEM–UKESM family (3 models), 3 = CMCC–GISS-H group (6 models).Figure 4. long description.

Figure 9

Figure 5. Dominant cluster (left column) and trust entropy (right column) for Ridge (top), RF (middle), and Gating (bottom). Ridge maintains high entropy (mean Neff=21.1$ {N}_{\mathrm{eff}}=21.1 $) with a spatially smooth multi-cluster pattern. RF is more concentrated (mean Neff=13.4$ {N}_{\mathrm{eff}}=13.4 $), with stronger Cluster-0 (MIROC) dominance in the tropics. Gating achieves an intermediate Neff=19.5$ {N}_{\mathrm{eff}}=19.5 $, selectively concentrating trust in regions where RF’s nonlinear predictions are locally superior.Figure 5. long description.

Figure 10

Figure 6. Spatial distribution of the time-mean gate value $ \overline{g} $ (per pixel). Red ($ \overline{g} $ near 1) indicates Ridge-dominated pixels; blue ($ \overline{g} $ near 0) indicates RF-dominated pixels. Overall, 55% of pixels are Ridge-dominated and 45% are RF-dominated. RF dominance is concentrated in tropical oceans and the Southern Ocean, which also exhibit the strongest skill improvement relative to AMME (Figure 7).Figure 6. long description.

Figure 11

Figure 7. Spatial distribution of skill improvement of the gating ensemble relative to AMME for near-surface temperature (test period 2006–2014). The diverging colormap is centered at zero (white), with red indicating improvement and blue indicating degradation relative to AMME. Positive values indicate regions where gating reduces RMSE compared to the arithmetic ensemble. Strong improvements occur over tropical oceans and parts of the Southern Hemisphere; small degradations occur over some continental interiors and high-latitude land areas.Figure 7. long description.

Figure 12

Figure 8. Spatial distribution of trust dispersion under the Gating ensemble, measured as (a) trust entropy H$ H $ and (b) effective ensemble size Neff=expH$ {N}_{\mathrm{eff}}=\exp (H) $ [mean =19.5$ =19.5 $ models]. Higher values indicate more evenly distributed trust (larger effective ensemble size), while lower values indicate strong concentration on a small subset of models. For comparison, Ridge yields mean Neff=21.1$ {N}_{\mathrm{eff}}=21.1 $ and RF yields mean Neff=13.4$ {N}_{\mathrm{eff}}=13.4 $; see Figure 5 for side-by-side entropy maps of all three methods.Figure 8. long description.

Figure 13

Figure 9. (a) Temporal evolution of the global gating weight gt$ {g}_t $ over the test period 2006–2014. Blue shading indicates Ridge-dominated months (gt>0.5$ {g}_t>0.5 $); yellow shading indicates RF-dominated months (gt<0.5$ {g}_t<0.5 $). The red curve shows a 12-month rolling mean; the dotted horizontal line shows the global mean g¯=0.685$ \overline{g}=0.685 $. (b) Seasonal distribution of gt$ {g}_t $: MAM is strongly Ridge-dominated (mean 0.873), while DJF shows the greatest RF contribution (mean 0.592). Boxplots show the interquartile range and outliers across individual months within each season.Figure 9. long description.