G01 · METHOD · uncertainty-quantificationGCRI dossier · service level R0
GCRIWater NexusEstablished
Method page · Uncertainty quantification and model validation

Uncertainty quantification and model validation in water

Uncertainty quantification is what makes the evidence honest: every modelled value on this platform carries a range, a label and the assumptions behind it, so a decision-maker can see how much weight it bears.

Publisher
The Global Centre for Risk and Innovation
Field
Water, Climate and hazards, Critical infrastructure
Status
Established
Service level
R0: information and enquiries
Research workbench, illustrative interfaceAn illustrative research workbench: a compound drought and heat scenario with an observed history and a scenario range, a model card listing method, version, inputs, uncertainty and review, and three policy options compared side by side.SCENARIOCompound drought and heatWATER · ENERGY · HEALTH · ILLUSTRATIVEMODELLED1007550250T0T+1T+2T+3T+4T+5NOWOBSERVEDSCENARIO RANGEGRID STRESS INDEX · PLACEHOLDERMODEL CARDMETHODCoupled hydro-energyVERSIONv2.1INPUTSVersioned sourcesUNCERTAINTYEnsemble rangeREVIEWDomain reviewPOLICY OPTIONSDemand response01Reservoir rules02Hospital backup03

Water NexusWireframe of the working environment, not a live screen. Names and values are placeholders.

STEM methods
9
Canonical methods this field applies
Topics
8
Subject pages in the field
Counterparts
10
Platforms in shared fields at GCRI, GRF and GRA
Report series
3
Nexus Reports series it contributes to
01Application

Uncertainty quantification and model validation in water, climate and hazards and critical infrastructure.

Uncertainty quantification and model validation characterise how uncertainty in inputs, parameters and model structure affects predictions. They establish how much confidence a model’s outputs deserve. In water, climate and hazards and critical infrastructure, uncertainty quantification shows where risk estimates are robust and where they are fragile. It guides where better data or models would change decisions. The canonical description is on the STEM Commons.

Ensemble and parameter uncertainty

Models are run across parameter sets and forcing ensembles; the spread is reported as the range, not collapsed to a mean.

Propagation through the cascade

Uncertainty in inflow is carried into storage, generation, treatment and health effects, so the final range reflects every step.

Evidence labelling

Each value is labelled observed, official, modelled, estimated, forecast or unknown, and the label travels with the value into every figure and table.

02Field

Water Nexus on the map.

Where this page’s subject sits in the world: boundaries and context now, the field layers when the interactive map loads.

Field · world viewDesign figure until live
World map, Equal Earth projectionLand and country boundaries from Natural Earth at 1:110 million, drawn in the Equal Earth projection with a fifteen degree graticule. The interactive map with its layers loads through the Nexus Foundry plugin.
GCRI · Water Nexus · fieldDESIGN FIGURE

MapWorld map in the Equal Earth projection, land and boundaries from Natural Earth (public domain). The interactive map loads through the Nexus Foundry plugin (globe or flat view).

03Canvas

The method as a run graph.

Data from the source register feeds the methods; calibration and an independent test gate the estimate and its limits; the decision stays with the competent authority.

Method canvas · Uncertainty quantification and model validation as applied hereDesign, not a record
Uncertainty quantification and model validation in Water Nexus: the method as a run graphData from the source register feeds the methods; calibration and an independent test gate the estimate and its limits; the decision stays with the competent authority. Design of the method’s use, not a record of a run.runs / water-nexus / stem / uncertainty-quantificationDESIGN RUN+−FITPLAYLAYOUT · LRSOURCE REGISTERUNCERTAINTY QUANTIFICATION AND MODEL VALIDATIONVALIDATIONOUTPUTSAUTHORITYObservational…DATASETsource registerlabel carriedDONEModel ensemblesDATASETsource registerlabel carriedDONEExpert elicitati…DATASETsource registerlabel carriedDONEExperimental dataDATASETsource registerlabel carriedDONESensitivity anal…MODELUncertainty…assumptions statedRUNNINGMonte Carlo…MODELUncertainty…assumptions statedDONESurrogate modell…MODELUncertainty…assumptions statedDONEBayesian calibra…MODELUncertainty…assumptions statedDONECalibrationGATEfit on one periodtest on anotherGATEIndependent testGATEheld-out dataskill reportedQUEUEDEstimate with ra…DATASETuncertainty attachedlabel: MODELLEDQUEUEDLimits statementTASKwhat it cannot sayversionedQUEUEDDecisionDECISIONcompetent authorityunder its own rulesAUTHORITYRUN TIMELINE · ONE APPLICATIONDataFitTestEstimateDecideObservational…Model ensemblesExpert elicitationExperimental dataSensitivity analysisMonte Carlo…Surrogate modellingNOWINSPECTOR · SELECTED NODECalibration · gateOWNERWater Nexus · method stewardINPUTS4 method runsCHECKPredictive distributions are tested for calibration and…EVIDENCEskill on the test period onlyUNLOCKSindependent test

Fig. 01Nodes carry their type, metrics and state; connectors show what feeds what; the gates are the validation steps; the timeline is one application. Design of the method’s use, not a record of a run.

04Data

What the method consumes.

Datasets and records used by uncertainty quantification and model validation on this platform, with the role each plays and the label its values carry. Sources are listed in the source register.

DataRoleLabel
Model ensemblesSpread and sensitivityMODELLED
Observation error estimatesInput uncertaintyESTIMATED
Expert elicitationWhere no data existESTIMATED
05Validation

How results are checked.

Predictive distributions are tested for calibration and sharpness against held-out observations. Verification confirms that code solves the intended equations.

CheckHow it is done
Sensitivity analysisThe inputs that drive most of the output range are identified and reported
Calibration of probabilitiesStated probabilities are checked against outcomes where a record exists
Label auditA sample of published values is traced back to the evidence behind its label

Structural uncertainty and unknown unknowns are difficult to represent. Computational cost limits exploration of high-dimensional models.

07Stewardship

Who maintains the method.

Systems Science and Modelling stewards uncertainty quantification and model validation for the Consortium and reviews how it is applied across platforms.

08Connected

Where this page leads across the Consortium.

LinkRelationshipWhy
Uncertainty quantification and model validationCanonical method pagePlatform application links to the canonical method page.
Uncertainty quantification and model validation in systems science and modellingSteward platformSystems Science and Modelling stewards this method.
09Questions

Questions and answers.

What are the limits of uncertainty quantification and model validation in this field?
Structural uncertainty and unknown unknowns are difficult to represent. Computational cost limits exploration of high-dimensional models.
How are results checked?
Predictive distributions are tested for calibration and sharpness against held-out observations. Verification confirms that code solves the intended equations.
Are the values on this page real?
The data names, roles and checks are real descriptions of practice. The canvas shows a design of the method’s use, not a run; no result is reported here.
Where else is this method applied?
The canonical method page lists every platform that applies it.
Water Nexus

Bring your expertise to this field.

The current service level is R0: information and enquiries. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

Have questions?