Skip to content

GCRI · 系统科学与建模

不确定性与验证

A model result is useful only when its uncertainty is stated and its fitness for a purpose has been tested. Verification checks that the code solves the equations intended; validation checks that the model represents the real system well enough for the decision at hand. This page sets out how uncertainty is quantified and models are verified and validated, and what evidence serves the decision makers who rely on model results.

01画布

工作如何开展。

系统 · 围绕本主题示意

耦合模型运行器

Uncertainty and validation · Coupled model A · Scenario set 3

集合运行中GCRI · 系统科学与建模

模型耦合图

节点:模型 · 边:交换的变量

耦合组件

水文学1 day径流是
电力系统1 h需求,停运是
经济1 个季度产出,价格部分
人口1 year暴露是

集合输出

Coupled model runner: the screen’s structure, terms and states for Uncertainty and validation.示例名称和示意数值;是设计方案,并非记录或实时系统。

图Coupled model runner: example names and illustrative values, not a record or a live system.

02问题

Uncertainty and validation: how the risk develops.

Quantifying uncertainty, validation against observations and the limits of calibration. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

机制

Verification precedes validation

Before asking whether a model matches reality, modellers check that the code is correct, through tests, convergence studies and comparison with known solutions.

机制

Validation is purpose-specific

A model valid for one question may be invalid for another. Validation is judged against the accuracy a specific decision needs.

机制

Uncertainty has several sources

Input data, parameters, model structure, numerical error and natural variability each contribute, and each needs a different treatment.

机制

Calibration can hide error

Tuning parameters to match past data can make a model fit for the wrong reasons, so validation needs data not used in calibration.

03地理

北美的危害与暴露。

Flood water, population density and night lights over North America, from NASA GIBS. Each layer carries its own date.

交互式地图需要JavaScript;图层列表和来源见下文。

图层 3

本页面的危害与暴露

关于本图层
证据
观测(云层造成缺口)
来源
VIIRS 全球洪水产品(NASA LANCE)
提供方
NASA LANCE
许可协议
NASA 开放数据
年份版本
每日;卫星探测;云层造成缺口
构建时的最新内容
2026-10-14
处理结果
约 250 米网格
不确定性
卫星探测;云层造成缺口。卫星或模型栅格数据,按提供方发布的原样呈现。云层、条带缺口和反演误差会造成缺口和噪声;数值是指标,而非某地的测量值。
经由以下途径到达
gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
证据
估计值
来源
世界网格化人口 v4.11(NASA SEDAC(哥伦比亚大学 CIESIN))
提供方
NASA SEDAC(哥伦比亚大学 CIESIN)
许可协议
CC BY 4.0
年份版本
null;基于人口普查的估算,静态(2020)
处理结果
约 1 公里网格
不确定性
基于人口普查的 2020 年每平方公里人口估算,作为风险暴露背景展示;不是受任何危害影响的人数。
经由以下途径到达
gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
证据
观测
来源
VIIRS Black Marble(VNP46A2)(NASA LAADS DAAC)
提供方
NASA LAADS DAAC
许可协议
NASA 开放数据
年份版本
每日;卫星辐射亮度,已校正月光和大气影响
构建时的最新内容
2026-10-12
处理结果
约 500 米网格
不确定性
所示日期的卫星夜间辐射亮度;灯光是用电和停电的替代指标,并非对供应或获得电力情况的测量。
经由以下途径到达
gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
证据
观测
来源
VIIRS NOAA-20 校正反射率(NASA LANCE)
提供方
NASA LANCE
许可协议
NASA 开放数据
年份版本
每日;卫星图像
构建时的最新内容
2026-10-14
处理结果
约 250 米网格
不确定性
卫星图像。卫星或模型栅格数据,按提供方发布的原样呈现。云层、条带缺口和反演误差会造成缺口和噪声;数值是指标,而非某地的测量值。
经由以下途径到达
gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
证据
模型生成(GIBS 发布的最新年份)
来源
MODIS Terra 和 Aqua 土地覆盖(MCD12Q1)(NASA LP DAAC)
提供方
NASA LP DAAC
许可协议
NASA 开放数据
年份版本
每年;卫星分类;GIBS 发布的最新年份
构建时的最新内容
2024-01-01
处理结果
约 500 米网格
不确定性
所示年份的卫星土地覆盖类别,含农田;该分类存在已知误差,并非农场登记册。
经由以下途径到达
gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
证据
观测(云层和过境时间造成缺口)
来源
VIIRS NOAA-20 375 米(FIRMS)(NASA LANCE FIRMS)
提供方
NASA LANCE FIRMS
许可协议
NASA 开放数据
年份版本
每日;卫星探测;云层和过境时间造成缺口
构建时的最新内容
2026-10-13
处理结果
约 500 米网格
不确定性
所示日期的卫星热点探测结果,包括天然气火炬和工业热源;并非已确认的火情、事件报告或预警。
经由以下途径到达
gibs.earthdata.nasa.gov,仅在您允许实时地图后访问

最新可用

NASA GIBS / EOSDIS · ASTER GDEM (METI, NASA) · Blue Marble (NASA) · © OpenStreetMap贡献者 (ODbL) · Natural Earth

正在加载最新的NASA影像。

拖动以移动。按住 Ctrl 或 ⌘ 并滚动、双指缩放或使用按钮缩放;悬停可查看指针下的数值;重置可返回该区域。

危害与风险暴露,以北美为取景。NASA 发布的卫星和模型产品,各带自己的日期。它们是指标,而非对任何地点的评估。

数据:NASA GIBS · ASTER GDEM · Blue Marble · © OpenStreetMap 贡献者 · Natural Earth · NASA EONET · 美国地质调查局 · NASA JPL OPERA DIST-ALERT来源与许可

  • We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS). Colours redrawn from the published colour map; values averaged into hexagonal cells where shown (modified). NASA 开放数据
  • We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS). Colours redrawn from the published colour map; values averaged into hexagonal cells where shown (modified). NASA 开放数据
  • VIIRS 近实时产品(洪水、地表温度、积雪覆盖、校正反射率),NASA LANCE;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
  • Center for International Earth Science Information Network (CIESIN), Columbia University. 2018. Gridded Population of the World, Version 4 (GPWv4): Population Density, Revision 11. NASA Socioeconomic Data and Applications Center (SEDAC). 采用 CC BY 4.0 许可。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 doi:10.7927/H49C6VHW. CC BY 4.0
  • VIIRS Black Marble 夜间灯光,NASA 戈达德航天中心;由 NASA Level-1 与大气档案和分发系统(LAADS DAAC)分发;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
  • MODIS 陆地产品(植被指数、总初级生产力、土地覆盖),NASA LP DAAC 和 LANCE;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
  • NASA 资源管理火灾信息系统(FIRMS),VIIRS 375 m 活跃火点产品,NASA LANCE;矢量瓦片来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
  • ASTER GDEM 是 METI 和 NASA 的产品(ASTER Global Digital Elevation Model V003,NASA LP DAAC);影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。引用格式:NASA/METI/AIST/Japan Spacesystems and U.S./Japan ASTER Science Team (2019). ASTER Global Digital Elevation Model V003. doi:10.5067/ASTER/ASTGTM.003. NASA 开放数据
  • 使用 Natural Earth 制作。免费矢量和栅格地图数据,见 naturalearthdata.com。 公有领域
  • © OpenStreetMap 贡献者(ODbL),经由 NASA GIBS(海岸线、边界、道路和地名)。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 ODbL
  • Blue Marble,NASA Earth Observatory;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
  • 地球仪和平面地图上的背景信息:海岸线、边界、道路和地名来自 NASA GIBS 参考图层(OpenStreetMap 数据,ODbL,© OpenStreetMap contributors);Blue Marble 影像可作为可选底图;3D 地形和高程读数来自 ASTER GDEM 高程色彩指数(5 m 至 200 m 分级,为便于辨识而作了夸张处理)。边界按已发布的样式绘制,不代表对任何领土的立场。
  • 实时事件:NASA Earth Observatory Natural Event Tracker(EONET);事件仅供参考,并保留其原始来源链接。
  • 实时:NASA EONET。事件仅供参考,不是主管机构的预警。
  • 实时:美国地质调查局。事件仅供参考,不是主管机构的预警。
  • Observed (EO): NASA JPL OPERA DIST-ALERT (contains modified Copernicus Sentinel data 2026). We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS).
  • NASA GIBS: We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS).
  • 河流流量预报,30天及区间(GloFAS,经Open-Meteo):包含经修改的Copernicus Emergency Management Service 2026年信息;非洪水警报。
  • 天气数据来自 Open-Meteo.com (https://open-meteo.com/), 依据 CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). 授权。
  • 可选图层(图层列表中有 11 个来源:实时、预报、观测和背景)开启时会在地图上和此处显示其提供方署名;预报是模型输出,派生指数是估计值。

图层与日期

  • 洪水水体,3 日合成:VIIRS 全球洪水产品,NASA LANCE · 2026年10月14日
  • 人口密度,2020 年:人口:哥伦比亚大学 CIESIN,世界网格化人口 v4.11(2018),NASA SEDAC, CC BY 4.0 · 静态
  • 夜间灯光,每日:VIIRS Black Marble(VNP46A2),NASA LAADS DAAC · 2026年10月12日
  • 真彩色:VIIRS NOAA-20 校正反射率,NASA LANCE · 2026年10月13日
  • 土地覆盖类型(IGBP),年度:MODIS Terra 和 Aqua 土地覆盖(MCD12Q1),NASA LP DAAC · 2024
  • 活跃火点与热异常:VIIRS NOAA-20 375 m(FIRMS),NASA LANCE FIRMS · 2026年10月13日

04跨领域

Validation must match the decision each domain faces.

Validation studies are designed for the 方法与技术系列. ASME V&V 40, NASA-STD-7009 and Bayesian calibration (Kennedy and O’Hagan, 2001) set practice; 敏感性分析 is one of the five rules of Saltelli and colleagues (2020).

  • Validation datasets.
  • Documented model failures.
05孪生与级联模拟器

Model uncertainty and validation as a system. Run the cascade.

Assembled from the Nexus Standards area profile 复合与级联危害标准: the hazards it names, the 系统 and sectors that carry the loss, the controls that dampen it and the data that observe it. Choose the components, pick an initiating hazard and step through the cascade. The Map view places the run on an example geography with open data. Every coupling weight is a stated assumption you can change. A teaching model, not a forecast, an assessment or a certification. To model a place of your own choosing, open the full System Builder.

灾害

控制措施

  • NS-0 章程与原则
  • NS-3 风险记录 UNI(语法、旧编码对照、分配机构)
  • NS-9 情境 UNI(部署、实例、计划实例)
  • NS-11 验证与监测(证据、证明、零信任符合性观测)
  • NRS-H61 危害族:级联失效(NHS-1 sys.cascade)
  • NRS-H62 危害类别:复合与多危害事件(NHS-1 sys.compound)
  • NRS-H60 危害类别:供应链与流动中断(NHS-1 sys.supply-chain)
  • NRS-H94 危害族:系统性网络事件(NHS-1 cyber.systemic-cyber)
  • NRS-H107 危害族:数字基础设施集中与单一化(NHS-1 tech.digital-concentration)
  • NRS-H7 危害类别:大尺度环流异常(NHS-1 atmo.climate-mode)

观测

  • Copernicus EMS rapid mapping activations (listed for reference)
  • OpenStreetMap planet and replication (listed for reference)
  • ERA5 再分析(Copernicus Climate Data Store)(仅列作参考)
  • 灾害造成的直接经济损失与全球国内生产总值之比
  • Number of disruptions to basic services attributed to disasters

示例地理范围

  • 孟加拉国:134 个六边形单元
  • 今夜夜间灯光与停电(VIIRS 昼夜波段),NASA GIBS
  • Carbon monoxide, smoke transport (AIRS), NASA GIBS
  • Vegetation disturbance alerts, 30 m (OPERA DIST-ALERT), NASA GIBS
06指标

衡量什么,以及衡量得如何。

每个指标都注明其单位、频率、背后的来源类型以及数值将附带的证据标签。此处不显示数值:数值由计划依据其自身权限提供。

指标单位节奏来源类型标签
Verification tests passedpercent of test suite每次发布Model test records观测
Validation error against independent dataerror metricper validationValidation studies估算
Prediction interval coveragepercent of observations inside stated intervalsper evaluationOut-of-sample evaluation观测
Sensitivity indicesshare of output variance by inputper analysis全球 敏感性分析模型生成
Models with documented credibility assessment计数每次评估Model documentation已声明
Independent reviews completed计数per modelReview records已报告
07方法与证据

How uncertainty and validation is modelled, measured and tested.

模型、其假设、数据和不确定性,以科学家或工程师会核查的形式呈现。结构遵循已发表的方法。所取数值仅为示意,不是研究发现。

模型、方程与假设

The model structure used for uncertainty and validation, the assumptions it makes and how each is tested.

要素 i 的风险Ri = f(Hi, Ei, Vi, Ci)危害、风险暴露、脆弱性和应对能力
预期年度损失EAL = ∑k pk · Lk对年概率为 pk
耦合系统xt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
假设为何制作如何检验
在一次事件中,危害与暴露相互独立使损失积分保持可计算与基于联合记录拟合的 copula 进行比较
耦合在工作点附近是线性的让冲击通过 A 传播在线性范围之外施加扰动并比较
脆弱性曲线可以在不同地点之间迁移使用很少有本地曲线可用在有观测损失的地方据此进行验证
输入
带溯源信息的版本化数据集
成果
分布,绝不是单一数字
代码
连同模型卡和测试一起发布
复现
相同的数据、代码、环境和随机种子
标准的风险与状态空间表述;所列假设是该方法的典型假设,供审查之用,并非结果。
FAIR 指导原则 · GO FAIR 和 FORCE11W3C PROV · 万维网联盟关于一致处理不确定性的指南 · IPCCCEOS 分析就绪数据 · 地球观测卫星委员会
08来源

证据来自何处。

具名公共数据集与机构记录,各自注明许可类别。依协议获得的来源仅按其条款使用,绝不再次发布。

来源它提供什么许可类别
ASME V&V 10, V&V 20 and V&V 40Verification, validation and credibility standardsLicensed standards, purchase required
NASA-STD-7009Credibility assessment of models and simulationsPublic domain, US government
IPCC uncertainty guidance note经校准的不确定性表述Public, IPCC terms
SALib and other open 敏感性分析 librariesImplementations of global sensitivity methodsOpen source, MIT licence
Published validation studies in each fieldEvidence on model performanceLicence per publication
09决定

由谁决定,以及证据服务于什么。

系统 Science and Modelling prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

谁来决定问题本页面服务的证据
Model ownersWhether a model is fit for a stated purposeCredibility assessments; validation reports
Decision makersHow much weight to give model resultsUncertainty statements
Reviewers and auditorsWhether verification and validation were adequateProtocols and review records

该主题产生的产出

  • Verification and validation protocols for network models
  • Uncertainty statements in calibrated language
  • Credibility assessments for models used in decisions
  • Validation reports against independent data
10核心问题

What experts ask about uncertainty and validation.

  • Which sources of uncertainty matter most for the decision at hand?
  • How does uncertainty in inputs and parameters propagate to outputs?
  • What observations can test the model, and are they independent of calibration data?
  • How far beyond the calibration conditions can the model be trusted?
  • How should uncertainty be communicated to people who must act on it?
11机制与驱动因素

Kinds of uncertainty and why calibration is not validation.

Modellers distinguish aleatory uncertainty, the inherent variability of a system, from epistemic uncertainty, which comes from incomplete knowledge and can in principle be reduced. Structural uncertainty, about whether the model’s equations are right, is often the largest and hardest to quantify. 深度不确定性 arises when experts cannot agree even on probability distributions.

Calibration adjusts parameters so that a model matches observations. A well-calibrated model may still be wrong: many parameter combinations can fit the same data, a problem called equifinality, and a model tuned to past conditions may fail under new ones. Validation therefore requires tests against data not used in calibration, and ideally under different conditions.

Validation is purpose-specific. A model may be adequate for estimating averages but not extremes, or for one region but not another.

12方法与数据

方法及其局限。

  1. 01

    敏感性分析

    Identifying which inputs drive output variation. Global methods are computationally demanding.

  2. 02

    Probabilistic propagation

    Monte Carlo and related methods, using 概率与统计. Results depend on assumed input distributions.

  3. 03

    Bayesian calibration

    Updating parameter beliefs with data and representing model discrepancy. Priors and discrepancy models involve judgement.

  4. 04

    Out-of-sample validation

    Testing against independent data, held-out periods or different locations. Suitable data are often scarce for extremes.

No validation proves a model correct. It establishes confidence for a purpose, within stated conditions.

13方法

如何研究,以及方法无法说明的内容。

  1. 不确定性量化与模型验证不确定性预算 · 高成本模拟的代理模型 · 可信度评估在此应用
  2. 概率与统计贝叶斯校准 · 预测的恰当评分 · 集合统计在此应用
  3. 系统工程决策模型的需求 · 耦合模型的接口控制在此应用
  4. 不确定性下的决策分析先界定决策再建模 · 模型的信息价值在此应用
15问题

问题与解答。

What is the difference between verification and validation?
Verification asks whether the model is solved correctly, that the code does what it is meant to. Validation asks whether it is the right model for the purpose, by comparing it with reality.
Can a model be validated for the future?
Not directly. Models can be tested on past conditions and processes; confidence for new conditions rests on whether the model represents the underlying processes.
What is global sensitivity analysis?
A method that varies all uncertain inputs together to find which ones drive most of the variation in model outputs.
Can uncertainty always be quantified?
Not always. Under deep uncertainty, experts may not agree on probabilities, and other approaches such as scenario analysis are used. See 不确定性下的优化.
What is equifinality?
The situation in which different parameter sets produce equally good fits to observations, so calibration cannot identify the true values.
Does GCRI validate models for regulators?
No. GCRI does not certify. Its method notes describe how validation can be done.
Why is calibration not enough?
Because matching past data does not show that a model will perform under new conditions or for different outputs.
报告贡献

从本页贡献证据。

报告 is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRI系统科学与建模方法与技术情景与压力测试
系统科学与建模

带来一种方法、一个数据集或一个问题。

信息和咨询现已开放。每项咨询都会获得一个编号,并告知下一步;申请、付款、算力分配和注册只有在相应团队、条款和审查能力就绪时才会开放。