GCRI · 系统科学与建模
不确定性与验证
A model result is useful only when its uncertainty is stated and its fitness for a purpose has been tested. Verification checks that the code solves the equations intended; validation checks that the model represents the real system well enough for the decision at hand. This page sets out how uncertainty is quantified and models are verified and validated, and what evidence serves the decision makers who rely on model results.
工作如何开展。
耦合模型运行器
Uncertainty and validation · Coupled model A · Scenario set 3
模型耦合图
节点:模型 · 边:交换的变量
耦合组件
| 水文学 | 1 day | 径流 | 是 |
| 电力系统 | 1 h | 需求,停运 | 是 |
| 经济 | 1 个季度 | 产出,价格 | 部分 |
| 人口 | 1 year | 暴露 | 是 |
集合输出
图Coupled model runner: example names and illustrative values, not a record or a live system.
Uncertainty and validation: how the risk develops.
Quantifying uncertainty, validation against observations and the limits of calibration. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.
Verification precedes validation
Before asking whether a model matches reality, modellers check that the code is correct, through tests, convergence studies and comparison with known solutions.
Validation is purpose-specific
A model valid for one question may be invalid for another. Validation is judged against the accuracy a specific decision needs.
Uncertainty has several sources
Input data, parameters, model structure, numerical error and natural variability each contribute, and each needs a different treatment.
Calibration can hide error
Tuning parameters to match past data can make a model fit for the wrong reasons, so validation needs data not used in calibration.
北美的危害与暴露。
Flood water, population density and night lights over North America, from NASA GIBS. Each layer carries its own date.
交互式地图需要JavaScript;图层列表和来源见下文。
图层 3
本页面的危害与暴露
关于本图层
- 证据
- 观测(云层造成缺口)
- 来源
- VIIRS 全球洪水产品(NASA LANCE)
- 提供方
- NASA LANCE
- 许可协议
- NASA 开放数据
- 年份版本
- 每日;卫星探测;云层造成缺口
- 构建时的最新内容
- 2026-10-14
- 处理结果
- 约 250 米网格
- 不确定性
- 卫星探测;云层造成缺口。卫星或模型栅格数据,按提供方发布的原样呈现。云层、条带缺口和反演误差会造成缺口和噪声;数值是指标,而非某地的测量值。
- 经由以下途径到达
- gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
- 证据
- 估计值
- 来源
- 世界网格化人口 v4.11(NASA SEDAC(哥伦比亚大学 CIESIN))
- 提供方
- NASA SEDAC(哥伦比亚大学 CIESIN)
- 许可协议
- CC BY 4.0
- 年份版本
- null;基于人口普查的估算,静态(2020)
- 处理结果
- 约 1 公里网格
- 不确定性
- 基于人口普查的 2020 年每平方公里人口估算,作为风险暴露背景展示;不是受任何危害影响的人数。
- 经由以下途径到达
- gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
- 证据
- 观测
- 来源
- VIIRS Black Marble(VNP46A2)(NASA LAADS DAAC)
- 提供方
- NASA LAADS DAAC
- 许可协议
- NASA 开放数据
- 年份版本
- 每日;卫星辐射亮度,已校正月光和大气影响
- 构建时的最新内容
- 2026-10-12
- 处理结果
- 约 500 米网格
- 不确定性
- 所示日期的卫星夜间辐射亮度;灯光是用电和停电的替代指标,并非对供应或获得电力情况的测量。
- 经由以下途径到达
- gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
- 证据
- 观测
- 来源
- VIIRS NOAA-20 校正反射率(NASA LANCE)
- 提供方
- NASA LANCE
- 许可协议
- NASA 开放数据
- 年份版本
- 每日;卫星图像
- 构建时的最新内容
- 2026-10-14
- 处理结果
- 约 250 米网格
- 不确定性
- 卫星图像。卫星或模型栅格数据,按提供方发布的原样呈现。云层、条带缺口和反演误差会造成缺口和噪声;数值是指标,而非某地的测量值。
- 经由以下途径到达
- gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
- 证据
- 模型生成(GIBS 发布的最新年份)
- 来源
- MODIS Terra 和 Aqua 土地覆盖(MCD12Q1)(NASA LP DAAC)
- 提供方
- NASA LP DAAC
- 许可协议
- NASA 开放数据
- 年份版本
- 每年;卫星分类;GIBS 发布的最新年份
- 构建时的最新内容
- 2024-01-01
- 处理结果
- 约 500 米网格
- 不确定性
- 所示年份的卫星土地覆盖类别,含农田;该分类存在已知误差,并非农场登记册。
- 经由以下途径到达
- gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
关于本图层
- 证据
- 观测(云层和过境时间造成缺口)
- 来源
- VIIRS NOAA-20 375 米(FIRMS)(NASA LANCE FIRMS)
- 提供方
- NASA LANCE FIRMS
- 许可协议
- NASA 开放数据
- 年份版本
- 每日;卫星探测;云层和过境时间造成缺口
- 构建时的最新内容
- 2026-10-13
- 处理结果
- 约 500 米网格
- 不确定性
- 所示日期的卫星热点探测结果,包括天然气火炬和工业热源;并非已确认的火情、事件报告或预警。
- 经由以下途径到达
- gibs.earthdata.nasa.gov,仅在您允许实时地图后访问
键盘操作,地图获得焦点时
按住 Ctrl 或 ⌘ 并滚动以缩放
最新可用
NASA GIBS / EOSDIS · ASTER GDEM (METI, NASA) · Blue Marble (NASA) · © OpenStreetMap贡献者 (ODbL) · Natural Earth
正在加载最新的NASA影像。
拖动以移动。按住 Ctrl 或 ⌘ 并滚动、双指缩放或使用按钮缩放;悬停可查看指针下的数值;重置可返回该区域。
危害与风险暴露,以北美为取景。NASA 发布的卫星和模型产品,各带自己的日期。它们是指标,而非对任何地点的评估。
数据:NASA GIBS · ASTER GDEM · Blue Marble · © OpenStreetMap 贡献者 · Natural Earth · NASA EONET · 美国地质调查局 · NASA JPL OPERA DIST-ALERT来源与许可
- We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS). Colours redrawn from the published colour map; values averaged into hexagonal cells where shown (modified). NASA 开放数据
- We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS). Colours redrawn from the published colour map; values averaged into hexagonal cells where shown (modified). NASA 开放数据
- VIIRS 近实时产品(洪水、地表温度、积雪覆盖、校正反射率),NASA LANCE;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
- Center for International Earth Science Information Network (CIESIN), Columbia University. 2018. Gridded Population of the World, Version 4 (GPWv4): Population Density, Revision 11. NASA Socioeconomic Data and Applications Center (SEDAC). 采用 CC BY 4.0 许可。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 doi:10.7927/H49C6VHW. CC BY 4.0
- VIIRS Black Marble 夜间灯光,NASA 戈达德航天中心;由 NASA Level-1 与大气档案和分发系统(LAADS DAAC)分发;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
- MODIS 陆地产品(植被指数、总初级生产力、土地覆盖),NASA LP DAAC 和 LANCE;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
- NASA 资源管理火灾信息系统(FIRMS),VIIRS 375 m 活跃火点产品,NASA LANCE;矢量瓦片来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
- ASTER GDEM 是 METI 和 NASA 的产品(ASTER Global Digital Elevation Model V003,NASA LP DAAC);影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。引用格式:NASA/METI/AIST/Japan Spacesystems and U.S./Japan ASTER Science Team (2019). ASTER Global Digital Elevation Model V003. doi:10.5067/ASTER/ASTGTM.003. NASA 开放数据
- 使用 Natural Earth 制作。免费矢量和栅格地图数据,见 naturalearthdata.com。 公有领域
- © OpenStreetMap 贡献者(ODbL),经由 NASA GIBS(海岸线、边界、道路和地名)。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 ODbL
- Blue Marble,NASA Earth Observatory;影像来自 NASA GIBS。颜色依据已发布的色标重绘;显示处的数值已按六边形网格平均(经修改)。 NASA 开放数据
- 地球仪和平面地图上的背景信息:海岸线、边界、道路和地名来自 NASA GIBS 参考图层(OpenStreetMap 数据,ODbL,© OpenStreetMap contributors);Blue Marble 影像可作为可选底图;3D 地形和高程读数来自 ASTER GDEM 高程色彩指数(5 m 至 200 m 分级,为便于辨识而作了夸张处理)。边界按已发布的样式绘制,不代表对任何领土的立场。
- 实时事件:NASA Earth Observatory Natural Event Tracker(EONET);事件仅供参考,并保留其原始来源链接。
- 实时:NASA EONET。事件仅供参考,不是主管机构的预警。
- 实时:美国地质调查局。事件仅供参考,不是主管机构的预警。
- Observed (EO): NASA JPL OPERA DIST-ALERT (contains modified Copernicus Sentinel data 2026). We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS).
- NASA GIBS: We acknowledge the use of imagery provided by services from NASA’s Global Imagery Browse Services (GIBS), part of NASA’s Earth Science Data and Information System (ESDIS).
- 河流流量预报,30天及区间(GloFAS,经Open-Meteo):包含经修改的Copernicus Emergency Management Service 2026年信息;非洪水警报。
- 天气数据来自 Open-Meteo.com (https://open-meteo.com/), 依据 CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). 授权。
- 可选图层(图层列表中有 11 个来源:实时、预报、观测和背景)开启时会在地图上和此处显示其提供方署名;预报是模型输出,派生指数是估计值。
图层与日期
- 洪水水体,3 日合成:VIIRS 全球洪水产品,NASA LANCE · 2026年10月14日
- 人口密度,2020 年:人口:哥伦比亚大学 CIESIN,世界网格化人口 v4.11(2018),NASA SEDAC, CC BY 4.0 · 静态
- 夜间灯光,每日:VIIRS Black Marble(VNP46A2),NASA LAADS DAAC · 2026年10月12日
- 真彩色:VIIRS NOAA-20 校正反射率,NASA LANCE · 2026年10月13日
- 土地覆盖类型(IGBP),年度:MODIS Terra 和 Aqua 土地覆盖(MCD12Q1),NASA LP DAAC · 2024
- 活跃火点与热异常:VIIRS NOAA-20 375 m(FIRMS),NASA LANCE FIRMS · 2026年10月13日
Validation must match the decision each domain faces.
Model uncertainty and validation as a system. Run the cascade.
Assembled from the Nexus Standards area profile 复合与级联危害标准: the hazards it names, the 系统 and sectors that carry the loss, the controls that dampen it and the data that observe it. Choose the components, pick an initiating hazard and step through the cascade. The Map view places the run on an example geography with open data. Every coupling weight is a stated assumption you can change. A teaching model, not a forecast, an assessment or a certification. To model a place of your own choosing, open the full System Builder.
灾害
- Natech event
- Chemical spill or leak (在下游引发)
- Emergency-response overload (在下游引发)
- Toxic gas release (set off downstream)
- Industrial fire (set off downstream)
系统与耦合
- 复合与级联危害标准
- 水文气象危害标准 Compounding
- 地球物理危害标准 Triggering
- 关键基础设施与关键实体 级联
- 全球与系统性风险 机制
控制措施
NS-0章程与原则NS-3风险记录 UNI(语法、旧编码对照、分配机构)NS-9情境 UNI(部署、实例、计划实例)NS-11验证与监测(证据、证明、零信任符合性观测)NRS-H61危害族:级联失效(NHS-1 sys.cascade)NRS-H62危害类别:复合与多危害事件(NHS-1 sys.compound)NRS-H60危害类别:供应链与流动中断(NHS-1 sys.supply-chain)NRS-H94危害族:系统性网络事件(NHS-1 cyber.systemic-cyber)NRS-H107危害族:数字基础设施集中与单一化(NHS-1 tech.digital-concentration)NRS-H7危害类别:大尺度环流异常(NHS-1 atmo.climate-mode)
观测
- Copernicus EMS rapid mapping activations (listed for reference)
- OpenStreetMap planet and replication (listed for reference)
- ERA5 再分析(Copernicus Climate Data Store)(仅列作参考)
- 灾害造成的直接经济损失与全球国内生产总值之比
- Number of disruptions to basic services attributed to disasters
示例地理范围
- 孟加拉国:134 个六边形单元
- 今夜夜间灯光与停电(VIIRS 昼夜波段),NASA GIBS
- Carbon monoxide, smoke transport (AIRS), NASA GIBS
- Vegetation disturbance alerts, 30 m (OPERA DIST-ALERT), NASA GIBS
衡量什么,以及衡量得如何。
每个指标都注明其单位、频率、背后的来源类型以及数值将附带的证据标签。此处不显示数值:数值由计划依据其自身权限提供。
| 指标 | 单位 | 节奏 | 来源类型 | 标签 |
|---|---|---|---|---|
| Verification tests passed | percent of test suite | 每次发布 | Model test records | 观测 |
| Validation error against independent data | error metric | per validation | Validation studies | 估算 |
| Prediction interval coverage | percent of observations inside stated intervals | per evaluation | Out-of-sample evaluation | 观测 |
| Sensitivity indices | share of output variance by input | per analysis | 全球 敏感性分析 | 模型生成 |
| Models with documented credibility assessment | 计数 | 每次评估 | Model documentation | 已声明 |
| Independent reviews completed | 计数 | per model | Review records | 已报告 |
How uncertainty and validation is modelled, measured and tested.
模型、其假设、数据和不确定性,以科学家或工程师会核查的形式呈现。结构遵循已发表的方法。所取数值仅为示意,不是研究发现。
模型、方程与假设
The model structure used for uncertainty and validation, the assumptions it makes and how each is tested.
Ri = f(Hi, Ei, Vi, Ci)危害、风险暴露、脆弱性和应对能力EAL = ∑k pk · Lk对年概率为 pkxt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error| 假设 | 为何制作 | 如何检验 |
|---|---|---|
| 在一次事件中,危害与暴露相互独立 | 使损失积分保持可计算 | 与基于联合记录拟合的 copula 进行比较 |
| 耦合在工作点附近是线性的 | 让冲击通过 A 传播 | 在线性范围之外施加扰动并比较 |
| 脆弱性曲线可以在不同地点之间迁移使用 | 很少有本地曲线可用 | 在有观测损失的地方据此进行验证 |
- 输入
- 带溯源信息的版本化数据集
- 成果
- 分布,绝不是单一数字
- 代码
- 连同模型卡和测试一起发布
- 复现
- 相同的数据、代码、环境和随机种子
证据来自何处。
具名公共数据集与机构记录,各自注明许可类别。依协议获得的来源仅按其条款使用,绝不再次发布。
| 来源 | 它提供什么 | 许可类别 |
|---|---|---|
| ASME V&V 10, V&V 20 and V&V 40 | Verification, validation and credibility standards | Licensed standards, purchase required |
| NASA-STD-7009 | Credibility assessment of models and simulations | Public domain, US government |
| IPCC uncertainty guidance note | 经校准的不确定性表述 | Public, IPCC terms |
| SALib and other open 敏感性分析 libraries | Implementations of global sensitivity methods | Open source, MIT licence |
| Published validation studies in each field | Evidence on model performance | Licence per publication |
由谁决定,以及证据服务于什么。
系统 Science and Modelling prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.
| 谁来决定 | 问题 | 本页面服务的证据 |
|---|---|---|
| Model owners | Whether a model is fit for a stated purpose | Credibility assessments; validation reports |
| Decision makers | How much weight to give model results | Uncertainty statements |
| Reviewers and auditors | Whether verification and validation were adequate | Protocols and review records |
该主题产生的产出
- Verification and validation protocols for network models
- Uncertainty statements in calibrated language
- Credibility assessments for models used in decisions
- Validation reports against independent data
What experts ask about uncertainty and validation.
- Which sources of uncertainty matter most for the decision at hand?
- How does uncertainty in inputs and parameters propagate to outputs?
- What observations can test the model, and are they independent of calibration data?
- How far beyond the calibration conditions can the model be trusted?
- How should uncertainty be communicated to people who must act on it?
Kinds of uncertainty and why calibration is not validation.
Modellers distinguish aleatory uncertainty, the inherent variability of a system, from epistemic uncertainty, which comes from incomplete knowledge and can in principle be reduced. Structural uncertainty, about whether the model’s equations are right, is often the largest and hardest to quantify. 深度不确定性 arises when experts cannot agree even on probability distributions.
Calibration adjusts parameters so that a model matches observations. A well-calibrated model may still be wrong: many parameter combinations can fit the same data, a problem called equifinality, and a model tuned to past conditions may fail under new ones. Validation therefore requires tests against data not used in calibration, and ideally under different conditions.
Validation is purpose-specific. A model may be adequate for estimating averages but not extremes, or for one region but not another.
方法及其局限。
- 01
敏感性分析
Identifying which inputs drive output variation. Global methods are computationally demanding.
- 02
Probabilistic propagation
Monte Carlo and related methods, using 概率与统计. Results depend on assumed input distributions.
- 03
Bayesian calibration
Updating parameter beliefs with data and representing model discrepancy. Priors and discrepancy models involve judgement.
- 04
Out-of-sample validation
Testing against independent data, held-out periods or different locations. Suitable data are often scarce for extremes.
No validation proves a model correct. It establishes confidence for a purpose, within stated conditions.
Where this page’s references lead.
阅读本页时所对照的机构和文件。状态和版本会变化;每个链接都指向发布机构。
- ASME V&V 40-2018, assessing credibility of computational modelling (ASME)
- NASA-STD-7009,模型与仿真标准(NASA)
- Kennedy and O’Hagan, Bayesian calibration of computer models, Journal of the Royal Statistical Society Series B 63 (2001)
- Saltelli and others, Five ways to ensure that models serve society: a manifesto, Nature 582 (2020)
问题与解答。
What is the difference between verification and validation?
Can a model be validated for the future?
What is global sensitivity analysis?
Can uncertainty always be quantified?
What is equifinality?
Does GCRI validate models for regulators?
Why is calibration not enough?
从本页贡献证据。
报告 is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.
- 电子邮件网关 GW-GCRI从本页发送证据、更正、案例、方法、审查、翻译或概况投稿。它会带上本页标签送达,由负责的编辑接收。
- Zenodo开放存缴存缴并提交到社区用您的 ORCID iD 在 Zenodo 上发布您自己的记录,然后提交到那里的 Reports 社区。由策展人审核;DOI 仍归您所有。
- 报告GCRI查看所有贡献方式贡献类型、各自的评审方式、您获得的署名、许可协议,以及绝不接受的内容。
切勿发送个人数据、敏感基础设施细节或您无权分享的任何内容。贡献在使用前会经过审查;发送贡献不赋予署名权或编辑权,赞助也绝不能换取研究结论。
法律文件。
本网站上的地图、数据和图表仅作为背景和一般信息展示。它们不是建议、预测或预警;信息的局限见免责声明和数据说明。