Skip to content

GCRI · Systemic Risk Management

Quantitative and qualitative methods

Risk assessment uses numbers where data support them and structured judgement where they do not. Probabilistic models, loss distributions, expert elicitation, bow-tie diagrams and risk matrices each answer different questions and fail in different ways. This page sets out how the main methods work, when each is fit for purpose, and how combining them keeps an assessment honest about what is known and what is assumed.

01رجسٹر

Quantitative and qualitative methods on the record.

02The question

Quantitative and qualitative methods: how the risk develops.

Probability, uncertainty and judgement. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

طریقۂ کار

Models need data that fit

Frequency and severity models work where events are numerous and recorded consistently. For rare, novel or changing risks the data are thin, and a precise-looking number can carry more assumption than evidence.

طریقۂ کار

Judgement carries biases

Experts anchor on recent events, overestimate their own precision and converge in groups. Structured elicitation reduces these effects by separating estimates, asking for ranges and scoring calibration.

طریقۂ کار

Matrices compress information

Likelihood and consequence matrices are quick to use, but they rank risks coarsely, can reverse orderings and hide correlated losses. They suit screening, and need other methods before a major decision.

طریقۂ کار

Methods combine through structure

Fault trees, event trees and bow-tie diagrams link causes, controls and consequences. They provide a frame into which quantitative estimates and expert judgement can be placed and checked.

03نگرانی

Cascade and stress lab.

وہ اسکرین جو ایک ٹیم اس موضوع کی پیروی کے لیے استعمال کرے گی: اس کے پیمانے، حالتیں اور فیصلے۔ نام مثالیں ہیں اور اقدار توضیحی ہیں۔

Cascade and stress lab

Quantitative and qualitative methods · National system · Scenario SC-40

Cascade crosses three systemsGCRI · Systemic Risk Management

Interdependency graph

red: failed in scenario

Cascade sequence

  1. T+0HAZHeatwave and drought
  2. T+6hENGThermal plant derated, cooling water
  3. T+9hICTData centre on backup power
  4. T+14hWATPumping reduced, pressure loss
  5. T+20hHLTHospital water supply at risk

Service loss by system

Cascade and stress lab: the screen’s structure, terms and states for Quantitative and qualitative methods.Example names and illustrative values; a design, not a record or a live system.
04Across the domains

Methods must be fit for risks that cross domains.

05Methods and evidence

How quantitative and qualitative methods is modelled, measured and tested.

The model, its assumptions, its data and its uncertainty, in the form a scientist or engineer would check. Structures follow published methods. The values drawn are illustrative, not findings.

Model, equations and assumptions

The model structure used for quantitative and qualitative methods, the assumptions it makes and how each is tested.

Risk of element iRi = f(Hi, Ei, Vi, Ci)hazard, exposure, vulnerability and coping capacity
Expected annual lossEAL = ∑k pk · Lkover events k with annual probability pk
Coupled systemsxt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
AssumptionWhy it is madeHow it is tested
Hazard and exposure are independent within an eventKeeps the loss integral tractableCompare with a copula fit on joint records
Couplings are linear near the operating pointLets shocks propagate through APerturb beyond the linear range and compare
Vulnerability curves transfer between placesLocal curves are rarely availableValidate against observed losses where they exist
Inputs
versioned datasets with provenance
Outputs
distributions, never single numbers
کوڈ
released with the model card and tests
Reproduction
same data, code, environment and seed
Standard risk and state-space formulations; the assumptions listed are typical of the method, stated for review, not results.
FAIR guiding principles · GO FAIR and FORCE11W3C PROV · World Wide Web ConsortiumGuidance on consistent treatment of uncertainties · IPCCCEOS Analysis Ready Data · Committee on Earth Observation Satellites
06اشاریے

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeلیبل
Risks assessed with quantitative estimatespercent of principal risksannualAssessment recordsرپورٹ شدہ
Calibration of expert estimatescalibration score on seed questionsper elicitationStructured expert judgement recordsمشاہدہ شدہ
Loss event recordscount of events with cause and amount recordedcontinuousInternal loss databasesمشاہدہ شدہ
Assessment uncertainty rangeratio of upper to lower boundper assessmentAssessment outputsتخمینی
Controls with tested effectivenesspercent of key controlsannualControl testing recordsرپورٹ شدہ
Method documentation completenesspercent of assessments with method, data and assumptions recordedannualAssessment filesرپورٹ شدہ
07ماخذات

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

ماخذWhat it givesLicence class
IEC 31010 Risk assessment techniquesDescriptions, strengths and limits of more than forty techniquesLicensed standard, purchase required
EM-DAT بین الاقوامی آفات ڈیٹا بیس (CRED، لووین کیتھولک یونیورسٹی)Disaster events with human and economic impactsFree for non-commercial use with registration
Sendai Framework Monitor and national disaster loss databasesPublished reporting of disaster losses against Sendai targetsPublic, UN terms of use
TU Delft expert judgement databasePast structured expert judgement studies with calibration dataLicence to check
Published operational loss data consortia summariesAggregate operational loss patterns in financial servicesMembers only; public summaries (to check)
08Decisions

Who decides, and what the evidence serves.

Systemic Risk Management prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

کون فیصلہ کرتا ہےThe questionEvidence this page serves
Risk functions and analystsWhich method fits a given risk and decisionMethod selection guides; documentation standards
Boards and executivesHow much confidence to place in an assessment before acting on itUncertainty ranges; method documentation; calibration records
Regulators and supervisorsWhether an institution’s risk models are fit for the use made of themModel documentation; validation and back-testing evidence

Outputs this topic produces

  • Method selection guides keyed to the question and the evidence available
  • Structured expert elicitation protocols with calibration
  • Bow-tie and fault-tree templates linked to registers
  • Assessment files that record data, assumptions and ranges
09Core questions

What methods experts ask.

  • Is there enough relevant data to estimate probabilities, or would numbers convey a false sense of precision?
  • What kind of uncertainty dominates: randomness, lack of knowledge, or disagreement about how the system works?
  • How sensitive is the decision to the parts of the analysis that are least certain?
  • How can expert judgement be elicited so that it is transparent and less prone to bias?
10Mechanisms

Kinds of uncertainty.

Aleatory

Randomness

Natural variability that persists even with perfect knowledge, such as weather from year to year. Probability handles it well.

Epistemic

Lack of knowledge

Uncertainty that more data or research could reduce. It should be shown, not hidden in a single number.

Deep

Disputed structure

Where experts disagree on models, probabilities or values. Scenarios and robust decision methods suit it better.

11Methods and limits

A toolkit, matched to the problem.

  1. 01

    Statistical and probabilistic models

    Frequency analysis, extreme value methods and Bayesian inference from probability and statistics. Limits: rare events are poorly sampled, and past data may not reflect a changing system.

  2. 02

    Uncertainty quantification

    Uncertainty quantification and model validation propagates input uncertainty through models and tests them against data. Limits: it cannot capture what the model leaves out.

  3. 03

    منظم ماہرانہ رائے

    Formal elicitation protocols that calibrate and combine expert views. Limits: time-consuming, and experts share blind spots.

  4. 04

    Qualitative assessment

    Scales, matrices and narrative analysis. Useful for communication and screening, but risk matrices can rank risks inconsistently and should not be the only tool.

12طریقے

How it is studied, and what the methods cannot say.

13Where this page’s references

Where this page’s references lead.

وہ ادارے اور دستاویزات جن کے تناظر میں یہ صفحہ پڑھا جاتا ہے۔ حیثیت اور ایڈیشن بدلتے رہتے ہیں؛ ہر لنک جاری کرنے والے ادارے تک جاتا ہے۔

14سوالات

سوالات و جوابات۔

Are risk matrices reliable?
They are useful for screening and communication, but they rank risks coarsely and can mislead when risks are correlated or consequences are uncertain. Important decisions need methods that show ranges and dependencies.
What is structured expert judgement?
A formal process for eliciting estimates from experts, often with seed questions whose answers are known, so that each expert’s calibration and informativeness can be scored and estimates combined accordingly.
When should risk be quantified?
When data or models can support a number whose uncertainty can be stated, and when the decision needs it. Where they cannot, a well-documented qualitative assessment is more honest than a false number.
Are quantitative methods always better?
No. They are better when data and models are adequate. Where they are not, numbers can mislead, and structured qualitative methods or scenarios are more honest.
What is wrong with risk matrices?
They are simple and widely understood, but coarse scales can rank different risks equally, hide uncertainty and ignore dependence. They work best as a screening tool alongside other methods.
How should uncertainty be communicated?
With ranges, scenarios and plain statements of what is not known, so that decision-makers can see how much the conclusion depends on uncertain inputs.
رپورٹیںحصہ ڈالیں

اس صفحے سے شواہد فراہم کریں۔

Reports کنسورشیم کی سہ ماہی اشاعت ہے۔ اس موضوع کے بارے میں آپ کا علم اگلے شمارے میں شواہد، کیس یا تصحیح بن سکتا ہے، جو آپ کے نام سے منسوب ہوگا اور اگر یہ آپ کا اپنا کام ہو تو CC BY 4.0 کے تحت شائع ہوگا۔

GCRIنظامی خطرے کا انتظاممنظرنامہ اور دباؤ کی جانچطریقے اور تکنیکی امورپورٹ فولیو اور تیاری
نظامی خطرے کا انتظام

Bring a method, a dataset or a question.

معلومات اور استفسارات آج کھلے ہیں۔ استفسار کو ایک حوالہ نمبر ملتا ہے اور اگلے مرحلے کی نشاندہی ہوتی ہے؛ درخواستیں، ادائیگیاں، کمپیوٹنگ کی تخصیص اور رجسٹریشن صرف اس وقت کھلتی ہیں جب ان کی ٹیم، شرائط اور جائزے کی استعداد موجود ہو۔