Skip to content

GCRI · Research library

Rêbaz û gotarên teknîkî

Papers describing the quantitative and qualitative methods of The Global Centre for Risk and Innovation (GCRI), open enough for another team to apply, test or criticise them. Each states the method, its assumptions, its validation, where it fails and the software or data it needs. Methods link to their STEM Commons pages. Part of the research library.

01Qada xebatê

The workspace for methods and technical papers.

Pileya delîlan

Methods and technical papers · Review wave 2 · Example interface, not a record

Two sources downgradedGCRI · GCRI

Bawerî li gorî pîvanê

0 nizm heta 100 bilind

Bilindtir bêtir piştrast e. Nirx mînak in.

Rêza nirxandinê

  1. R-1Country programmes activesecond reviewer3 d
  2. R-2Evidence records with labelssecond reviewer2 d
  3. R-3Methods appliedsecond reviewer4 d
Pileya delîlan.Navrûyeke ronîker; ne daneya zindî ye.

GCRI · Evidence grading. Evidence grading: example names and illustrative values, not a record.

02Two traditions

Quantitative and qualitative, held to one standard.

Both kinds of method must be described well enough to be checked.

Quantitative

Models and statistics

Statistical, network, simulation and optimisation methods, such as uncertainty quantification.

Qualitative

Structured judgement

Interviews, expert elicitation, scenario workshops and case analysis, with policy and decision science.

Tevlihev

Combined designs

Studies that combine both, stating how evidence of each kind is weighed.

03Reporting guides

The reporting guides a methods paper follows, by kind of method.

Kind of methodGuideReferans
Prediction models, including machine learningTRIPOD+AICollins and others, BMJ, 2024
Agent-based and other simulation modelsODD protocol, second updateGrimm and others, 2020
Computer model calibrationCalibration with explicit model discrepancyKennedy and O’Hagan, 2001
Machine-learning models in deploymentModel cardsMitchell and others, 2019
Land change from remote sensingArea estimation from a reference sampleOlofsson and others, 2014
Dadweriya pisporan a sazkirîDocumented elicitation protocol with calibration questionsStated in each paper

Reviewed methods are designed for the Methods and Technical series, with each model described under NS-12 of the proposed Nexus Standards. Methods researchers can contribute replications and documented failures; both are published.

04Pêvajo

Pêvajo çawa dimeşe.

Process explorer · Process

Methods and technical papers: Source to evidence record

10 steps4 stages2 gates

Pêvajo

Methods and technical papers: Source to evidence record

Çavkanî tê tomarkirin û nirxandin, tomara wê tê nîşankirin û dabeşkirin, û Pasaporta Delîla Dîjîtal çavkanîbûnê hildigire; rastkirin digihîje her tomara girêdayî.

  1. 01 Wergirtin

    1. 01Çavkaniyê nas bikeÇavkanî · Parêzvanê çavkaniyêKeşif ne wergirtin e. Nasîna çavkaniyê çîna çavkaniyê, parêzvan, rola saziyî û dadrêsiyê tomar dike.
    2. 03Çavkaniyê tomar bikeGavTomarkirin çavkaniyeke hatî keşifkirin dike beşdarekî birêvebirî yê çerxa jiyanê ya delîlan. Ew tu piştgirî an pejirandinê nade.
  2. 02 Nirxandin

    1. 04Dadrêsî û dabeşkirina mafanDerîDabeşkirina mafan lîsans, razîbûn, nepenîtî û sînorên bikaranîna ji nû ve dide nasîn. Encam gihîştin û rêvekirinê diyar dike.
    2. 05Nirxandina kalîteya delîlanGavNirxandina kalîteyê diyar dike gelo tomar ji bo bikaranîneke diyarkirî guncav e. Kalîte pirdîmenî ye û tu carî ne puaneke yekane ye.
    3. 06Nîşana delîlanGavHer encam yek ji nehê nîşanên delîlan hildigire. Daneya kêm wekî kêm tê nîşandan, qet wekî sifir.
  3. 03 Tomar

    1. 07Dabeşkirina delîlanTomarDabeşkirin rewşên çerxa jiyanê dide tomaran, wekî çavkanî-rastandî, ewle-ji-bo-giştî an bisînor. Rewş dikarin bi hev re hebin û bikaranîna delîlan diyar bikin.
    2. 08Weşana çavkaniyê û nasnameTomar · NXS-GRX (daneya kanonîk, çavkanîbûn û xetere)Weşana çavkaniyê maf, vegirtina demî û nijada çavkaniyê tomar dike. UNI bi riya katalogekê tê dayîn û tu carî bi dest nayê nivîsandin.
    3. 09Pasaporta Delîla DîjîtalTomarPasaport çavkanîbûn, kalîte, maf, dadrêsî, bikaranîna destûrdayî û dîrokê tomar dike, da ku delîl dema digere çarçoveya xwe biparêze.
  4. 04 Bikaranîn û rastkirin

    1. 02Rastkirin digihîje tomarên girêdayîGav · NXS-GRX (daneya kanonîk, çavkanîbûn û xetere)Rastkirina çavkaniyekê digihîje birr û berhemên girêdayî bêyî ku encamên kevin ji nû ve binivîse.
    2. 10Nirxandina ewle ya giştîDerîNirxandina ewle-ji-bo-giştî diyar dike ka tomar dikare bi giştî were parvekirin. Ew qonaxeke cuda ye û ne rastandin e.

Data protocols: evidence lifecycle · Data protocols: core data objects and evidence records · The Global Risks Index (NXS-GRX)Designed programme process, not a record of operation. No cycle has run and every programme is at service level R0. A gate is a programme decision, never a public-authority approval, certification or deployment authorisation. The data-protocol pages describe a design, not a running system.

05What a methods paper contains

Six elements in every paper.

  1. 01

    Armanc

    The question the method answers and where it should not be used.

  2. 02

    Texmîn

    What must be true for results to hold.

  3. 03

    Erêkirin

    How the method was tested, on which data and with what result.

  4. 04

    Failure modes

    Known situations where the method gives misleading results.

  5. 05

    Bicihanîn

    Software, versions and parameters, released where licences allow.

  6. 06

    Nirxandin

    Who reviewed the paper and its review state.

06Why openness matters

A method no one can check is not evidence.

Risk decisions often rest on models and judgement that are hard to see. Open methods let independent researchers, source agencies and affected communities test them, find weaknesses and propose improvements. Where licensing or security prevents releasing code or data, the paper says so and describes the method in enough detail to assess.

09Pirs

Pirs û bersiv.

Why publish methods separately from results?
So that the method can be reviewed and reused on its own, and so that results in many publications can point to one checked description.
Are qualitative methods treated as less rigorous?
No. They answer different questions. Both must state their design, assumptions and limits, and both are reviewed.
Can I reuse a GCRI method?
Yes, under the licence of the paper and any released software. Please cite the method paper and version.
How are methods improved over time?
Through review, challenge and new evidence. A revised method is published as a new version, and results that depend on it note the change.
Can I propose an improvement to a method?
Yes. Write to the research collaboration form with the method, the proposed change and your evidence. Proposals receive a reference and are reviewed on their merits.
rêzeya Pergalên StratejîkTevkarî bike

Ji vê rûpelê delîl bidin.

Reports weşana sê mehane ya Konsorsiyûmê ye. Tiştê ku tu li ser vê mijarê dizanî dikare di çapa pêş de bibe delîl, dosya an rastkirin, bi navê te û di bin CC BY 4.0 de weşandî li cihê ku karê te bi xwe be.

GCRI
Global Centre for Risk and Innovation

Rêbazek, danehevek an pirsek bîne.

Agahî û pirs îro vekirî ne. Pirsek referansekê distîne û gava piştî wê dide nasîn; serlêdan, drav, veqetandina hesabkirinê û tomarkirin tenê dema ku tîm, mercên wê û kapasîteya vekolînê hebin vedibin.