G11 · TOPIC · labs-and-foundry-seriesGCRI dossier · service level R0
GCRINexus ReportsEstablished
Topic dossier · Nexus Reports

Labs and foundry series

Labs and foundry reports record technical tests: prototypes, software, sensors, data pipelines and procedures exercised under stated conditions. Test evidence is easy to overstate, because a passed test under controlled conditions is read as readiness for use. This page sets out how test reports are structured, reviewed and archived, how readiness levels are evidenced rather than declared, and what such evidence can support for those deciding whether to adopt or fund a technology.

01In brief

The short answer.

Technical test reports record prototypes, software, sensors, data pipelines and procedures exercised under stated conditions. Test evidence is easy to overstate, because a test passed under controlled conditions is read as readiness for use, so reports register protocols, archive code and configuration, and publish negative and inconclusive results.

02Geography

Systemic exposure in the United Kingdom and Ireland.

Where people and networks concentrate, the exposure through which shocks travel between systems, shown for the United Kingdom and Ireland as an example geography for this subject.

Where people and networks concentrate, the exposure through which shocks travel between systems.Indicator derived from Natural Earth at map scale; a screening view, not an assessment.
GCRI · Nexus Reports · fieldDESIGN FIGURE
03Console

Series production desk, in outline.

The working screen behind this subject: its structure, terms and states. Names are placeholders and values illustrative.

Series production desk

Labs and foundry series · Annual synthesis · Edition 7

Data check behind planGCRI · Nexus Reports

Editions in production

Annual synthesisGlobalData check81W10
Country profile 7CountryPeer review97W16
Water outlookSectoralDrafting32W38
Methods note 4MethodsReleased100done

Data check, annual synthesis

Values traced79 pct · req 100Labels attached95 pct · req 100Uncertainty stated73 pct · req 100

Edition pipeline

  1. Outlineboard
  2. Draftauthors
  3. Data checkevery value
  4. Peer reviewtwo rounds
  5. Editorialdecision
  6. ReleaseDOI
  7. Correctionsversioned
Series production desk: the screen's structure, terms and states for Labs and foundry series.Placeholder names and illustrative values; a design, not a record or a live system.
04The question

Labs and foundry series: how the risk develops.

Technical test and readiness evidence. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mechanism

Test conditions narrow the claim

A test establishes behaviour under the conditions tested, with the inputs, environment and version used. Reports that omit those conditions invite readers to generalise beyond them.

Mechanism

Readiness declared not shown

Technology readiness levels are often self-assigned. Without the evidence each level requires, a readiness claim moves from test report to procurement decision unchecked.

Mechanism

Negative results go missing

Failed and inconclusive tests are seldom written up, so the published record overstates success rates and others repeat tests that have already failed.

Mechanism

Versions change underneath

Software and hardware change after testing. A result cited without the version tested is attached to a system that may no longer exist in that form.

05Key terms

Terms used on this page.

Each term as this page uses it. Where a standard-setting body defines the term, the wording follows that body.

TermDefinition
Test protocolA document fixing a test's conditions, procedure and pass criteria before it is run.
Inconclusive resultA test outcome that neither supports nor rules out the claim tested.
System under testThe exact version and configuration of what was tested, which a result applies to.
06Indicators

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeLabel
Test protocols registered before testingpercent of reportsper reportRegistry recordsOBSERVED
Test reports with archived code, data and configurationpercent of reportsper reportRepository deposit recordsOBSERVED
Readiness level claimed and evidence attachedlevel claimed; yes or no for evidenceper reportReport and evidence annexDECLARED
Negative and inconclusive results publishedcount per periodannualSeries catalogueREPORTED
Version of the tested system identifiedpercent of reportsper reportReport metadataOBSERVED
Independent technical review completedyes or no, with reviewer roleper reportReview recordDECLARED
07Canvas

From sources to decisions.

The topic as a computational graph: named sources feed the methods, an evidence review gates the outputs, and the decisions stay with the authorities that hold them.

Pipeline canvas · Labs and foundry series as a run graphDesign, not a record
Labs and foundry series: systematic evidence synthesisA question is framed with its owner and a protocol registered; records are searched, screened and checked for eligibility by two reviewers; data are extracted, synthesised and graded for certainty before a brief is written. Design of the process, not a record of a run.

Fig. 02Nodes carry their type, two metric rows and a state; connectors show what feeds what; dashed frames name the owners; the timeline is the cadence. Design of the pipeline, not a record of a run.

08Sources

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

SourceWhat it givesLicence class
ZenodoArchived test data, configurations and software releases with DOIsMetadata CC0, licence per record
Software HeritagePreserved source code at the exact revision testedCode under its own licence
OSF RegistriesPre-registered test protocols and analysis plansMetadata CC0, licence per registration
protocols.ioPublished step-by-step methods with versions and DOIsLicence per protocol, mostly CC BY
NIST National Vulnerability DatabaseKnown vulnerabilities for software components under testPublic domain
09Decisions

Who decides, and what the evidence serves.

Nexus Reports prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Who decidesThe questionEvidence this page serves
Procurement and adoption boardsWhether a tested technology is ready for a pilot or operational useReadiness evidence annexes, test conditions and known limitations
Innovation funders and programme managersWhether to fund the next stage of developmentReadiness level with its evidence, negative results and open risks
Technical review panelsWhether a test report is complete and its conclusions follow from the evidenceRegistered protocols, archived data and version identifiers
Standards and conformity assessment bodiesWhether test methods are suitable for a future standardDocumented test procedures and their reproducibility

Outputs this topic produces

  • Test reports stating conditions, versions and acceptance criteria
  • Readiness evidence annexes mapping each level to its evidence
  • Archived configurations and data for each test
  • A register of negative and inconclusive results
10Core questions

What the series asks.

Technical claims about tools and systems need evidence that others can inspect. A system that is said to work under stress should show the test that proved it, the conditions of the test and what failed. Publishing that evidence, including negative results, guards against overstated readiness and helps institutions judge what a tool can and cannot do.

  • What exactly was tested, under which protocol, with which data and in which environment?
  • What passed, what failed and what was not tested?
  • Does the evidence support the stated next step, and only that step?
  • Which observations or signals warrant further analysis, and how reliable are they?
11Scope

What the series covers.

Three series report evidence from building, testing and observing.

Labs

Experiments and testbeds

Results from completed protocols, including null and negative results.

Foundry

Build and readiness

Evidence about Nexus Foundry systems against stated readiness criteria, never as certification.

Signals

Observation

Signals from monitoring, labelled by source and confidence, prompting analysis rather than action.

The series follows the logic of test and evaluation practice in engineering: a claim is only as good as the protocol that tested it, and readiness is always readiness for something specific. A tool that has passed a laboratory test is not ready for field use, and a system that worked in one exercise has not shown that it will work in every setting. Editions state these limits next to each result.

12Methods and evidence

How editions are built, and their limits.

  1. 01

    Protocols

    Each result cites a protocol registered before the test, so outcomes cannot be selected after the fact.

  2. 02

    Environments

    Test conditions are described; results from a testbed may not transfer to live operation.

  3. 03

    Readiness criteria

    Readiness is assessed against criteria for a stated next step. It is not approval, bankability or certification.

  4. 04

    Signal quality

    Observatory signals state their source, coverage and false-alarm characteristics where known.

13Methods

How it is studied, and what the methods cannot say.

  1. Data engineering, interoperability and stewardshipStructured publishing in JATS XML · Persistent identifiers across the recordApplied here
  2. Uncertainty quantification and model validationCalibrated language in assessments · Certainty of evidence ratingsApplied here
  3. Probability and statisticsMeta-analysis with heterogeneity stated · Small-study and publication biasApplied here
14Questions

Questions and answers.

What is a technology readiness level?
A scale describing how far a technology has progressed from basic principles to proven operation. Each level requires specific evidence; a level stated without that evidence is a declaration, not a demonstration.
Why publish failed tests?
Because a record of successes alone misleads. Negative and inconclusive results show where a technology does not work and stop others repeating the same test.
Does a passed test mean a system is safe?
No. It means the system met the stated criteria under the stated conditions. Safety depends on use, context and conditions the test may not have covered.
Does a readiness report mean a system is approved?
No. Readiness is fitness for a stated next step within a stated scope. It is not approval, certification or a statement that a service operates.
Are failed tests published?
Yes. Negative and null results are part of the evidence, and omitting them would overstate readiness.
Can vendors publish results in the series?
Results appear only from protocols run under the programme's review. Vendor claims are labelled Institution-reported if cited at all.
Are observatory signals warnings?
No. They prompt analysis. Warnings remain with competent authorities.
Nexus Reports

Bring your expertise to this field.

The current service level is R0: information and enquiries. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

Have questions?