Skip to content

GCRI · Labs

Feld- und Labortestumgebungen

A testbed is a controlled place to try something before it meets the world: a laboratory rig, a pilot plant, a field trial plot, a living lab in a neighbourhood, a regulatory sandbox. Testbeds carry risks of their own, to staff, participants, sites and neighbours, and their evidence is only as useful as the match between test and conditions of use. This page sets out how testbeds are designed, permitted, made safe and read, and who decides when a result may move on.

01Arbeitsfläche

Wie die Arbeit abläuft.

System · rund um dieses ThemaBeispielhaft

Testbed operations

Field and lab testbeds · Field lab coast · Campaign 5

Sensors deployedGCRI · Labs

Sensor deployment

illustrative Küstenlinie

BuoyStationGaugeMeerBands: tidal rangeN

Sensors

S-01 tide940.2Nominal
S-04 salinity910.4Recalibrate
S-07 wave910.2Nominal

Sensor vs reference

Testbed operations: the screen’s structure, terms and states for Field and lab testbeds.Beispielnamen und beispielhafte Werte; ein Entwurf, kein Eintrag und kein Live-System.

Abb.Testbed operations: example names and illustrative values, not a record or a live system.

02Die Frage

Field and lab testbeds: how the risk develops.

Test environments, safety and site permissions. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mechanismus

The test is not the world

Laboratory conditions remove the variability of real sites, users and maintenance. A technology that performs on a rig may fail in heat, dust, intermittent power or untrained hands. The gap between test and operating environment is what readiness levels try to name.

Mechanismus

Hazards travel with the experiment

Pressurised Systeme, biological agents, chemicals, batteries, drones and autonomous machines can harm people outside the lab once trials move to the field. Risikobeurteilung has to follow the experiment to each new site and each new configuration.

Mechanismus

Permission is layered

Field work can need landowner consent, environmental and planning permits, aviation or radio authorisations, biosafety approval and community agreement. A missing permission can halt a trial midway or make its data unusable.

Mechanismus

Living labs involve people

When a trial runs in homes, streets, wards or workplaces, residents become participants. Consent, data protection, benefit sharing and exit arrangements decide whether the evidence is ethical and whether the community will host another trial.

03Methoden und Evidenz

How field and lab testbeds is modelled, measured and tested.

Das Modell, seine Annahmen, seine Daten und seine Unsicherheit in der Form, in der eine Wissenschaftlerin oder ein Ingenieur sie prüfen würde. Die Strukturen folgen veröffentlichten Methoden. Die dargestellten Werte sind illustrativ, keine Befunde.

Modell, Gleichungen und Annahmen

The model structure used for field and lab testbeds, the assumptions it makes and how each is tested.

Risiko des Elements iRi = f(Hi, Ei, Vi, Ci)Gefahr, Exposition, Verwundbarkeit und Bewältigungskapazität
Erwarteter jährlicher SchadenEAL = ∑k pk · Lküber Ereignisse k mit jährlicher Wahrscheinlichkeit pk
Gekoppelte Systemext+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
AnnahmeWarum es entstehtWie es geprüft wird
Gefahr und Exposition sind innerhalb eines Ereignisses unabhängigHält das Schadensintegral berechenbarMit einer Copula-Anpassung an gemeinsamen Aufzeichnungen vergleichen
Kopplungen sind nahe dem Arbeitspunkt linearLässt Schocks sich über A ausbreitenÜber den linearen Bereich hinaus stören und vergleichen
Vulnerabilitätskurven lassen sich zwischen Orten übertragenLokale Kurven sind selten verfügbarAnhand beobachteter Schäden validieren, wo es sie gibt
Eingaben
versionierte Datensätze mit Herkunftsnachweis
Ergebnisse
Verteilungen, nie einzelne Zahlen
Code
mit Modellkarte und Tests veröffentlicht
Reproduktion
gleiche Daten, Code, Umgebung und Seed
Standardformulierungen für Risiko und Zustandsraum; die aufgeführten Annahmen sind für die Methode typisch und zur Prüfung benannt, keine Ergebnisse.
FAIR-Leitprinzipien · GO FAIR und FORCE11W3C PROV · World Wide Web ConsortiumHinweise zur einheitlichen Behandlung von Unsicherheiten · IPCCCEOS Analysis Ready Data · Committee on Earth Observation Satellites
04In the five domains

Testbeds test technology in each domain’s real conditions.

05Indikatoren

Was gemessen wird und wie gut.

Jeder Indikator trägt seine Einheit, seinen Rhythmus, die Art der zugrunde liegenden Quelle und die Evidenzkennzeichnung, die ein Wert tragen würde. Es werden keine Werte gezeigt: Ein Programm liefert sie unter seiner eigenen Autorität.

IndikatorEinheitTaktQuellentypKennzeichnung
Technology readiness level at entry and exitlevel on a named TRL scaleper trialAssessment against NASA, EU or ISO 16290 definitionsDEKLARIERT
Independent readiness reviewpercent of readiness claims reviewed outside the teamjährlichProgramme review recordsBEOBACHTET
Operating-environment fidelityordinal scale from laboratory to operationalper trialTest plan against the stated use environmentGESCHÄTZT
Permits in force before startpercent of required permitsper trialPermit registerVeröffentlichte Statistiken
Safety incidents and near missescount per thousand test hoursmonatlichIncident reporting systemBERICHTET
Participant consent coveragepercent of participants with recorded consentper trialConsent recordsBEOBACHTET
Site restoration completedpercent of field sites restored to the agreed conditionper trialSite closure reportsBERICHTET
06Quellen

Woher die Evidenz stammt.

Benannte öffentliche Datensätze und institutionelle Aufzeichnungen, jeweils mit ihrer Lizenzklasse. Quellen auf Vereinbarungsbasis werden nur zu ihren Bedingungen genutzt und niemals weiterveröffentlicht.

QuelleWas es liefertLizenzklasse
ESFRI roadmap and landscape analysisEuropean research infrastructures, their scope and access conditionsFree access, attribution
MERIL portal (European Science Foundation)Inventory of European research infrastructures open to external usersFree access, terms of use
European Network of Living Labore member directoryLiving labs, their domains and contact pointsFree access, terms of use
Testing and Experimentation Facilities (European Commission, Digital Europe Programme)Sector testbeds for artificial intelligence in manufacturing, health, agri-food and citiesPublic programme records
CORDIS (Europäische Kommission)Funded projects, pilot sites, deliverables and reported readinessFree and open, CC BY
Global BioLabs (King’s College London and George Mason University)Mapped high-containment laboratories and their biosafety governanceFree access, attribution
National permit and incident registersField-trial permits, release authorisations and reportable incidentsBy agreement with each authority
07Entscheidungen

Wer entscheidet und wozu die Evidenz dient.

Labore prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Wer entscheidetDie FrageEvidenz, der diese Seite dient
Institutional biosafety and safety committeesWhether an experiment may run at a given containment level or field siteHazard assessment, containment design, training and incident records
Environmental, aviation and spectrum regulatorsWhether a field release, flight or transmission may be authorisedTest plan, site description, mitigation and monitoring arrangements
Programme managers at funding agenciesWhether a technology has earned the next readiness gate and its fundingReadiness evidence per level, independent review, fidelity statement
Host communities and landownersWhether to host a trial, on what terms, and how it endsPlain-language trial description, data use, benefits and restoration plan

Ergebnisse, die dieses Thema hervorbringt

  • Test plans stating the operating environment, the hazards and the exit criteria for each readiness level
  • Permit and safety registers kept with the trial record
  • Readiness assessments with evidence attached to each level claimed
  • Site agreements and closure records for field and living-lab trials
08Kernfragen

What experts ask before a test begins.

  • How close are the testbed’s conditions to the real setting where the result will be used?
  • What can be controlled, what can only be observed, and what is unknown?
  • What could go wrong for people, equipment or the environment, and how is it contained?
  • Who owns the site and the data, and who has granted permission to use them?
  • How will the testbed be returned to its original state when the work ends?
09Mechanismen und Treiber

Why the gap between test and reality matters.

The value of a testbed lies in control: it removes or fixes some sources of variation so that the effect of interest can be seen. The cost of control is realism. A water treatment process that works in a laboratory may fail with real source water that varies by season; a forecasting tool that performs well on historical data may degrade when the system changes. Engineers call this the validity trade-off, and it is never eliminated, only managed.

Field testbeds narrow the gap but bring new risks. They involve communities, landowners, operators and regulators, each with legitimate interests. They can disrupt services, collect personal data or affect ecosystems. Safety cases, consent and permissions are therefore part of the science, not administration around it.

System engineering offers a staged path: component tests, integrated tests in simulation, limited field trials and wider pilots, with criteria for moving between stages.

10Methoden und Daten

How testbeds are characterised.

  1. 01

    Testbed description

    A record of the environment, instruments, calibration, boundary conditions and known deviations from the target setting.

  2. 02

    Hazard and safety analysis

    Structured identification of failure modes and controls, drawing on Systems Engineering practice. It reduces but does not remove residual risk.

  3. 03

    Simulation and digital models

    Virtual testbeds that allow many runs at low cost. Their results are only as good as the model’s validation.

  4. 04

    Readiness staging

    Explicit criteria for moving from bench to simulation to field. Staging helps decisions but readiness levels are coarse and can hide important differences.

A testbed result shows performance under the tested conditions. Generalising beyond them requires further evidence and is reported as a separate claim.

11Methoden

Wie es untersucht wird und was die Methoden nicht sagen können.

  1. SystemtechnikRückverfolgbarkeit von Anforderungen zur Verifikation · Bereitschaftsprüfungen an Stage-GatesHier angewandt
  2. Unsicherheitsquantifizierung und ModellvalidierungBudgets der Messunsicherheit · Sensitivitätsanalyse von SimulationsmodellenHier angewandt
  3. Wahrscheinlichkeit und StatistikPlanung von Stichprobengröße und Teststärke · Metaanalyse mit Bewertung von VerzerrungenHier angewandt
  4. Kausale Inferenz und WirkungsevaluationRandomisierte Pilotprojekte und gestufte Einführungen · Quasi-experimentelle ProgrammevaluierungHier angewandt
12Where this page’s references

Where this page’s references lead.

Die Gremien und Dokumente, vor deren Hintergrund diese Seite gelesen wird. Status und Ausgaben ändern sich; jeder Link führt zur herausgebenden Stelle.

13Fragen

Fragen und Antworten.

What does a technology readiness level measure?
How far a technology has been demonstrated, from basic principles observed to a system demonstrated in its operating environment. It says nothing about market readiness, cost or social acceptance, which need their own evidence.
What is a living lab?
A real-world setting, such as a neighbourhood, hospital ward or farm, where users and researchers co-design and test innovations over time. Its strength is realism; its obligations are those of research with people.
Who is responsible for safety in a field trial?
The organisation running the trial, under its safety management system and the permits it holds. Committees and regulators review and authorise; they do not take over the operator’s duty of care.
Is a regulatory sandbox an exemption from the law?
No. A sandbox is a supervised arrangement under which a regulator allows limited testing with conditions and monitoring. The regulator sets the terms and can withdraw them.
Does Labs own testbed sites?
No site is listed as a Labs testbed until a record shows who owns it, who granted permission and on what terms.
Can a company test a product in a Labs testbed?
Testbed use is designed for research under a published protocol. GCRI does not certify products, so a test result is never a product approval.
Are simulation testbeds treated differently?
They follow the same protocol rules. Their validation against observations is reported so readers can judge how far results transfer.
BerichteBeitragen

Evidenz von dieser Seite aus beitragen.

Berichte is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRILaboreLabs-EvidenzMethoden und Technik
Labore

Bringen Sie eine Methode, einen Datensatz oder eine Frage mit.

Information und Anfragen sind heute offen. Eine Anfrage erhält ein Aktenzeichen und nennt den nächsten Schritt; Bewerbungen, Zahlungen, Rechenzuteilungen und Registrierungen öffnen erst, wenn Team, Bedingungen und Prüfkapazität bestehen.