Skip to content

GCRI · Labs

Testbeds de campo e de laboratório

A testbed is a controlled place to try something before it meets the world: a laboratory rig, a pilot plant, a field trial plot, a living lab in a neighbourhood, a regulatory sandbox. Testbeds carry risks of their own, to staff, participants, sites and neighbours, and their evidence is only as useful as the match between test and conditions of use. This page sets out how testbeds are designed, permitted, made safe and read, and who decides when a result may move on.

01Canvas

Como decorre o trabalho.

sistemas · em torno deste temaIlustrativo

Testbed operations

Field and lab testbeds · Field lab coast · Campaign 5

Sensors deployedGCRI · Labs

Sensor deployment

litoral ilustrativo

BuoyEstaçãoGaugeMarBands: tidal rangeN

Sensors

S-01 tide940.2Nominal
S-04 salinity910.4Recalibrate
S-07 wave910.2Nominal

Sensor vs reference

Testbed operations: the screen’s structure, terms and states for Field and lab testbeds.Nomes de exemplo e valores ilustrativos; um projeto, não um registro nem um sistema ativo.

Fig.Testbed operations: example names and illustrative values, not a record or a live system.

02A pergunta

Field and lab testbeds: how the risk develops.

Test environments, safety and site permissions. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mecanismo

The test is not the world

Laboratory conditions remove the variability of real sites, users and maintenance. A technology that performs on a rig may fail in heat, dust, intermittent power or untrained hands. The gap between test and operating environment is what readiness levels try to name.

Mecanismo

Hazards travel with the experiment

Pressurised sistemas, biological agents, chemicals, batteries, drones and autonomous machines can harm people outside the lab once trials move to the field. avaliação do risco has to follow the experiment to each new site and each new configuration.

Mecanismo

Permission is layered

Field work can need landowner consent, environmental and planning permits, aviation or radio authorisations, biosafety approval and community agreement. A missing permission can halt a trial midway or make its data unusable.

Mecanismo

Living labs involve people

When a trial runs in homes, streets, wards or workplaces, residents become participants. Consent, data protection, benefit sharing and exit arrangements decide whether the evidence is ethical and whether the community will host another trial.

03Métodos e evidência

How field and lab testbeds is modelled, measured and tested.

O modelo, os seus pressupostos, os seus dados e a sua incerteza, na forma que um cientista ou engenheiro verificaria. As estruturas seguem métodos publicados. Os valores representados são ilustrativos, não conclusões.

Modelo, equações e pressupostos

The model structure used for field and lab testbeds, the assumptions it makes and how each is tested.

Risco do elemento iRi = f(Hi, Ei, Vi, Ci)ameaça, exposição, vulnerabilidade e capacidade de enfrentamento
Perda anual esperadaEAL = ∑k pk · Lksobre os eventos k com probabilidade anual pk
Sistemas acopladosxt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
PressupostoPorque é feitoComo é testado
A ameaça e a exposição são independentes dentro de um eventoMantém tratável o integral de perdasComparar com um ajuste de cópula sobre registros conjuntos
Os acoplamentos são lineares perto do ponto de funcionamentoPermite que os choques se propaguem através de APerturbar para além do intervalo linear e comparar
As curvas de vulnerabilidade transferem-se entre lugaresAs curvas locais raramente estão disponíveisValidar face às perdas observadas quando existam
Entradas
conjuntos de dados versionados com proveniência
Resultados
distribuições, nunca números isolados
Código
publicado com a ficha de modelo e os testes
Reprodução
mesmos dados, código, ambiente e semente
Formulações padrão de risco e de espaço de estados; os pressupostos listados são típicos do método, indicados para revisão, não resultados.
Princípios orientadores FAIR · GO FAIR e FORCE11W3C PROV · World Wide Web ConsortiumOrientação sobre o tratamento consistente das incertezas · IPCCCEOS Analysis Ready Data · Committee on Earth Observation Satellites
04In the five domains

Testbeds test technology in each domain’s real conditions.

05Indicadores

O que é medido e com que qualidade.

Cada indicador leva sua unidade, sua periodicidade, o tipo de fonte por trás dele e a etiqueta de evidência que um valor levaria. Nenhum valor é mostrado: um programa os fornece sob sua própria autoridade.

IndicadorUnidadeCadênciaTipo de fonteRótulo
Technology readiness level at entry and exitlevel on a named TRL scaleper trialAssessment against NASA, EU or ISO 16290 definitionsDECLARADO
Independent readiness reviewpercent of readiness claims reviewed outside the teamanualProgramme review recordsOBSERVADO
Operating-environment fidelityordinal scale from laboratory to operationalper trialTest plan against the stated use environmentESTIMADO
Permits in force before startpercent of required permitsper trialPermit registerEstatísticas publicadas
Safety incidents and near missescount per thousand test hoursmensalIncident reporting systemREPORTADO
Participant consent coveragepercent of participants with recorded consentper trialConsent recordsOBSERVADO
Site restoration completedpercent of field sites restored to the agreed conditionper trialSite closure reportsREPORTADO
06Fontes

De onde vêm as evidências.

Conjuntos de dados públicos nomeados e registros institucionais, cada um com sua classe de licença. As fontes obtidas por acordo só são usadas nos seus termos e nunca são republicadas.

FonteO que ofereceClasse de licença
ESFRI roadmap and landscape analysisEuropean research infrastructures, their scope and access conditionsFree access, attribution
MERIL portal (European Science Foundation)Inventory of European research infrastructures open to external usersFree access, terms of use
European Network of Living Laboratórios member directoryLiving labs, their domains and contact pointsFree access, terms of use
Testing and Experimentation Facilities (European Commission, Digital Europe Programme)Sector testbeds for artificial intelligence in manufacturing, health, agri-food and citiesPublic programme records
CORDIS (Comissão Europeia)Funded projects, pilot sites, deliverables and reported readinessFree and open, CC BY
Global BioLabs (King’s College London and George Mason University)Mapped high-containment laboratories and their biosafety governanceFree access, attribution
National permit and incident registersField-trial permits, release authorisations and reportable incidentsBy agreement with each authority
07Decisões

Quem decide, e a que servem as evidências.

Laboratórios prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Quem decideA perguntaEvidências a que esta página serve
Institutional biosafety and safety committeesWhether an experiment may run at a given containment level or field siteHazard assessment, containment design, training and incident records
Environmental, aviation and spectrum regulatorsWhether a field release, flight or transmission may be authorisedTest plan, site description, mitigation and monitoring arrangements
Programme managers at funding agenciesWhether a technology has earned the next readiness gate and its fundingReadiness evidence per level, independent review, fidelity statement
Host communities and landownersWhether to host a trial, on what terms, and how it endsPlain-language trial description, data use, benefits and restoration plan

Produtos que este tema gera

  • Test plans stating the operating environment, the hazards and the exit criteria for each readiness level
  • Permit and safety registers kept with the trial record
  • Readiness assessments with evidence attached to each level claimed
  • Site agreements and closure records for field and living-lab trials
08Questões centrais

What experts ask before a test begins.

  • How close are the testbed’s conditions to the real setting where the result will be used?
  • What can be controlled, what can only be observed, and what is unknown?
  • What could go wrong for people, equipment or the environment, and how is it contained?
  • Who owns the site and the data, and who has granted permission to use them?
  • How will the testbed be returned to its original state when the work ends?
09Mecanismos e fatores

Why the gap between test and reality matters.

The value of a testbed lies in control: it removes or fixes some sources of variation so that the effect of interest can be seen. The cost of control is realism. A water treatment process that works in a laboratory may fail with real source water that varies by season; a forecasting tool that performs well on historical data may degrade when the system changes. Engineers call this the validity trade-off, and it is never eliminated, only managed.

Field testbeds narrow the gap but bring new risks. They involve communities, landowners, operators and regulators, each with legitimate interests. They can disrupt services, collect personal data or affect ecosystems. Safety cases, consent and permissions are therefore part of the science, not administration around it.

sistemas engineering offers a staged path: component tests, integrated tests in simulation, limited field trials and wider pilots, with criteria for moving between stages.

10Métodos e dados

How testbeds are characterised.

  1. 01

    Testbed description

    A record of the environment, instruments, calibration, boundary conditions and known deviations from the target setting.

  2. 02

    Hazard and safety analysis

    Structured identification of failure modes and controls, drawing on engenharia de sistemas practice. It reduces but does not remove residual risk.

  3. 03

    Simulation and digital models

    Virtual testbeds that allow many runs at low cost. Their results are only as good as the model’s validation.

  4. 04

    Readiness staging

    Explicit criteria for moving from bench to simulation to field. Staging helps decisions but readiness levels are coarse and can hide important differences.

A testbed result shows performance under the tested conditions. Generalising beyond them requires further evidence and is reported as a separate claim.

11Métodos

Como é estudado e o que os métodos não podem dizer.

  1. Engenharia de sistemasRastreabilidade dos requisitos à verificação · Avaliações de prontidão por etapasAplicado aqui
  2. Quantificação da incerteza e validação de modelosOrçamentos de incerteza de medição · Análise de sensibilidade de modelos de simulaçãoAplicado aqui
  3. Probabilidade e estatísticaPlanejamento do tamanho amostral e do poder estatístico · Metanálise com avaliação de viesesAplicado aqui
  4. Inferência causal e avaliação de impactoPilotos randomizados e implantações escalonadas · Avaliação quase experimental de programasAplicado aqui
12Where this page’s references

Where this page’s references lead.

Os organismos e documentos à luz dos quais esta página é lida. O estado e as edições mudam; cada ligação leva ao organismo emissor.

13Perguntas

Perguntas e respostas.

What does a technology readiness level measure?
How far a technology has been demonstrated, from basic principles observed to a system demonstrated in its operating environment. It says nothing about market readiness, cost or social acceptance, which need their own evidence.
What is a living lab?
A real-world setting, such as a neighbourhood, hospital ward or farm, where users and researchers co-design and test innovations over time. Its strength is realism; its obligations are those of research with people.
Who is responsible for safety in a field trial?
The organisation running the trial, under its safety management system and the permits it holds. Committees and regulators review and authorise; they do not take over the operator’s duty of care.
Is a regulatory sandbox an exemption from the law?
No. A sandbox is a supervised arrangement under which a regulator allows limited testing with conditions and monitoring. The regulator sets the terms and can withdraw them.
Does Labs own testbed sites?
No site is listed as a Labs testbed until a record shows who owns it, who granted permission and on what terms.
Can a company test a product in a Labs testbed?
Testbed use is designed for research under a published protocol. GCRI does not certify products, so a test result is never a product approval.
Are simulation testbeds treated differently?
They follow the same protocol rules. Their validation against observations is reported so readers can judge how far results transfer.
RelatóriosContribuir

Contribua com evidências a partir desta página.

Relatórios is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRILaboratóriosEvidências de LabsMétodos e documentos técnicos
Laboratórios

Traga um método, um conjunto de dados ou uma pergunta.

A informação e os pedidos estão abertos hoje. Um pedido recebe uma referência e indica o próximo passo; candidaturas, pagamentos, alocações de computação e registros só abrem quando existem a equipa, os termos e a capacidade de revisão.