Skip to content

GCRI · 혁신과 기술 변화

기술 평가

Claims about technology are easy to make and hard to check. Technology assessment at The Global Centre for Risk and Innovation (GCRI) asks what a technology actually does, under which conditions, on what evidence and with what limits. Institutions can then tell a demonstration from a dependable capability before they adopt, procure or regulate. Part of innovation and technological change.

01작업 공간

The workspace for technology assessment.

혁신 파이프라인

GCRI · 단계 관문 · 예시 인터페이스이며 기록이 아님

Gate review in 8 dGCRI · GCRI

성숙도 수준별

TRL 2~301
방법 검토 주기개념 시험됨
TRL 4~502
근거 라벨 감사실험실 검증
국가 모델 구축실험실 검증
TRL 6~701
보고서 판 기획소유자와 시범 운영
채택 검토01
연간 임무 설계소유자가 결정

준비도 기준

파일럿 대 게이트

효과의 근거필요 70건 중 85건보호 장치60 of 80 required운영 비용 파악됨40 of 60 required소유자 약정43 of 75 required

파일럿 문제

  1. I-1시범 사이트 데이터 라이선스확인 사항9 일 후 기한
  2. I-2참관인 규약 서명됨완료8 일 후 기한
혁신 파이프라인.예시용 인터페이스이며 실시간 데이터가 아닙니다.

GCRI · 혁신 파이프라인. 혁신 파이프라인: 예시 이름과 예시 값이며, 기록이 아닙니다.

02검토 대상

모든 평가의 바탕이 되는 네 가지 질문.

A fourth question runs through all three: what would make the technology fail, and has that been looked for?

준비

How mature is it?

Evidence on maturity in the intended setting, not in the most favourable one.

검증

시험을 거쳤습니까?

명시된 목표에 대한 독립적 시험이며, 시험 조건을 함께 보고합니다.

Claims

What exactly is claimed?

Capability statements separated into measured, estimated and asserted.

03Readiness scales

Readiness levels, what they measure and what they leave out.

Technology readiness levels run from one, basic principles observed, to nine, a system proven in its operational environment. NASA introduced them; ISO 16290:2013 defines them for space systems, and many agencies use adapted versions. A readiness level describes maturity in a stated environment. It says nothing about cost, safety in a different setting, social acceptance or whether an organisation can operate the technology.

질문Evidence that answers itCommon gap
주장한 대로 작동합니까?Independent tests against a pre-registered plan, on held-out data or in a representative environmentVendor benchmarks on data the system was tuned to
Does it work here?Trials in the target context, with local users and conditionsTransfer from a different climate, language or infrastructure
What does it depend on?Bills of materials, supply and energy needs, skills requiredHidden dependence on a single supplier or service
어떻게 실패하는가?적대적 시험 및 스트레스 시험, 사고 기록Testing only the expected cases
04측정 실무

Reporting capability honestly.

  • Report performance with confidence intervals and on the population it will serve, not only on aggregate test sets.
  • Check for contamination: test data that leaked into training inflates scores, a known problem for AI benchmarks.
  • For prediction models in health and similar settings, follow reporting guides such as TRIPOD+AI (2024).
  • Separate a demonstration, a pilot and sustained operation; each is a different claim.

The OECD’s Framework for Anticipatory Governance of Emerging Technologies of 2024 and parliamentary technology assessment offices, networked through EPTA, provide models of assessment that look beyond performance to values and institutions.

05GCRI’s part

Assessment reports, not approvals.

An assessment records what was tested, how and with what result. It confers no status and is never a condition of procurement. Assessments are designed for the Labs Evidence series and, when they concern readiness for national deployment, the Foundry Build and Readiness series; evidence would follow NS-11 of the proposed Nexus Standards. Providers can submit test plans; independent researchers can submit replications.

06Measurement rules

How capability is reported.

  • Measured capability is published with workload, data size, hardware, configuration, software version and interval
  • Peak, sustained, available and allocated capacity are reported separately
  • 기기 수와 사양은 설명 정보이며, 적용 결과가 아닙니다
  • 에너지, 냉각 및 물 사용을 추적하며, 측정값과 추정값을 구분하여 관리합니다
  • Failures and limitations found during testing are reported, not removed
07테스트 실행 방식

평가 계획에서 기록된 결과까지.

  1. 01

    Evaluation plan

    시험 전에 합의한 목표, 지표, 조건 및 중단 규칙.

  2. 02

    Controlled test

    독립적인 관찰 아래 Labs 시험 환경 또는 연례 유니버스 프로그램에서 진행하는 실험입니다.

  3. 03

    기록된 결과

    방법, 한계 및 근거 표시를 갖춘 결과로, 권리가 허용하는 범위에서 공개됩니다.

08경계

Testing is not certification.

An assessment describes what was tested and found. It is not accreditation, certification, endorsement or approval for use. Evaluation never depends on a provider’s contribution. Providers start at technology and infrastructure providers. See also responsible technology and the Labs Evidence report series.

10질문

질문과 답변.

Can a vendor cite a GCRI assessment in marketing?
Only as a factual citation of the published result, with its scope and limits, and never as certification or endorsement. Misrepresentation can be reported to the integrity address.
평가 비용은 누가 부담합니까?
Terms are set out for each testbed call or agreement. Payment never buys a result, and evaluation never depends on a high contribution.
Are negative results published?
Yes, where rights allow. A technology that fails a test produces a result as valid as one that passes.
Does GCRI use readiness levels?
Readiness is described with evidence for the specific setting. Where a recognised readiness scale is referenced, it is named and the evidence for the level is shown.
평가에 이의를 제기할 수 있습니까?
Yes. Providers, researchers and the public can challenge a published assessment through the integrity route. An accepted correction creates a new recorded version with its history.
보고서기여하기

이 페이지에서 증거를 기여하십시오.

Reports는 컨소시엄의 분기별 간행물입니다. 이 주제에 관해 귀하가 아는 것은 다음 호에서 근거, 사례 또는 정정이 될 수 있으며, 귀하의 이름으로 표시되고, 귀하 자신의 저작인 경우 CC BY 4.0으로 발행됩니다.

GCRI
글로벌 리스크 혁신 센터(Global Centre for Risk and Innovation)

방법, 데이터세트 또는 질문을 가져오십시오.

정보와 문의는 오늘부터 열려 있습니다. 문의에는 참조 번호가 부여되고 다음 단계가 안내됩니다. 신청, 결제, 컴퓨팅 할당, 등록은 해당 팀, 약관, 심사 역량이 갖추어졌을 때만 열립니다.