Skip to content

GCRI · نوآوری و تحول فناورانه

ارزیابی فناوری

Claims about technology are easy to make and hard to check. Technology assessment at The Global Centre for Risk and Innovation (GCRI) asks what a technology actually does, under which conditions, on what evidence and with what limits. Institutions can then tell a demonstration from a dependable capability before they adopt, procure or regulate. Part of innovation and technological change.

01فضای کار

The workspace for technology assessment.

خط لولهٔ نوآوری

GCRI · دروازه‌های مرحله‌ای · رابط نمونه، نه یک رکورد

Gate review in 8 dGCRI · GCRI

بر پایهٔ سطح آمادگی

TRL 2 تا 301
چرخهٔ داوری روش‌هامفهوم آزموده‌شده
TRL 4 تا 502
ممیزی برچسب شواهداعتبارسنجی آزمایشگاهی
ساخت مدل ملیاعتبارسنجی آزمایشگاهی
TRL 6 تا 701
برنامه‌ریزی ویراست گزارشآزمایشی با مالک
بازبینی پذیرش01
طراحی سالانهٔ مأموریتمالک تصمیم می‌گیرد

معیارهای آمادگی

آزمایشی در برابر دروازه

شواهد اثر85 of 70 requiredپادمان‌ها60 of 80 requiredهزینهٔ بهره‌برداری مشخص است40 از 60 مورد الزامیتعهد مالک۴۳ مورد از ۷۵ مورد الزامی

مسائل آزمایشی

  1. I-1پروانهٔ داده برای سایت آزمایشیبرای بررسی9 روز
  2. I-2پروتکل ناظر امضا شدانجام‌شده8 روز
خط لولهٔ نوآوری.رابط تصویری؛ داده‌های زنده نیست.

GCRI · خط لولهٔ نوآوری. خط لولهٔ نوآوری: نام‌های نمونه و مقادیر تبیینی، نه یک رکورد.

02What is examined

Four questions behind every assessment.

A fourth question runs through all three: what would make the technology fail, and has that been looked for?

آمادگی

سطح بلوغ آن چقدر است؟

Evidence on maturity in the intended setting, not in the most favourable one.

اعتبارسنجی

Has it been tested?

Independent tests against stated objectives, with the test conditions reported.

Claims

What exactly is claimed?

Capability statements separated into measured, estimated and asserted.

03Readiness scales

Readiness levels, what they measure and what they leave out.

Technology readiness levels run from one, basic principles observed, to nine, a system proven in its operational environment. NASA introduced them; ISO 16290:2013 defines them for space systems, and many agencies use adapted versions. A readiness level describes maturity in a stated environment. It says nothing about cost, safety in a different setting, social acceptance or whether an organisation can operate the technology.

پرسشEvidence that answers itشکاف رایج
Does it work as claimed?Independent tests against a pre-registered plan, on held-out data or in a representative environmentVendor benchmarks on data the system was tuned to
Does it work here?Trials in the target context, with local users and conditionsTransfer from a different climate, language or infrastructure
به چه چیزی بستگی دارد؟Bills of materials, supply and energy needs, skills requiredHidden dependence on a single supplier or service
چگونه شکست می‌خورد؟Adversarial and stress tests; incident recordsTesting only the expected cases
04Measurement practice

Reporting capability honestly.

  • عملکرد را با بازه‌های اطمینان و بر جمعیتی که به آن خدمت خواهد کرد گزارش کنید، نه فقط بر مجموعه‌های آزمون تجمیعی.
  • Check for contamination: test data that leaked into training inflates scores, a known problem for AI benchmarks.
  • For prediction models in health and similar settings, follow reporting guides such as TRIPOD+AI (2024).
  • Separate a demonstration, a pilot and sustained operation; each is a different claim.

The OECD’s Framework for Anticipatory Governance of Emerging Technologies of 2024 and parliamentary technology assessment offices, networked through EPTA, provide models of assessment that look beyond performance to values and institutions.

05GCRI’s part

Assessment reports, not approvals.

An assessment records what was tested, how and with what result. It confers no status and is never a condition of procurement. Assessments are designed for the Labs Evidence series and, when they concern readiness for national deployment, the Foundry Build and Readiness series; evidence would follow NS-11 of the proposed Nexus Standards. Providers can submit test plans; independent researchers can submit replications.

06Measurement rules

How capability is reported.

  • Measured capability is published with workload, data size, hardware, configuration, software version and interval
  • Peak, sustained, available and allocated capacity are reported separately
  • Device counts and specifications are descriptors, not application results
  • Energy, cooling and water use are tracked, with measurements kept apart from estimates
  • Failures and limitations found during testing are reported, not removed
07How tests run

From evaluation plan to recorded result.

  1. 01

    Evaluation plan

    Objectives, metrics, conditions and stop rules agreed before testing.

  2. 02

    آزمون کنترل‌شده

    Experiments in Labs test environments or the annual Universe programme, with independent observation.

  3. 03

    Recorded result

    Results with their method, limits and evidence label, published where rights allow.

08مرزها

Testing is not certification.

An assessment describes what was tested and found. It is not accreditation, certification, endorsement or approval for use. Evaluation never depends on a provider’s contribution. Providers start at technology and infrastructure providers. See also responsible technology and the Labs Evidence report series.

10پرسش‌ها

پرسش و پاسخ.

Can a vendor cite a GCRI assessment in marketing?
Only as a factual citation of the published result, with its scope and limits, and never as certification or endorsement. Misrepresentation can be reported to the integrity address.
Who pays for an assessment?
Terms are set out for each testbed call or agreement. Payment never buys a result, and evaluation never depends on a high contribution.
Are negative results published?
Yes, where rights allow. A technology that fails a test produces a result as valid as one that passes.
Does GCRI use readiness levels?
Readiness is described with evidence for the specific setting. Where a recognised readiness scale is referenced, it is named and the evidence for the level is shown.
Can an assessment be challenged?
Yes. Providers, researchers and the public can challenge a published assessment through the integrity route. An accepted correction creates a new recorded version with its history.
گزارش‌هامشارکت

شواهد را از همین صفحه ارسال کنید.

Reports نشریهٔ فصلی کنسرسیوم است. آنچه دربارهٔ این موضوع می‌دانید می‌تواند در ویراست بعدی به شواهد، یک مورد یا یک اصلاح تبدیل شود، به نام شما ثبت شود و در صورتی که کار خود شما باشد تحت CC BY 4.0 منتشر شود.

GCRI
⁨Global Centre for Risk and Innovation⁩

یک روش، یک مجموعه‌داده یا یک پرسش بیاورید.

اطلاعات و درخواست‌ها امروز باز است. هر درخواست یک شمارهٔ پیگیری می‌گیرد و گام بعدی را مشخص می‌کند؛ درخواست‌های عضویت، پرداخت‌ها، تخصیص رایانش و ثبت‌نام‌ها تنها زمانی باز می‌شوند که تیم، شرایط و ظرفیت داوری آن‌ها فراهم باشد.