GCRI · 人工智能与自主系统
方法与不确定性
The methods Artificial Intelligence and Autonomous 系统 relies on: their equations and assumptions, the data they need, how they are validated and the limits of what they can show.
事情发生的顺序。
- 01草稿已引用来源，已附标签
- 02证据核查每个数值均可追溯
- 03独立审查已申报的利益冲突
- 04版本连同其局限一并发布
- 05更正新版本，绝不进行无声修改
使用中的方法。
Each method, its role in this field and how it is checked.
- Ai MLRole hereArtificial intelligence and machine learning is the technology this platform stewards for the network.Checks appliedHeld-out evaluation; Dataset documentation; Drift monitoring
- Ai assuranceRole hereAI evaluation and assurance engineering is the second method this platform stewards.Checks appliedIndependent review; Evidence currency; Coverage reporting
- ComputingRole hereHigh-performance and cloud computing supply the capacity AI needs.Checks appliedMeasurement boundaries; Reproducible configuration; Provider data verification
- Probability statisticsRole hereProbability and statistics make AI evaluation trustworthy: confidence intervals on scores, significance of differences between models, calibration of predicted probabilities and sampling designs for audits.Checks appliedInterval reporting; Multiple comparisons; Sample size planning
- 网络安全Role hereCybersecurity and cryptography protect AI systems and the data they use.Checks appliedThreat model review; Provenance verification; Regression testing
- 社会科学Role hereSocial and behavioural science studies how people use, trust and are affected by AI.Checks appliedEthics review; Pre-registration; Representative sampling
- 机器人Role hereRobotics and automation bring AI into physical systems.Checks appliedScenario coverage; Simulation validity; Standards conformity
流程如何运行。
Process explorer · Process
Methods and uncertainty: PRISMA 2020 review reporting
10 steps·4 个阶段
流程
Methods and uncertainty: PRISMA 2020 review reporting
PRISMA 2020 是系统综述的报告指南；各步骤依循其核查清单，而非强制顺序，且没有任何 Nexus 文件采纳它。
01 Plan
- 01注册与协议记录 · 审查团队该指南要求说明注册信息、方案的获取方式以及任何修订。
- 02资格标准记录 · 审查团队该指南要求说明纳入与排除标准以及研究的分组方式。
02 查找与遴选
- 03检索：来源与策略步骤 · 审查团队该指南要求说明信息来源与完整的检索策略。它并不规定使用哪些来源。
- 04研究的遴选步骤 · 审查团队该指南要求说明如何判定研究符合纳入条件，包括有多少名审查人进行筛选。它并不规定审查人数量。
- 05流程图记录流程图显示检索到的记录数量、纳入的研究数量以及排除的理由。
03 分析
- 06数据收集步骤 · 审查团队该指南要求说明如何从报告中收集数据以及寻求了哪些数据项。
- 07偏倚风险步骤 · 审查团队该指南要求说明评估偏倚风险所使用的方法与工具。
- 08综合模型 · 审查团队该指南要求说明效应量指标与综合方法。它并不规定必须进行荟萃分析。
- 09证据的确定性步骤 · 审查团队该指南要求说明评估确定性所用的方法，并按结局报告结果。它并未指定分级量表。
04 报告
- 10审查报告记录该指南帮助作者报告开展综述的原因、所做的工作以及所得的发现。
报告Outline of an externally published reporting guideline, not a Nexus process and not a record of operation. PRISMA 2020 mainly covers reviews of intervention effects. No Nexus page names it. Every programme is at service level R0.
Where uncertainty in AI analysis comes from, and how it is shown.
| 来源 | Why it matters here | How it is reported |
|---|---|---|
| Benchmark validity | Benchmarks saturate and leak into training data | Several evaluations, held-out tests, dates stated |
| Capability elicitation | Measured capability depends on prompting and tools | Elicitation effort described |
| Deployment context | Risk depends on use, not only the model | Use-specific assessment |
| Incident data | Reporting is voluntary and uneven | Incident sources and coverage stated |
Evaluation results carry the model version, date and setup; AI capability changes quickly and old results expire.
如何报告不确定性。
- 01
说明假设
每项分析都列出其假设及其所依赖的数据。
- 02
尽可能量化
在报告中心估计值的同时报告区间与置信度。
- 03
验证与比较
模型会对照观测数据进行核查，并在可能时与其他模型进行对照。
- 04
发布限制
分析无法说明的内容与其能够说明的内容并列陈述。
Where this page’s references lead.
阅读本页时所对照的机构和文件。状态和版本会变化；每个链接都指向发布机构。
问题与解答。
方法是开放的吗？
从本页贡献证据。
Reports is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.
- 电子邮件网关 GW-GCRI从本页发送证据、更正、案例、方法、审查、翻译或概况投稿。它会带上本页标签送达，由负责的编辑接收。
- Zenodo开放存缴存缴并提交到社区用您的 ORCID iD 在 Zenodo 上发布您自己的记录，然后提交到那里的 Reports 社区。由策展人审核；DOI 仍归您所有。
- 报告GCRI查看所有贡献方式贡献类型、各自的评审方式、您获得的署名、许可协议，以及绝不接受的内容。
切勿发送个人数据、敏感基础设施细节或您无权分享的任何内容。贡献在使用前会经过审查；发送贡献不赋予署名权或编辑权，赞助也绝不能换取研究结论。
法律文件。
本网站上的地图、数据和图表仅作为背景和一般信息展示。它们不是建议、预测或预警；信息的局限见免责声明和数据说明。