Skip to content

GCRI · 人工智能与自主系统

AI 与公共服务

Governments use algorithms to target benefits, detect fraud, triage health care, allocate inspections, translate and answer citizens’ questions. When these 系统 are wrong, opaque or biased, people lose services and rights they depend on, often without knowing why. This page sets out how public sector AI succeeds and fails, how it is assessed and made accountable, and what evidence serves the agencies, auditors and citizens involved.

01画布

工作如何开展。

系统 · 围绕本主题示意

模型注册库

AI and public services · Model registry · Release gate

一个模型在关口被拦截GCRI · 人工智能与自主系统

模型

M-843 triage assistant公共服务高22 of 24 suites已阻止
M-266 flood nowcast科学中12 中的 11已发布
M-756 document search内部低8 of 8已发布
M-769 agent planner智能体式高12 of 16评估中

模型卡

预期用途
分诊辅助,由人决定
不在范围内
资格决定
已知局限
在罕见案例上的准确率较低
负责人
模型所有者

事件日志

  1. D-13INC摘要中出现虚构引用
  2. D-6MIT已增加检索依据
  3. D-2INC通过上传文件的提示注入
  4. D-1MIT工具权限已收窄

Evaluation scores

vs release threshold

Task accuracy87 of 85 required稳健性77 of 75 requiredFairness gap (lower is better)5 of 5 requiredRefusal on misuse94 of 95 required
Model registry: the screen’s structure, terms and states for AI and public services.示例名称和示意数值;是设计方案,并非记录或实时系统。

图Model registry: example names and illustrative values, not a record or a live system.

02问题

AI and public services: how the risk develops.

Public accountability, access and rights. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

机制

Errors fall on the vulnerable

People who depend most on public services are often those most affected by automated decisions, and least able to challenge them.

机制

Historical data carry bias

Models trained on past decisions can reproduce discrimination present in those decisions, even when protected characteristics are excluded.

机制

Opacity blocks challenge

When people cannot see that an algorithm was used or why it produced a result, they cannot contest it, and errors persist.

机制

Accountability stays with the agency

Procuring a system from a vendor does not transfer responsibility. Agencies must be able to explain, audit and override algorithmic decisions.

03方法与证据

How AI and public services is modelled, measured and tested.

模型、其假设、数据和不确定性,以科学家或工程师会核查的形式呈现。结构遵循已发表的方法。所取数值仅为示意,不是研究发现。

系统模型

The couplings between the systems in AI and public services: signs of influence, a reinforcing and a balancing loop, and cross-links where stress jumps.

++−+人工智能数据社区经济R 增强B 平衡
Causal loop diagram from the page’s systems; signs show the direction of influence. Illustrative structure for a system dynamics or network model, not estimated couplings.
FAIR 指导原则 · GO FAIR 和 FORCE11W3C PROV · 万维网联盟关于一致处理不确定性的指南 · IPCCCEOS 分析就绪数据 · 地球观测卫星委员会
04跨领域

AI in public services touches the domains people depend on.

Public service AI studies are designed for the 证据简报系列. The EU AI Act classifies many public-service uses as high-risk; UNESCO’s Recommendation (2021) and WHO guidance (2021) set ethical expectations.

  • Algorithmic impact assessments a body publishes.
  • Accounts from people affected by automated decisions.
05指标

衡量什么,以及衡量得如何。

每个指标都注明其单位、频率、背后的来源类型以及数值将附带的证据标签。此处不显示数值:数值由计划依据其自身权限提供。

指标单位节奏来源类型标签
Public algorithm registerscount of 系统 registeredper updateGovernment algorithm registers已发布统计
Algorithmic impact assessments completedpercent of deployed systems年度机构记录已声明
Error rate by population groupdifference in error ratesper auditAlgorithm audits观测
Decisions appealed and overturnedcount and percent年度Appeals records已发布统计
Systems with human review of adverse decisionspercent of systems每次审查Agency documentation已声明
Audit findings on public sector algorithmscount by severityper audit cycleAudit office reports已报告
06来源

证据来自何处。

具名公共数据集与机构记录,各自注明许可类别。依协议获得的来源仅按其条款使用,绝不再次发布。

来源它提供什么许可类别
Government algorithm and AI registers, such as the UK Algorithmic Transparency Recording Standard recordsPublic records of algorithmic tools in useOpen, Open Government Licence where applicable
National audit office reports on algorithmsIndependent audits of public sector AIPublic records, licence per office
OECD.AI 政策观察站Government AI policies and the AI Incidents MonitorPublic, OECD terms
Court and ombudsman decisions on automated decision-makingLegal findings on public sector algorithms公共记录
Canada Directive on Automated Decision-Making and its impact assessment toolA model for impact assessment requirementsPublic, Government of Canada terms
07决定

由谁决定,以及证据服务于什么。

人工智能与自主 系统 prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

谁来决定问题本页面服务的证据
Government agenciesWhether and how to deploy an algorithm in a public serviceImpact assessments; audit methods
Auditors and ombudspersonsWhere to investigate algorithmic harmRegisters; appeals data; audit evidence
立法机构What transparency and accountability to requireComparative policy and case evidence

该主题产生的产出

  • Impact assessment templates for public sector AI
  • Audit methods for disaggregated error and fairness
  • Transparency record templates
  • Case studies of public sector algorithm failures and fixes
08核心问题

What public-sector technologists ask.

  • Is the system accurate for the whole population it serves, including minority groups?
  • Can affected people understand a decision, challenge it and get it corrected?
  • Who is accountable when an automated decision is wrong?
  • Does automation improve access, or does it create new barriers for people without digital skills or connections?
09机制

How automated decisions go wrong.

系统 trained on historical administrative data inherit its biases and gaps. Risk-scoring tools can concentrate scrutiny on groups already over-represented in past enforcement. Small error rates become large numbers of wrongly affected people at national scale. When staff defer to the system, known as automation bias, errors are not caught.

Opacity compounds harm: if neither public servants nor citizens can see why a decision was made, it is hard to contest and slow to correct. Access barriers arise when services move online without alternatives.

10方法与数据

Evidence for accountable systems.

  1. 01

    影响评估

    Structured assessment of a system’s purpose, data, affected groups and safeguards before deployment, using 社会与行为科学. Quality depends on honest completion.

  2. 02

    Fairness and error analysis

    Disaggregated error rates by group, with 概率与统计. Different fairness definitions can conflict, so trade-offs must be made explicit.

  3. 03

    Explanation and contestability

    Designing decision notices and appeal routes people can use. Technical explanations do not by themselves make a decision contestable.

  4. 04

    Audit and monitoring

    Ongoing checks of outcomes and complaints after deployment.

11方法

如何研究,以及方法无法说明的内容。

  1. 社会与行为科学人类监督研究 · 受影响社区研究 · 工作场所采用研究在此应用
  2. AI 评估与保证工程人工智能系统的保证论证 · 结构化红队测试 · 部署后监测在此应用
  3. 概率与统计基准分数的不确定性 · 校准评估 · 审计抽样在此应用
  4. 人工智能与机器学习分布偏移分析 · 针对特定用途的微调 · 可解释性方法在此应用
12Where this page’s references

Where this page’s references lead.

阅读本页时所对照的机构和文件。状态和版本会变化;每个链接都指向发布机构。

13问题

问题与解答。

What is automated decision-making?
Decisions about people made wholly or partly by algorithms, such as eligibility for benefits or prioritisation for inspection, which some laws regulate specifically.
What is an algorithmic impact assessment?
A structured review before and during deployment of an algorithm’s purpose, data, risks to rights and safeguards, often required for public sector systems.
Can people challenge an algorithmic decision?
Many legal systems give rights to an explanation, human review or appeal, but these depend on knowing that an algorithm was used and on how the law applies.
Should public services use AI at all?
That is a decision for public authorities and the public. The platform’s role is to show what systems can do reliably, where they fail and what safeguards evidence supports.
What is automation bias?
The tendency of people to over-rely on automated recommendations, accepting them without adequate scrutiny even when they are wrong.
Can affected people use the platform’s work?
Yes. Outputs are written to be usable by advocates, ombudspersons and the public as well as by public servants.
Does the platform evaluate specific government systems?
Only through scoped projects with the competent authority under written terms. It does not audit systems on its own initiative or publish assessments without agreement.
报告贡献

从本页贡献证据。

报告 is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRI人工智能与自主系统指数级技术Labs 证据
人工智能与自主系统

带来一种方法、一个数据集或一个问题。

信息和咨询现已开放。每项咨询都会获得一个编号,并告知下一步;申请、付款、算力分配和注册只有在相应团队、条款和审查能力就绪时才会开放。