GCRI · 人工知能と自律システム
AI と公共サービス
Governments use algorithms to target benefits, detect fraud, triage health care, allocate inspections, translate and answer citizens’ questions. When these システム are wrong, opaque or biased, people lose services and rights they depend on, often without knowing why. This page sets out how public sector AI succeeds and fails, how it is assessed and made accountable, and what evidence serves the agencies, auditors and citizens involved.
作業の進め方。
モデル・レジストリ
AI and public services · Model registry · Release gate
モデル
| M-843 triage assistant | 公共サービス | 高 | 22 of 24 suites | 阻害中 |
| M-266 flood nowcast | 科学 | 中 | 12 のうち 11 | 公開済み |
| M-756 document search | 内部 | 低 | 8 of 8 | 公開済み |
| M-769 agent planner | エージェント型 | 高 | 12 of 16 | 評価中 |
モデルカード
- 想定用途
- トリアージ支援、判断は人が行う
- 対象外
- 適格性の決定
- 既知の限界
- まれな事例での精度が低い
- オーナー
- モデルの所有者
インシデントログ
- D-13INC要約に実在しない引用が含まれる
- D-6MIT検索拡張による根拠づけを追加
- D-2INCアップロードされたファイルによるプロンプトインジェクション
- D-1MITツール権限を縮小
Evaluation scores
vs release threshold
図Model registry: example names and illustrative values, not a record or a live system.
AI and public services: how the risk develops.
Public accountability, access and rights. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.
Errors fall on the vulnerable
People who depend most on public services are often those most affected by automated decisions, and least able to challenge them.
Historical data carry bias
Models trained on past decisions can reproduce discrimination present in those decisions, even when protected characteristics are excluded.
Opacity blocks challenge
When people cannot see that an algorithm was used or why it produced a result, they cannot contest it, and errors persist.
Accountability stays with the agency
Procuring a system from a vendor does not transfer responsibility. Agencies must be able to explain, audit and override algorithmic decisions.
How AI and public services is modelled, measured and tested.
モデル、その仮定、データ、不確実性を、科学者やエンジニアが確認する形で示します。構造は公表された手法に従っています。描かれた値は例示であり、知見ではありません。
システム・モデル
The couplings between the systems in AI and public services: signs of influence, a reinforcing and a balancing loop, and cross-links where stress jumps.
AI in public services touches the domains people depend on.
Public service AI studies are designed for the エビデンス・ブリーフ・シリーズ. The EU AI Act classifies many public-service uses as high-risk; UNESCO’s Recommendation (2021) and WHO guidance (2021) set ethical expectations.
- Algorithmic impact assessments a body publishes.
- Accounts from people affected by automated decisions.
何を、どの程度うまく測定しているか。
各指標には、その単位、更新頻度、背後にある出典の種類、値が持つことになるエビデンスのラベルが付いています。値は表示しません：プログラムが自らの権限のもとで値を提供します。
| 指標 | 単位 | 周期 | 出典の種類 | ラベル |
|---|---|---|---|---|
| Public algorithm registers | count of システム registered | per update | Government algorithm registers | 公表統計 |
| Algorithmic impact assessments completed | percent of deployed systems | 年次 | 機関の記録 | 申告済み |
| Error rate by population group | difference in error rates | per audit | Algorithm audits | 観測 |
| Decisions appealed and overturned | count and percent | 年次 | Appeals records | 公表統計 |
| Systems with human review of adverse decisions | percent of systems | レビューごと | Agency documentation | 申告済み |
| Audit findings on public sector algorithms | count by severity | per audit cycle | Audit office reports | 報告値 |
エビデンスの出所。
名前の明示された公開データセットと機関の記録。それぞれにライセンス区分があります。合意に基づく出典は、その条件のもとでのみ使用し、再公開することはありません。
| 出典 | 提供するもの | ライセンス区分 |
|---|---|---|
| Government algorithm and AI registers, such as the UK Algorithmic Transparency Recording Standard records | Public records of algorithmic tools in use | Open, Open Government Licence where applicable |
| National audit office reports on algorithms | Independent audits of public sector AI | Public records, licence per office |
| OECD.AI 政策観測所 | Government AI policies and the AI Incidents Monitor | Public, OECD terms |
| Court and ombudsman decisions on automated decision-making | Legal findings on public sector algorithms | 公的記録 |
| Canada Directive on Automated Decision-Making and its impact assessment tool | A model for impact assessment requirements | Public, Government of Canada terms |
誰が決め、エビデンスが何に役立つか。
人工知能と自律 システム prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.
| 誰が決定するか | 質問 | このページが提供するエビデンス |
|---|---|---|
| Government agencies | Whether and how to deploy an algorithm in a public service | Impact assessments; audit methods |
| Auditors and ombudspersons | Where to investigate algorithmic harm | Registers; appeals data; audit evidence |
| 議会 | What transparency and accountability to require | Comparative policy and case evidence |
このトピックが生み出す成果物
- Impact assessment templates for public sector AI
- Audit methods for disaggregated error and fairness
- Transparency record templates
- Case studies of public sector algorithm failures and fixes
What public-sector technologists ask.
- Is the system accurate for the whole population it serves, including minority groups?
- Can affected people understand a decision, challenge it and get it corrected?
- Who is accountable when an automated decision is wrong?
- Does automation improve access, or does it create new barriers for people without digital skills or connections?
How automated decisions go wrong.
システム trained on historical administrative data inherit its biases and gaps. Risk-scoring tools can concentrate scrutiny on groups already over-represented in past enforcement. Small error rates become large numbers of wrongly affected people at national scale. When staff defer to the system, known as automation bias, errors are not caught.
Opacity compounds harm: if neither public servants nor citizens can see why a decision was made, it is hard to contest and slow to correct. Access barriers arise when services move online without alternatives.
Evidence for accountable systems.
- 01
影響評価
Structured assessment of a system’s purpose, data, affected groups and safeguards before deployment, using 社会・行動科学. Quality depends on honest completion.
- 02
Fairness and error analysis
Disaggregated error rates by group, with 確率と統計. Different fairness definitions can conflict, so trade-offs must be made explicit.
- 03
Explanation and contestability
Designing decision notices and appeal routes people can use. Technical explanations do not by themselves make a decision contestable.
- 04
Audit and monitoring
Ongoing checks of outcomes and complaints after deployment.
どのように研究され、手法が言えないことは何か。
Where this page’s references lead.
このページの読解の基準となる機関と文書。状態と版は変わります。各リンクは発行機関へ移動します。
質問と回答。
What is automated decision-making?
What is an algorithmic impact assessment?
Can people challenge an algorithmic decision?
Should public services use AI at all?
What is automation bias?
Can affected people use the platform’s work?
Does the platform evaluate specific government systems?
このページからエビデンスを提供する。
報告書 is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.
- メールゲートウェイ GW-GCRIこのページから送信するエビデンス、訂正、事例、手法、レビュー、翻訳、プロファイルへの入力。このページのタグが付いて届くため、担当の編集者が受け取ります。
- Zenodoオープンな寄託寄託してコミュニティに提出するORCID iD を使って Zenodo に自分の記録を公開し、そこから Reports コミュニティに提出してください。キュレーターが審査し、DOI は引き続きあなたのものです。
- 報告書GCRI貢献のすべての方法を見る貢献の種類、それぞれの審査方法、受け取るクレジット、ライセンス、決して受け付けないもの。
個人データ、重要インフラの機微な詳細、共有する権利のないものは決して送らないでください。寄稿は利用前にレビューされます。送付によって著作者としての権利や編集上の権利が生じることはなく、スポンサーシップで調査結果を買うことは決してできません。
手法、データセット、または問いを持ち込んでください。
情報提供と問い合わせは本日から受け付けています。問い合わせには参照番号が付き、次の手順が示されます。申請、支払い、計算資源の割り当て、登録は、担当チーム、規約、審査体制が整ってから開始します。
法的文書。
このサイトの地図、データ、図表は、背景と一般的な情報として示すものです。助言、予報、警報ではありません。情報の限界は免責事項とデータに関する注意事項に記載しています。