GCRI · Foundry
ئەیجێنت و ئۆتۆماسیۆن
AI agents can draft analyses, run pipelines and query data at a speed no team can match, which is why their authority must be explicit. An agent that can call tools can call the wrong one, read data it should not, follow instructions planted in a document, or present a draft as reviewed evidence. This page sets out how agent risk develops and spreads, how agents are evaluated before they receive authority, and the controls that let people stop them.
Agents and automation on the record.
Agents and automation: how the risk develops.
AI tools, authority and risk controls. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.
Tool reach multiplies impact
Each tool an agent can call adds a path from a model error to a real effect: a query, a write, a message, a run. Risk grows with the number of tools and the privileges behind them, not with the model alone.
Instructions arrive in data
Text retrieved from a web page, a document or a dataset can carry instructions the agent then follows. Prompt injection turns ordinary content into a control channel, so tool permissions must never depend on the agent recognising it.
Fluent error looks like evidence
Language models produce confident, well-formatted output that can be wrong, including invented citations and figures. Once an unlabelled draft enters a report, it borrows the authority of the report and the people who signed it.
Automation chains
One agent’s output becomes another’s input, or triggers a pipeline, with no person in between. An early error is copied, transformed and amplified along the chain, and the receipt trail is the only way back to where it started.
کۆنسۆڵی شوێنی کار و کارەکان.
ئەو شاشەیەی تیمێک بۆ بەدواداچوونی ئەم بابەتە بەکاری دەهێنێت: پێوەر، دۆخ و بڕیارەکانی. ناوەکان نموونەن و بەهاکان ڕوونکەرەوەن.
کۆنسۆڵی شوێنی کار و کارەکان
Agents and automation · Project space 12 · Cluster east
- کارە کارا31چالاک
- چاوەڕوانی ڕیز، p508کەمترینئاسایی
- ئەمڕۆ کاردەکات35924
- کۆتا بەکارهاتوو، % ئەم مانگە64چاودێری
کارەکان
| J-86161 | کۆمەڵەی مۆدێلی لافاو | خاوەنی پڕۆژە | 00:37:12 | کارا |
| J-42787 | ڕەندەری کاشی، زووم 0 بۆ 12 | شوێنی کاری GIS | 00:02:40 | کارا |
| J-76872 | هەناردەکردنی بەڵگە | پارێزەری مۆدێل | 00:00:47 | تەواو بوو |
| J-55145 | کۆمەڵەی بانگکردنی ئامرازی ئەیجێنت | قوتووی تاقیکاریی ئەیجێنت | 00:01:16 | بلۆکی سیاسەت |
ڕووداوی سیاسەت
- 10:25دەروازەبانگکردنی ئەیجێنت پێویستی بە پەسەندی مرۆڤ هەیە
- 10:51زانیاریتۆماری ڕاکردن لەسەر مۆر کراوە
- 11:34ئاگادارکردنەوەکۆتا گەیشتە 80 لە سەد بۆ پڕۆژەکە
Automation in Foundry is designed to keep humans in charge in every domain.
- WaterIn practiceAutomated data checks flag anomalies for people to review.What a reader can checkReview logs
- EnergyIn practiceNo automated action touches a real system.What a reader can checkAction boundaries
- HealthIn practiceAgents never access personal health data without basis.What a reader can checkAccess logs
Agent governance follows ISO/IEC 42001 and NIST’s AI RMF; agents and models carry NS-12 cards under the proposed Nexus Standards. Findings go to the Exponential Technology series.
- Security and safety reviews.
- Oversight design proposals.
How agents and automation is modelled, measured and tested.
مۆدێلەکە، گریمانەکانی، داتاکانی و نادڵنیاییەکەی، بەو شێوەیەی زانا یان ئەندازیارێک دەیپشکنێت. پێکهاتەکان ڕێگا بڵاوکراوەکان دەگرنەبەر. بەهاکانی کێشراو نموونەییە، نەک دۆزینەوە.
مۆدێل، هاوکێشەکان و گریمانەکان
The model structure used for agents and automation, the assumptions it makes and how each is tested.
Ri = f(Hi, Ei, Vi, Ci)مەترسیدەر، ڕووبەڕووبوون، لاوازی و توانای مامەڵەکردنEAL = ∑k pk · Lkover events k with annual probability pkxt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error| گریمانە | بۆچی دروست دەکرێت | چۆن تاقی دەکرێتەوە |
|---|---|---|
| مەترسیدەر و ڕووبەڕووبوون لە ناو پێشهاتێکدا سەربەخۆن | ئینتێگراڵی زیان بە ئاسانی دەهێڵێتەوە | بەراورد بکە لەگەڵ گونجاندنی کۆپیولا لەسەر تۆمارە هاوبەشەکان |
| هاوبەستییەکان لە نزیک خاڵی کارکردن هێڵین | ڕێگە دەدات شۆکەکان بڵاو ببنەوە لە A | لە دەرەوەی مەودای هێڵیی شڵەژێنە و بەراورد بکە |
| چەمکەکانی لاوازی لە شوێنێکەوە بۆ شوێنێکی تر دەگوازرێنەوە | چەمکی ناوخۆیی بە دەگمەن بەردەستە | لەگەڵ زیانە چاودێریکراوەکان پشتڕاستی بکەرەوە کە هەن |
- تێکردنەکان
- کۆمەڵە داتای وەشانکراو لەگەڵ ڕەسەنایەتی
- دەرچووەکان
- دابەشبوون، نەک یەک ژمارە
- کۆد
- بڵاوکراوەتەوە لەگەڵ کارتی مۆدێل و تاقیکردنەوەکان
- بەرهەمهێنانەوە
- هەمان داتا، کۆد، ژینگە و تۆو
What is measured, and how well.
Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.
| نیشاندەر | یەکە | ڕیتم | Source type | ناونیشان |
|---|---|---|---|---|
| Active agents with a current authority record | proportion of active agents | هەفتانە | Authority register | DECLARED |
| Tool calls denied at the policy gate | count per agent per period | daily | Policy gate logs | چاودێریکراو |
| Time from kill-switch activation to halt | seconds | per drill or event | Gate and runtime logs | چاودێریکراو |
| Agent outputs accepted after human review | proportion of outputs | مانگانە | Review records | چاودێریکراو |
| Red-team findings open at promotion | count by severity | per model version | Evaluation records | ڕاپۆرتکراو |
| Unsupported claims found in sampled outputs | count per sample | مانگانە | Reviewer audit | چاودێریکراو |
| Agent actions with a complete receipt | proportion of actions | daily | Receipt store | چاودێریکراو |
Where the evidence comes from.
Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.
| سەرچاوە | What it gives | Licence class |
|---|---|---|
| AI Incident Database | Documented real-world AI failures and harms for hazard identification | Open, terms of the database |
| OECD AI Incidents Monitor | Reported AI incidents and hazards drawn from news sources | Terms of the OECD |
| MITRE ATLAS | Adversary tactics and techniques against AI systems | Free, terms of use |
| OWASP Top 10 for large language model applications | Common vulnerability classes in language model and agent systems | CC BY-SA |
| NIST AI RMF Playbook | Suggested actions for the govern, map, measure and manage functions | دۆمەینی گشتی |
| Model cards published with open models | Intended use, evaluation and known limits of a base model | Licence per model |
Who decides, and what the evidence serves.
Foundry prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.
| کێ بڕیار دەدات | پرسیارەکە | Evidence this page serves |
|---|---|---|
| Supervising institutions | Whether an agent may act in their project, with which tools and on which data | Authority record, evaluation record, open red-team findings |
| Data owners | Whether their data may be read by agents or used to train or tune models | Data classes in scope; the recorded training decision |
| Reviewers | Whether an agent’s draft may be accepted into evidence or a report | Receipts, sources cited and checked, evidence labels |
| AI governance leads and data protection authorities | Whether automated processing meets applicable law and the institution’s AI policy | Impact assessment, logs, the human oversight record |
Outputs this topic produces
- Authority records per agent: purpose, tools, data classes, budget, kill-switch and supervisor
- Evaluation and red-team records at each promotion
- Receipts for every agent action
- Labelled drafts that remain assertions until a person reviews them
What AI and safety engineers ask.
- What exactly is this agent permitted to do, on which data, in which project?
- How was the agent and its model evaluated for this use, and by whom?
- Can every agent action be attributed to an identity, a configuration and a supervising institution?
- How quickly can a person stop it, and is that stop enforced outside the agent?
Authority records, gates and receipts.
In the design of the NXS-NSF (trust, authorisation and assurance) Sovereignty Framework (NXS-NSF), every agent and tool holds an authority record that states its purpose, the tools it may call, the data classes it may touch, its rate limits and its kill-switch. Requests without an explicit policy decision fail closed. Agent actions pass the same policy gates and receive the same receipts as human actions, and scopes and kill-switches are enforced at the gate rather than left to the agent’s own configuration.
In NXS-LAB (research, experiments and simulations), agents may run analyses and draft artefacts, but each action is bound to an agent identity, model, tool set, budget and supervising institution, and remains an assertion until a person reviews it. In NXS-STU (composition, dashboards and workflows), agent behaviour inside a composition is declared with its purpose, tools and scope.
Evaluation comes before authority.
- 01
Contract testing
Integrations and agents are tested against their declared contracts before they receive authority in any tenant.
- 02
هەڵسەنگاندنی مۆدێل
Promotion of a model requires evaluation records, including red-team results where the use calls for them.
- 03
Data use
No tenant data is used for training without a recorded decision by the data owner.
- 04
سنووردارییە ناسراوەکان
Evaluations sample behaviour and cannot exclude every failure; language models can produce fluent, wrong output; and tool-use risks grow with the number of tools an agent can reach. Narrow scopes and human review are the main mitigations.
Agents never take a decision that belongs to an institution or a competent authority, issue a warning, release funds, dispatch resources, sign an acceptance or present a draft as reviewed evidence.
How it is studied, and what the methods cannot say.
- 01Artificial intelligence and machine learningEarth observation models with spatial validation · Model cards and promotion recordsApplied here
- 02Software and safety-critical systems engineeringFail-closed policy gates · Build provenance and bills of materials · Assurance casesApplied here
- 03Systems engineeringCanonical system inventory · Contract-first interfaces · Requirements traced to evidenceApplied here
- 04Data engineering, interoperability and stewardshipValidation at the ingest boundary · Frozen data cuts for reproducible productsApplied here
Where this page’s references lead.
ئەو لەش و بەڵگەنامانەی ئەم لاپەڕەیەیان لەگەڵ دەخوێنرێتەوە. دۆخ و وەشانەکان دەگۆڕێن؛ هەر بەستەرێک دەچێتە لای لەشی دەرکەر.
پرسیار و وەڵام.
Who is accountable for an agent’s output?
Why are permissions enforced outside the agent?
Is project data used to train models?
Can I connect my own agent?
لەم لاپەڕەیەوە بەڵگە پێشکەش بکە.
Reports بڵاوکراوەی وەرزیی کۆنسۆرتیۆم ـە. ئەوەی تۆ لەسەر ئەم بابەتە دەیزانیت دەتوانێت لە وەشانی داهاتوودا ببێتە بەڵگە، کەیس یان ڕاستکردنەوە، بە ناوی خۆتەوە و لەژێر CC BY 4.0 بڵاو دەکرێتەوە کاتێک کاری خۆتە.
- ئیمەیڵدەروازەی GW-GCRIلەم لاپەڕەیەوە بینێرەبەڵگە، ڕاستکردنەوە، بابەت، ڕێگا، پێداچوونەوە، وەرگێڕان یان تێکردنی پڕۆفایل. بە نیشانەی ئەم لاپەڕەیە دەگات، بۆ ئەوەی دەستکاریکەری خاوەنەکەی وەریبگرێت.
- ZenodoOpen depositDeposit it and submit to the communityPublish your own record on Zenodo with your ORCID iD, then submit it to the Reports community there. Curators review it; the DOI stays yours.
- ڕاپۆرتەکانGCRIهەموو ڕێگاکانی بەشداری ببینەجۆرەکانی بەشداری، هەریەکە چۆن پێداچوونەوەی بۆ دەکرێت، چ ناوبردنێک وەردەگریت، مۆڵەتەکە و ئەوەی هەرگیز وەرناگیرێت.
هەرگیز داتای کەسی، وردەکاریی هەستیاری ژێرخان یان هیچ شتێک مەنێرە کە مافی بڵاوکردنەوەت نییە. بەشدارییەک پێش بەکارهێنان پێداچوونەوەی بۆ دەکرێت؛ ناردنی ماف نابەخشێت بە نووسەرایەتی یان بەڕێوەبردنی ڕاگەیاندن، و پاڵپشتی دارایی هەرگیز دۆزینەوەیەک ناکڕێت.
ڕێگایەک، کۆمەڵە داتایەک یان پرسیارێک بهێنە.
زانیاری و پرسیار ئەمڕۆ کراوەن. پرسیارێک ژمارەی ئاماژەی پێدەدرێت و هەنگاوی دواتر دیاری دەکات؛ داواکاری، پارەدان، تەرخانکردنی کۆمپیوتەر و تۆمارکردن تەنیا کاتێک دەکرێنەوە کە تیم، مەرج و توانای پێداچوونەوەیان هەبێت.
بەڵگەنامە یاساییەکان.
نەخشە، داتا و وێنەکانی ئەم ماڵپەڕە بۆ ناوەڕۆک و زانیاریی گشتی پیشان دراون. ئامۆژگاری، پێشبینی یان ئاگادارکردنەوە نین؛ سنوورەکانی زانیارییەکە لە ڕەتکردنەوەی بەرپرسیارێتی و ئاگاداریی داتادا دەستنیشان کراون.