Skip to content

GCRI · Zîrekiya çêkirî û pergalên xweser

Ewlehiya sîber a AI

AI and cybersecurity meet in three ways: AI pergalan can be attacked, AI can help attackers, and AI can help defenders. Models can be poisoned, stolen, manipulated or made to leak data; their supply chains of data, weights and libraries carry new risks. This page sets out how these threats work, how AI systems are secured, and what evidence serves the security teams and regulators responsible.

01Qeyd

AI cyber security on the record.

02The question

AI cyber security: how the risk develops.

Adversarial methods and model exposure. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mekanîzma

Models are attack surfaces

Adversarial inputs, prompt injection, data extraction and model theft target the model itself. Classic application vulnerabilities still apply around it.

Mekanîzma

The AI supply chain is long

Training data, pretrained weights, libraries and plugins come from many sources. Poisoned data or tampered models can introduce hidden behaviour.

Mekanîzma

AI lowers the cost of some attacks

Generative AI can draft phishing, translate lures and help write code, lowering the skill barrier for some attacks. The size of this effect is studied and debated.

Mekanîzma

AI assists defence

Machine learning detects anomalies, triages alerts and finds vulnerabilities. Defenders must also secure the AI tools they adopt.

03Simulator

Kaskadeyek di tevahiya torên girêdayî de.

A Şopa metirsîyê hebûnên li heman cihî di her qatê de ji holê radike; perçebûn, girêdayîbûna di navbera qatan de û barkirina zêde ya yên mayî paşê têkçûnê belav dikin. Dîmena 3D qatan bi kûrahiyê ji hev vediqetîne. Modela hînkirinê bi nirxên ronîker ên diyarkirî, ne pêşbînî.

Kontrol

Mal û milk her qat
18
Metirsî: şop
8% ya qadê
Mal û milkên ku bi qateke din ve girêdayî ne
60%
Kapasîteya zêde (tolerans)
30%

Xwendin

Mal û milkên ku metirsî bandor li wan kiriye
7%
Mal û milkên ku hê dixebitin
50%
Mezinbûna zerara destpêkê
6.8 times
Gavên çareserkirinê
3
Jimar, rêbaz û çavkanî
GavNavendên daneyê yên ku dixebitin (%)Tor yên ku dixebitin (%)Hêz dixebite (%)
08394100
1727894
2616750
3616722

Rêbaz

  1. Torên girêdayî Buldyrev û yên din (2010), Catastrophic cascade of failures in interdependent networks, Nature 464
  2. Zincîra barkêşiya zêde Motter and Lai (2002), Physical Review E 66
  3. Barê navbeynkariyê Brandes (2001), Journal of Mathematical Sociology 25
  4. Torên pirqat Kivela and others (2014), Journal of Complex Networks 2
  5. Girêdayîbûnên binesazê Rinaldi, Peerenboom and Kelly (2001), IEEE Control Systems 21(6)
  6. Pankeya nediyarîyê (Monte Carlo ya parametreyan) Spiegelhalter, Pearson and Short (2011), Visualising uncertainty about the future, Science 333
  7. Hesasiyeta yek-yek (tornado) Saltelli and others (2008), Global Sensitivity Analysis: The Primer, Wiley

Dane

The model runs on the teaching values set by the controls. To calibrate it for a place, read it against these admitted layers and series, which this page’s map can draw:

  • Rêyên sereke Natural Earth
  • Rêhesin Natural Earth
  • Benderên behrê Natural Earth
  • Balafirgeh Natural Earth
  • Dirêjahiyên bajarî Natural Earth
  • Ronahiya şevê îşev, qutbûn (VIIRS Day/Night Band) NASA/NOAA VIIRS (Suomi NPP) · register nasa.gibs.context-live-layers
  • Bûyerên xwezayî (NASA EONET) NASA EONET · tomar nasa.eonet.events
Zincîra bandorê di torên girêdayî de. Modela fêrkirinê ya nimûneyî: ew li ser nirxên ku kontrol destnîşan dikin dimeşe, ne li ser daneyên pîvandî. Rêbaz: Torên girêdayî (Buldyrev and others (2010), Catastrophic cascade of failures in interdependent networks, Nature 464); Zincîra barkêşiya zêde (Motter and Lai (2002), Physical Review E 66); Barê navbeynkariyê (Brandes (2001), Journal of Mathematical Sociology 25).
04Li seranserê qadan

AI changes cyber risk in every domain’s control systems.

05Rêbaz û delîl

How AI cyber security is modelled, measured and tested.

Model, texmînên wî, daneyên wî û nediyariya wî, bi şeweyê ku zanyar an endezyar kontrol bike. Avahî rêbazên weşandî dişopînin. Nirxên hatine xêzkirin nimûneyî ne, ne encam in.

Modela pergalê

The couplings between the systems in AI cyber security: signs of influence, a reinforcing and a balancing loop, and cross-links where stress jumps.

++−+Zîrekiya çêkirîDaneCivakAborîR xurtkerB hevseng
Causal loop diagram from the page’s systems; signs show the direction of influence. Illustrative structure for a system dynamics or network model, not estimated couplings.
Prensîbên rêber ên FAIR · GO FAIR û FORCE11W3C PROV · World Wide Web ConsortiumRêwerzên ji bo birêvebirina hevgirtî ya nediyarîyan · IPCCCEOS Analysis Ready Data · Committee on Earth Observation Satellites
06Nîşander

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeNîşan
Vulnerabilities reported in AI frameworks and librariescount of CVE entriesmonthlyVulnerability databasesREPORTED
Adversarial robustnessaccuracy under a stated attackper evaluationRobustness testingÇAVDÊRÎKIRÎ
Models with signed provenancepercent of deployed modelsper inventoryModel registriesDECLARED
AI-related security incidentscount by techniqueannualIncident reportsREPORTED
Time to detect AI system compromisehoursper incidentIncident response recordsÇAVDÊRÎKIRÎ
Organisations with AI security policiespercent of surveyed organisationsper surveyIndustry surveysREPORTED
07Çavkanî

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

ÇavkanîWhat it givesLicence class
MITRE ATLASAdversarial tactics and techniques against AI pergalan, with case studiesPublic, licence to check
NIST adversarial machine learning taxonomyTerminology and taxonomy of attacks and mitigationsPublic domain, US government
National Vulnerability Database and CVE recordsVulnerabilities in AI softwarePublic domain, US government
ENISA reports on AI cybersecurityThreat landscape and good practice for securing AIPublic, ENISA terms
Joint guidance from national cyber agencies on secure AI system developmentSecure design, development, deployment and operationPublic, terms per agency
08Biryar

Who decides, and what the evidence serves.

Zîrekiya çêkirî û Pergal prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Kî biryarê dideThe questionEvidence this page serves
Chief information security officersHow to secure AI systems the organisation builds or buysThreat models; supply chain checklists
National cybersecurity agenciesWhat guidance to issue on AI securityIncident and vulnerability evidence
PêşdebirWhich defences to build into models and applicationsRobustness testing; attack taxonomies

Outputs this topic produces

  • Threat models for AI deployments
  • AI supply chain security checklists
  • Robustness testing protocols
  • Evidence notes on AI-enabled attack trends
09Core questions

What security researchers ask.

  • How can inputs be crafted to make a model misbehave, and how robust are defences?
  • Can an attacker poison training data or tamper with model weights in the supply chain?
  • Can private training data or a model itself be extracted through its outputs?
  • How does AI change attackers’ and defenders’ capabilities?
10Mechanisms

The AI attack surface.

Adversarial examples are inputs altered in ways imperceptible to people that cause models to err. Data poisoning inserts malicious examples into training data to plant backdoors. Membership inference and extraction attacks recover information about training data or replicate a model through repeated queries. For language models, jailbreaks and prompt injection bypass intended restrictions.

On the other side, AI can help attackers find vulnerabilities, write malware variants and craft convincing phishing at scale, and help defenders triage alerts, analyse code and detect anomalies. The balance between the two is an open research question.

11Methods and data

Security engineering for AI.

  1. 01

    Red-teaming

    Structured attempts to break a system, combining ewlehiya sîber û kriptografî and artificial intelligence and machine learning expertise. Red-teaming finds problems but cannot prove their absence.

  2. 02

    Threat modelling

    Mapping assets, adversaries and attack paths across data, training, deployment and supply chain.

  3. 03

    Robustness testing

    Measuring performance under adversarial perturbation. Robustness to known attacks does not imply robustness to new ones.

  4. 04

    Supply-chain integrity

    Provenance of datasets, models and dependencies, with signing and verification. Provenance tooling is still maturing.

13Where this page’s references

Where this page’s references lead.

Sazî û belgeyên ku ev rûpel li hember wan tê xwendin. Rewş û çap diguherin; her girêdan diçe ba saziya derxistinê.

14Pirs

Pirs û bersiv.

What is data poisoning?
Manipulating training data so that a model learns hidden behaviours or performs worse, for example responding to a trigger in a way the attacker chooses.
What is MITRE ATLAS?
A knowledge base of adversary tactics and techniques against AI systems, modelled on MITRE ATT&CK, with real-world case studies.
Does AI make cyberattacks easier?
It can lower the effort for some tasks, such as writing phishing messages, according to agency assessments. How much it changes overall attack capability is still being studied.
Does the platform publish attack techniques?
Only at a level that supports defence, following responsible disclosure. Details that would mainly enable harm are not published.
How do I report a vulnerability?
Binivîse bo forma raporê ya ewlehiyê. The acknowledgement gives a reference and names the next step.
Is open release of model weights a security risk?
It is a trade-off. Open weights enable scrutiny, research and local control, and also make misuse and the removal of safeguards easier. The balance depends on the model’s capabilities.
Can AI defend against AI-enabled attacks?
It can help, but it is not a complete answer. Basic security practices, monitoring and human expertise remain essential.
rêzeya Pergalên StratejîkTevkarî bike

Ji vê rûpelê delîl bidin.

rêzeya Pergalên Stratejîk is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRIZîrekiya çêkirî û pergalên xweserTeknolojiya eksponensiyelDelîlên Labs
Zîrekiya çêkirî û pergalên xweser

Rêbazek, danehevek an pirsek bîne.

Agahî û pirs îro vekirî ne. Pirsek referansekê distîne û gava piştî wê dide nasîn; serlêdan, drav, veqetandina hesabkirinê û tomarkirin tenê dema ku tîm, mercên wê û kapasîteya vekolînê hebin vedibin.