Skip to content

GCRI · هوش مصنوعی و سامانه‌های خودمختار

هوش مصنوعی در علم

Machine learning now predicts protein structures, emulates weather and climate models, screens materials and helps analyse vast datasets. It can speed discovery, and it can also produce results that are hard to reproduce, overfit or rest on data leakage. This page sets out how AI is used in science, where it fails, how its results are checked, and what evidence serves the researchers, funders and journals involved.

02The question

AI in science: how the risk develops.

Discovery and reproducibility. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

سازوکار

Learning from data replaces some simulation

Models trained on simulations or observations can emulate expensive calculations quickly. They are reliable within the range of their training data and uncertain outside it.

سازوکار

Leakage inflates results

When information from the test set reaches training, through duplicates, time overlap or preprocessing, reported accuracy overstates real performance. Leakage is a known cause of irreproducible ML science.

سازوکار

Openness enables checking

Results can be verified only when code, data, models and settings are shared. Proprietary models and data limit independent checks.

سازوکار

Scientists stay accountable

AI can suggest hypotheses and draft text, but researchers remain responsible for methods, interpretation and integrity. Journals and funders are setting rules for AI use.

03پایش

ثبت‌خانهٔ مدل.

The screen a team would use to follow this subject: its measures, states and decisions. Names are examples and values are illustrative.

ثبت‌خانهٔ مدل

AI in science · Model registry · Release gate

یک مدل در دروازه مسدود شدGCRI · هوش مصنوعی و سامانه‌های خودمختار

مدل‌ها

M-489 triage assistantخدمات عمومیبالا20 of 24 suitesمسدود
M-530 flood nowcastعلممتوسط12 of 12منتشرشد
M-079 document searchداخلیپایین8 of 8منتشرشد
M-881 agent plannerعامل‌محوربالا11 of 16در حال ارزیابی

کارت مدل

کاربرد مورد نظر
پشتیبانی غربالگری، انسان تصمیم می‌گیرد
خارج از دامنه
تصمیم‌های صلاحیت
محدودیت‌های شناخته‌شده
دقت کمتر در موارد نادر
مالک
مالک مدل

سیاههٔ رخداد

  1. D-19INCارجاع ساختگی در چکیده
  2. D-8MITزمین‌گذاری بازیابی افزوده شد
  3. D-3INCتزریق فرمان از طریق پروندهٔ بارگذاری‌شده
  4. D-1MITمجوز ابزار محدودتر شد

Evaluation scores

vs release threshold

Task accuracy81 of 85 requiredRobustness68 of 75 requiredFairness gap (lower is better)3 of 5 requiredRefusal on misuse85 of 95 required
Model registry: the screen’s structure, terms and states for AI in science.نام‌ها نمونه و مقادیر تبیینی‌اند؛ طرحی است، نه سابقه یا سامانهٔ زنده.
05روش‌ها و شواهد

How AI in science is modelled, measured and tested.

مدل، مفروضات، داده‌ها و عدم قطعیت آن، به شکلی که دانشمند یا مهندس بررسی می‌کند. ساختارها از روش‌های منتشرشده پیروی می‌کنند. مقادیر ترسیم‌شده تبیینی‌اند، نه یافته.

مدل، معادلات و مفروضات

The model structure used for AI in science, the assumptions it makes and how each is tested.

ریسک عنصر iRi = f(Hi, Ei, Vi, Ci)مخاطره، مواجهه، آسیب‌پذیری و ظرفیت مقابله
زیان سالانهٔ مورد انتظارEAL = ∑k pk · Lkبر رویدادهای k با احتمال سالانهٔ pk
سامانه‌های جفت‌شدهxt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
فرضچرا ساخته می‌شودچگونه آزموده می‌شود
مخاطره و مواجهه در یک رویداد مستقل‌اندانتگرال زیان را تحت‌کنترل نگه می‌داردمقایسه با برازش مفصل بر سوابق مشترک
جفت‌شدگی‌ها نزدیک نقطهٔ کار خطی‌انداجازه می‌دهد شوک‌ها از طریق A منتشر شوندفراتر از دامنهٔ خطی آشفته کنید و مقایسه کنید
منحنی‌های آسیب‌پذیری میان مکان‌ها منتقل می‌شوندمنحنی‌های محلی به‌ندرت در دسترس‌انداعتبارسنجی در برابر زیان‌های مشاهده‌شده در جاهایی که وجود دارند
ورودی‌ها
مجموعه‌داده‌های نسخه‌دار با خاستگاه
خروجی‌ها
توزیع‌ها، هرگز تک‌رقم‌ها
کد
منتشرشده با کارت مدل و آزمون‌ها
بازتولید
همان داده، کد، محیط و بذر
فرمول‌بندی‌های استاندارد ریسک و فضای حالت؛ مفروضات فهرست‌شده نمونهٔ روش‌اند، برای داوری بیان شده‌اند و نتیجه نیستند.
اصول راهنمای FAIR · GO FAIR و FORCE11W3C PROV · کنسرسیوم وب جهانیGuidance on consistent treatment of uncertainties · IPCCCEOS Analysis Ready Data · Committee on Earth Observation Satellites
06نشانگرها

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitدورهٔ تکرارSource typeبرچسب
Studies sharing code and datapercent of published ML studiesper reviewPublication auditsمشاهده‌شده
Leakage issues identified in reviewscount by typeper reviewReproducibility studiesگزارش‌شده
Out-of-distribution performanceerror on held-out regimesper evaluationارزیابی مدلمشاهده‌شده
Emulator error against reference simulationerror metricper evaluationValidation runsمشاهده‌شده
Journals with AI use policiescountannualPublisher policiesDECLARED
Compute used for scientific model trainingfloating point operationsper modelModel documentationبرآوردشده
07منابع

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

منبعWhat it givesLicence class
Protein Data Bank and AlphaFold Protein Structure DatabaseExperimental and predicted protein structuresOpen, CC0 and CC BY 4.0 respectively
WeatherBench and related benchmarksStandard evaluation of data-driven weather modelsOpen, licence per benchmark (to check)
Princeton reproducibility studies on ML-based scienceSurvey of leakage and reproducibility failuresLicence per publication
Materials ProjectComputed materials properties for screeningOpen, CC BY 4.0
Publisher and funder policies on AI useRules on authorship, disclosure and reviewPublic, terms per publisher
08تصمیم‌ها

Who decides, and what the evidence serves.

هوش مصنوعی و سامانه‌ها prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

چه کسی تصمیم می‌گیردThe questionEvidence this page serves
Research teamsWhether an ML result is robust enough to publishLeakage checklists; validation protocols
Journals and reviewersWhat evidence to require for ML-based claimsReporting guidance; reproducibility evidence
Research fundersHow to fund open models, data and compute for scienceOpenness and compute evidence

Outputs this topic produces

  • Leakage and reproducibility checklists for ML studies
  • Validation protocols for scientific emulators
  • Guidance on reporting AI use in research
  • Case studies of AI in specific sciences
09Core questions

What scientists ask about AI in research.

  • Does the AI-assisted result hold when tested independently, by experiment or observation?
  • Is the model, data and code available so others can reproduce it?
  • Has data leakage between training and evaluation inflated reported performance?
  • Does the model extrapolate beyond the conditions its training data covered?
10Mechanisms

How discovery and error both scale.

Machine learning finds patterns in large datasets faster than people can, and surrogate models can emulate expensive simulations, allowing many more scenarios to be explored. In fields with good data and clear validation, such as structural biology, the gains have been substantial.

The risks are equally systematic. Leakage between training and test data has produced inflated results across many disciplines. Models trained on past data may not respect physical laws when extrapolating. Generative سامانه‌ها can fabricate plausible references or data. And when models and data are proprietary, results cannot be checked.

11Methods and data

Keeping AI-assisted science reproducible.

  1. 01

    Reporting standards

    Checklists covering data splits, leakage checks, baselines and uncertainty. Standards help only if journals and reviewers enforce them.

  2. 02

    Physics-informed and hybrid models

    Combining learned components with known physical constraints, using هوش مصنوعی و یادگیری ماشین and high-performance, cloud and edge computing. Constraints reduce but do not remove extrapolation risk.

  3. 03

    Uncertainty estimation

    Ensembles and Bayesian methods from احتمال و آمار to flag predictions the model is unsure of. Uncertainty estimates can themselves be miscalibrated.

  4. 04

    Open artefacts

    Publishing code, data and model weights where rights allow, so others can reproduce and challenge results.

13Where this page’s references

Where this page’s references lead.

نهادها و اسنادی که این صفحه بر پایهٔ آن‌ها خوانده می‌شود. وضعیت و ویراست‌ها تغییر می‌کنند؛ هر پیوند به نهاد صادرکننده می‌رود.

14پرسش‌ها

پرسش و پاسخ.

What is data leakage in machine learning?
The unintended use of information from the test data during training or model selection, which makes performance look better than it would be on genuinely new data.
Can AI replace scientific simulation?
AI emulators can approximate simulations quickly within their training range, but they need validation and can fail for conditions they have not seen.
How should AI use in research be reported?
By stating which tools were used, for what, with what settings, and how outputs were checked, following the policies of the journal and funder.
Can AI replace experiments?
No. It can prioritise which experiments to run and emulate some simulations, but claims about the world still need testing against observation or experiment.
What is data leakage?
When information from the test set, or from the future, finds its way into training, so the model appears better than it is. It is one of the most common errors in applied machine learning.
Does the platform review scientific papers?
No. It studies methods and publishes guidance and case studies. Peer review remains with journals and the scientific community.
Are AI-generated hypotheses credited?
The platform’s outputs describe the role AI played in any work, so readers can judge the result; authorship and accountability stay with people.
گزارش‌هامشارکت

شواهد را از همین صفحه ارسال کنید.

گزارش‌ها is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRIهوش مصنوعی و سامانه‌های خودمختارفناوری نماییشواهد Labs
هوش مصنوعی و سامانه‌های خودمختار

یک روش، یک مجموعه‌داده یا یک پرسش بیاورید.

اطلاعات و درخواست‌ها امروز باز است. هر درخواست یک شمارهٔ پیگیری می‌گیرد و گام بعدی را مشخص می‌کند؛ درخواست‌های عضویت، پرداخت‌ها، تخصیص رایانش و ثبت‌نام‌ها تنها زمانی باز می‌شوند که تیم، شرایط و ظرفیت داوری آن‌ها فراهم باشد.