Skip to content

GCRI · Labs

研究方案

A research protocol fixes, before data are collected, what a study asks, how it will answer and what would count as an answer: the hypotheses, the design, the controls, the outcomes, the sample and the analysis. Many failures of credibility trace back to a protocol that was vague, unwritten or changed after the data were seen. This page sets out how protocols are built, registered, reviewed and reported, and what ethics committees, editors and funders rely on when they accept a study’s claims.

01画布

工作如何开展。

系统 · 围绕本主题示意

方案与复现看板

Research protocols · Labs · Quarter 3

两项重复实验运行中GCRI · Labs

协议

PR-378 sensor drift田野实验是已批准运行中
PR-705 AI triage随机化是条件设置
PR-694 message recall调查实验是已批准已完成
PR-360 heat exposure学员群组否待处理草稿

Replication R-25

原始效应
0.4 SD
复现效应
0.2 SD
结论
较小,符号相同
已发布
附数据和代码

试验平台可用性

Protocol and replication board: the screen’s structure, terms and states for Research protocols.示例名称和示意数值;是设计方案,并非记录或实时系统。

图Protocol and replication board: example names and illustrative values, not a record or a live system.

02问题

Research protocols: how the risk develops.

Hypotheses, controls and scientific acceptance. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

机制

Flexibility becomes bias

When outcomes, exclusions, covariates or stopping rules are chosen after the data are seen, many analyses become possible and the most striking one tends to be reported. Each choice looks reasonable alone; together they inflate false positives and effect sizes.

机制

Weak controls confound results

A missing control, unblinded assessment or non-random allocation lets something other than the intervention explain the difference. Design flaws cannot be repaired by analysis; they travel into every result and review built on the study.

机制

Underpowered designs mislead twice

Small samples miss real effects, and the effects they do detect tend to be overestimated. Underpowered studies that reach significance seed literatures that later, larger replications cannot match.

机制

Deviations go unreported

Protocols change for good reasons, such as slow recruitment or a safety signal. When a change is not dated, explained and reported, readers cannot tell a justified amendment from outcome switching, and reviews pool what should not be pooled.

03方法与证据

How research protocols is modelled, measured and tested.

模型、其假设、数据和不确定性,以科学家或工程师会核查的形式呈现。结构遵循已发表的方法。所取数值仅为示意,不是研究发现。

模型、方程与假设

The model structure used for research protocols, the assumptions it makes and how each is tested.

要素 i 的风险Ri = f(Hi, Ei, Vi, Ci)危害、风险暴露、脆弱性和应对能力
预期年度损失EAL = ∑k pk · Lk对年概率为 pk
耦合系统xt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
假设为何制作如何检验
在一次事件中,危害与暴露相互独立使损失积分保持可计算与基于联合记录拟合的 copula 进行比较
耦合在工作点附近是线性的让冲击通过 A 传播在线性范围之外施加扰动并比较
脆弱性曲线可以在不同地点之间迁移使用很少有本地曲线可用在有观测损失的地方据此进行验证
输入
带溯源信息的版本化数据集
成果
分布,绝不是单一数字
代码
连同模型卡和测试一起发布
复现
相同的数据、代码、环境和随机种子
标准的风险与状态空间表述;所列假设是该方法的典型假设,供审查之用,并非结果。
FAIR 指导原则 · GO FAIR 和 FORCE11W3C PROV · 万维网联盟关于一致处理不确定性的指南 · IPCCCEOS 分析就绪数据 · 地球观测卫星委员会
04In the five domains

Protocols are registered before results in every domain.

05指标

衡量什么,以及衡量得如何。

每个指标都注明其单位、频率、背后的来源类型以及数值将附带的证据标签。此处不显示数值:数值由计划依据其自身权限提供。

指标单位节奏来源类型标签
Registration before data collectionpercent of studies with a time-stamped registration年度Trial and study registries已发布统计
Primary outcome consistencypercent of reports matching the registered primary outcome年度Registry and publication comparison观测
Sample size justificationpercent of protocols with a power or precision rationale年度Protocol audit观测
Reporting guideline adherencepercent of applicable checklist items reported每项研究Assessment against CONSORT, PRISMA, ARRIVE or STROBE估算
Protocol amendmentscount per study, each with a stated reason每项研究Registry history and ethics committee records已发布统计
Registered report availabilitynumber of journals offering the format年度Center for Open Science journal list已报告
Results posting timelinessmonths from primary completion to posted results每项研究Trial registries已发布统计
Randomisation and blinding reportedpercent of eligible studies年度Risk-of-bias assessments估算
06来源

证据来自何处。

具名公共数据集与机构记录,各自注明许可类别。依协议获得的来源仅按其条款使用,绝不再次发布。

来源它提供什么许可类别
OSF Registries (Center for Open Science)Time-stamped preregistrations and registered report protocols across disciplinesOpen, licence per registration
ClinicalTrials.gov (US National Library of Medicine)Registered trials, protocol change history and posted results公有领域
WHO International Clinical Trials Registry PlatformSearch across primary national trial registriesFree, WHO terms of use
PROSPERO (NIHR)Registered protocols for systematic reviewsFree access, terms of use
protocols.ioVersioned, citable step-by-step laboratory and field methodsOpen, CC BY for public protocols
EQUATOR Network libraryReporting guidelines by study design, with extensionsFree access, licence per guideline
Crossref metadataLinks between registrations, articles, corrections and fundersOpen metadata, no restrictions
07决定

由谁决定,以及证据服务于什么。

实验室 prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

谁来决定问题本页面服务的证据
Research ethics committees and institutional review boardsWhether a protocol’s risks, consent and design justify approval, and whether an amendment needs fresh reviewComplete protocol, sample size rationale, amendment history with reasons
Journal editorsWhether to accept a registered report in principle, or whether a submitted analysis matches its planTime-stamped registration compared line by line with the manuscript
研究资助方Whether a proposal’s design can answer its question before money is committedPower or precision rationale, control conditions, data management plan
Medicines and device regulatorsWhether trial evidence was generated under the protocol submitted to themRegistry history, deviation logs, results posting record

该主题产生的产出

  • Protocol templates stating hypotheses, controls, outcomes and analysis plans before data collection
  • Registration records with time stamps and version history
  • Deviation logs that date and explain every amendment
  • Reporting checklists completed against the relevant EQUATOR guideline
08核心问题

What experts ask of any protocol.

  • What exactly is the hypothesis, and what result would count against it?
  • What is the comparison: a control group, a baseline period, a counterfactual model or a randomised arm?
  • Which outcomes are primary, which are secondary, and how will each be measured?
  • What sample, duration or number of runs is needed to detect an effect of the size that matters?
  • What would make the team stop early, for safety or for futility, and who decides?
  • What will be published if the result is null or the experiment fails?
09机制与驱动因素

Why experiments drift without a protocol.

Every experiment involves choices: which observations to exclude, which covariates to adjust for, which time window to use. Each choice may be reasonable alone, but when they are made after seeing the data, the number of possible analyses grows quickly and one of them will usually show something. This is the problem methodologists call analytic flexibility, and it is a central reason why published effects often shrink or vanish when repeated.

Interdisciplinary work adds its own drivers. Disciplines differ in what they treat as a control, how they handle missing data and what level of evidence they expect. A hydrologist, an economist and an epidemiologist may each consider a design rigorous by their own standard while disagreeing about what it shows. A protocol forces those differences into the open before work starts.

Incentives matter too. Positive, novel findings are easier to publish and fund, which rewards flexibility and penalises null results. Pre-registration and registered reports are the main structural responses.

10方法与数据

Tools protocols draw on, and where they stop.

  1. 01

    Pre-registration

    A time-stamped record of hypotheses and analysis plans. It limits post hoc changes but cannot stop a poorly chosen question.

  2. 02

    Power and design analysis

    Estimates how much data is needed to detect a meaningful effect, using 概率与统计. It depends on assumed effect sizes that are often uncertain.

  3. 03

    Causal designs

    Randomisation, difference-in-differences, regression discontinuity and instrumental variables from 因果推断. Each rests on assumptions that must be stated and, where possible, tested.

  4. 04

    Acceptance criteria

    Pre-agreed thresholds for when a method, model or prototype is considered to work. They make success testable but can be gamed if set too loosely.

A protocol cannot make a bad measurement good or fix a biased sample. Deviations from protocol are permitted when justified, but are reported with their reasons.

11方法

如何研究,以及方法无法说明的内容。

  1. 概率与统计样本量与检验效能规划 · 含偏倚评估的荟萃分析在此应用
  2. 因果推断与影响评估随机试点与阶梯式推广 · 准实验计划评估在此应用
  3. 不确定性量化与模型验证测量不确定性预算 · 模拟模型的敏感性分析在此应用
  4. 系统工程从需求到验证的可追溯性 · 阶段关口就绪审查在此应用
12Where this page’s references

Where this page’s references lead.

阅读本页时所对照的机构和文件。状态和版本会变化;每个链接都指向发布机构。

13问题

问题与解答。

What is the difference between a preregistration and a registered report?
A preregistration is a time-stamped plan deposited before analysis. A registered report is a journal format in which the plan is peer reviewed and accepted in principle before results exist, so publication does not depend on the outcome.
Does preregistration forbid exploratory analysis?
No. It separates the two. Planned analyses are reported as confirmatory; analyses suggested by the data are reported as exploratory, with that label, so readers can weigh them accordingly.
Which reporting guideline applies to my study?
It depends on the design: CONSORT for randomised trials, SPIRIT for trial protocols, PRISMA for systematic reviews, ARRIVE for animal research, STROBE for observational studies. The EQUATOR Network keeps the current list and extensions.
Can a protocol be changed after registration?
Yes, with a dated amendment and a stated reason, and with fresh ethics review where the change affects participants. What damages credibility is undisclosed change, not change itself.
Is pre-registration required for every Labs study?
It is designed to be the default for confirmatory work. Exploratory work is welcome but is labelled as exploratory, so that its findings are treated as hypotheses rather than conclusions.
Can a protocol change during a study?
Yes, for good reasons such as safety or an unforeseen data problem. Each change is dated, justified and reported alongside the result.
Who writes the protocol?
The research team writes it; a subject reviewer independent of the team is designed to check it before work begins.
报告贡献

从本页贡献证据。

Reports is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRI实验室Labs 证据方法与技术
实验室

带来一种方法、一个数据集或一个问题。

信息和咨询现已开放。每项咨询都会获得一个编号,并告知下一步;申请、付款、算力分配和注册只有在相应团队、条款和审查能力就绪时才会开放。