Skip to content

GCRI · Labs

Protocolli di ricerca

A research protocol fixes, before data are collected, what a study asks, how it will answer and what would count as an answer: the hypotheses, the design, the controls, the outcomes, the sample and the analysis. Many failures of credibility trace back to a protocol that was vague, unwritten or changed after the data were seen. This page sets out how protocols are built, registered, reviewed and reported, and what ethics committees, editors and funders rely on when they accept a study’s claims.

01Canvas

Come si svolge il lavoro.

sistemi · intorno a questo temaIllustrativo

Pannello di protocolli e replicazione

Research protocols · Labs · Quarter 3

Due repliche in esecuzioneGCRI · Labs

Protocolli

PR-378 sensor driftEsperimento sul campoSìApprovatoIn esecuzione
PR-705 AI triageRandomizzatoSìCondizioniConfigurazione
PR-694 message recallEsperimento di indagineSìApprovatoCompletato
PR-360 heat exposureCoorteNoIn sospesoBozza

Replication R-25

Effetto originale
0.4 SD
Effetto di replica
0.2 SD
Verdetto
Più piccolo, stesso segno
Pubblicato
con dati e codice

Disponibilità dei banchi di prova

Protocol and replication board: the screen’s structure, terms and states for Research protocols.Nomi di esempio e valori illustrativi; un progetto, non un registro né un sistema attivo.

Fig.Protocol and replication board: example names and illustrative values, not a record or a live system.

02La domanda

Research protocols: how the risk develops.

Hypotheses, controls and scientific acceptance. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Meccanismo

Flexibility becomes bias

When outcomes, exclusions, covariates or stopping rules are chosen after the data are seen, many analyses become possible and the most striking one tends to be reported. Each choice looks reasonable alone; together they inflate false positives and effect sizes.

Meccanismo

Weak controls confound results

A missing control, unblinded assessment or non-random allocation lets something other than the intervention explain the difference. Design flaws cannot be repaired by analysis; they travel into every result and review built on the study.

Meccanismo

Underpowered designs mislead twice

Small samples miss real effects, and the effects they do detect tend to be overestimated. Underpowered studies that reach significance seed literatures that later, larger replications cannot match.

Meccanismo

Deviations go unreported

Protocols change for good reasons, such as slow recruitment or a safety signal. When a change is not dated, explained and reported, readers cannot tell a justified amendment from outcome switching, and reviews pool what should not be pooled.

03Metodi ed evidenze

How research protocols is modelled, measured and tested.

Il modello, le sue ipotesi, i suoi dati e la sua incertezza, nella forma in cui uno scienziato o un ingegnere li verificherebbe. Le strutture seguono metodi pubblicati. I valori rappresentati sono illustrativi, non risultati.

Modello, equazioni e ipotesi

The model structure used for research protocols, the assumptions it makes and how each is tested.

Rischio dell'elemento iRi = f(Hi, Ei, Vi, Ci)pericolo, esposizione, vulnerabilità e capacità di risposta
Perdita annua attesaEAL = ∑k pk · Lksu eventi k con probabilità annua pk
Sistemi accoppiatixt+1 = A xt + B ut + εtA carries the couplings, u the shock, ε the error
IpotesiPerché è realizzatoCome viene testato
Pericolo ed esposizione sono indipendenti all'interno di un eventoMantiene trattabile l'integrale delle perditeConfrontare con un adattamento di copula su registrazioni congiunte
Gli accoppiamenti sono lineari vicino al punto di funzionamentoConsente agli shock di propagarsi attraverso APerturbare oltre l'intervallo lineare e confrontare
Le curve di vulnerabilità si trasferiscono da un luogo all'altroLe curve locali sono raramente disponibiliValidare rispetto alle perdite osservate, dove esistono
Input
set di dati versionati con provenienza
Risultati
distribuzioni, mai valori singoli
Codice
pubblicato con la scheda del modello e i test
Riproduzione
stessi dati, codice, ambiente e seed
Formulazioni standard del rischio e dello spazio degli stati; le ipotesi elencate sono tipiche del metodo, dichiarate per la revisione, non risultati.
Principi guida FAIR · GO FAIR e FORCE11W3C PROV · World Wide Web ConsortiumGuidance on consistent treatment of uncertainties · IPCCCEOS Analysis Ready Data · Comitato sui satelliti per l'osservazione della Terra
04In the five domains

Protocols are registered before results in every domain.

05Indicatori

Cosa viene misurato e con quale accuratezza.

Ogni indicatore riporta la sua unità, la sua cadenza, il tipo di fonte su cui si basa e l'etichetta di evidenza che un valore riporterebbe. Non sono mostrati valori: un programma li fornisce sotto la propria autorità.

IndicatoreUnitàCadenzaTipo di fonteEtichetta
Registration before data collectionpercent of studies with a time-stamped registrationannualeTrial and study registriesStatistiche pubblicate
Primary outcome consistencypercent of reports matching the registered primary outcomeannualeRegistry and publication comparisonOSSERVATO
Sample size justificationpercent of protocols with a power or precision rationaleannualeProtocol auditOSSERVATO
Reporting guideline adherencepercent of applicable checklist items reportedper studioAssessment against CONSORT, PRISMA, ARRIVE or STROBESTIMATO
Protocol amendmentscount per study, each with a stated reasonper studioRegistry history and ethics committee recordsStatistiche pubblicate
Registered report availabilitynumber of journals offering the formatannualeCenter for Open Science journal listRIPORTATO
Results posting timelinessmonths from primary completion to posted resultsper studioTrial registriesStatistiche pubblicate
Randomisation and blinding reportedpercent of eligible studiesannualeRisk-of-bias assessmentsSTIMATO
06Fonti

Da dove provengono le evidenze.

Set di dati pubblici e registri istituzionali specifici, ciascuno con la sua classe di licenza. Le fonti soggette ad accordo sono utilizzate solo alle relative condizioni e mai ripubblicate.

FonteCosa fornisceClasse di licenza
OSF Registries (Center for Open Science)Time-stamped preregistrations and registered report protocols across disciplinesOpen, licence per registration
ClinicalTrials.gov (US National Library of Medicine)Registered trials, protocol change history and posted resultsPubblico dominio
WHO International Clinical Trials Registry PlatformSearch across primary national trial registriesFree, WHO terms of use
PROSPERO (NIHR)Registered protocols for systematic reviewsFree access, terms of use
protocols.ioVersioned, citable step-by-step laboratory and field methodsOpen, CC BY for public protocols
EQUATOR Network libraryReporting guidelines by study design, with extensionsFree access, licence per guideline
Crossref metadataLinks between registrations, articles, corrections and fundersOpen metadata, no restrictions
07Decisioni

Chi decide, e a cosa servono le evidenze.

Laboratori prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Chi decideLa domandaEvidenze fornite da questa pagina
Research ethics committees and institutional review boardsWhether a protocol’s risks, consent and design justify approval, and whether an amendment needs fresh reviewComplete protocol, sample size rationale, amendment history with reasons
Journal editorsWhether to accept a registered report in principle, or whether a submitted analysis matches its planTime-stamped registration compared line by line with the manuscript
Finanziatori della ricercaWhether a proposal’s design can answer its question before money is committedPower or precision rationale, control conditions, data management plan
Medicines and device regulatorsWhether trial evidence was generated under the protocol submitted to themRegistry history, deviation logs, results posting record

Output prodotti da questo argomento

  • Protocol templates stating hypotheses, controls, outcomes and analysis plans before data collection
  • Registration records with time stamps and version history
  • Deviation logs that date and explain every amendment
  • Reporting checklists completed against the relevant EQUATOR guideline
08Questioni centrali

What experts ask of any protocol.

  • What exactly is the hypothesis, and what result would count against it?
  • What is the comparison: a control group, a baseline period, a counterfactual model or a randomised arm?
  • Which outcomes are primary, which are secondary, and how will each be measured?
  • What sample, duration or number of runs is needed to detect an effect of the size that matters?
  • What would make the team stop early, for safety or for futility, and who decides?
  • What will be published if the result is null or the experiment fails?
09Meccanismi e fattori

Why experiments drift without a protocol.

Every experiment involves choices: which observations to exclude, which covariates to adjust for, which time window to use. Each choice may be reasonable alone, but when they are made after seeing the data, the number of possible analyses grows quickly and one of them will usually show something. This is the problem methodologists call analytic flexibility, and it is a central reason why published effects often shrink or vanish when repeated.

Interdisciplinary work adds its own drivers. Disciplines differ in what they treat as a control, how they handle missing data and what level of evidence they expect. A hydrologist, an economist and an epidemiologist may each consider a design rigorous by their own standard while disagreeing about what it shows. A protocol forces those differences into the open before work starts.

Incentives matter too. Positive, novel findings are easier to publish and fund, which rewards flexibility and penalises null results. Pre-registration and registered reports are the main structural responses.

10Metodi e dati

Tools protocols draw on, and where they stop.

  1. 01

    Pre-registration

    A time-stamped record of hypotheses and analysis plans. It limits post hoc changes but cannot stop a poorly chosen question.

  2. 02

    Power and design analysis

    Estimates how much data is needed to detect a meaningful effect, using probabilità e statistica. It depends on assumed effect sizes that are often uncertain.

  3. 03

    Causal designs

    Randomisation, difference-in-differences, regression discontinuity and instrumental variables from inferenza causale. Each rests on assumptions that must be stated and, where possible, tested.

  4. 04

    Acceptance criteria

    Pre-agreed thresholds for when a method, model or prototype is considered to work. They make success testable but can be gamed if set too loosely.

A protocol cannot make a bad measurement good or fix a biased sample. Deviations from protocol are permitted when justified, but are reported with their reasons.

11Metodi

Come viene studiato, e cosa i metodi non possono dire.

  1. Probabilità e statisticaPianificazione della dimensione campionaria e della potenza · Meta-analisi con valutazione delle distorsioniApplicato qui
  2. Inferenza causale e valutazione d'impattoProgetti pilota randomizzati e introduzioni graduali · Valutazione quasi sperimentale dei programmiApplicato qui
  3. Quantificazione dell'incertezza e validazione dei modelliBudget di incertezza di misura · Analisi di sensibilità dei modelli di simulazioneApplicato qui
  4. Ingegneria dei sistemiTracciabilità dai requisiti alla verifica · Revisioni di prontezza per fasiApplicato qui
12Where this page’s references

Where this page’s references lead.

Gli organismi e i documenti alla luce dei quali si legge questa pagina. Stato ed edizioni cambiano; ogni link porta all'organismo emittente.

13Domande

Domande e risposte.

What is the difference between a preregistration and a registered report?
A preregistration is a time-stamped plan deposited before analysis. A registered report is a journal format in which the plan is peer reviewed and accepted in principle before results exist, so publication does not depend on the outcome.
Does preregistration forbid exploratory analysis?
No. It separates the two. Planned analyses are reported as confirmatory; analyses suggested by the data are reported as exploratory, with that label, so readers can weigh them accordingly.
Which reporting guideline applies to my study?
It depends on the design: CONSORT for randomised trials, SPIRIT for trial protocols, PRISMA for systematic reviews, ARRIVE for animal research, STROBE for observational studies. The EQUATOR Network keeps the current list and extensions.
Can a protocol be changed after registration?
Yes, with a dated amendment and a stated reason, and with fresh ethics review where the change affects participants. What damages credibility is undisclosed change, not change itself.
Is pre-registration required for every Labs study?
It is designed to be the default for confirmatory work. Exploratory work is welcome but is labelled as exploratory, so that its findings are treated as hypotheses rather than conclusions.
Can a protocol change during a study?
Yes, for good reasons such as safety or an unforeseen data problem. Each change is dated, justified and reported alongside the result.
Who writes the protocol?
The research team writes it; a subject reviewer independent of the team is designed to check it before work begins.
RapportiContribuisci

Contribuisci con evidenze da questa pagina.

Reports is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRILaboratoriEvidenze di LabsMetodi e aspetti tecnici
Laboratori

Porta un metodo, un set di dati o una domanda.

Informazioni e richieste sono aperte oggi. Una richiesta riceve un riferimento e indica il passo successivo; candidature, pagamenti, assegnazioni di calcolo e registrazioni si aprono solo quando esistono il team, le condizioni e la capacità di revisione.