GCRI · Data and Compute

Source and data register

Where Data and Compute gets its data: each source with its licence, lineage, resolution, quality checks and known gaps.

01Sequence

The order things happen in.

  1. 01Draftsources cited, labels attached
  2. 02Evidence checkevery value traced
  3. 03Independent reviewconflicts declared
  4. 04Editionpublished with its limits
  5. 05Correctiona new version, never a silent edit
02What is recorded

Each source carries five facts.

01

Origin

Who produces the data and how.

02

Access terms

Licence, restrictions and permitted uses.

03

Quality

Coverage, resolution, update frequency and known errors.

04

Provenance

How the data reached the platform and what was changed.

05

Gaps

What is missing and how the gap is handled.

03Register

Every source the topic dossiers cite, with its terms.

SourceWhat it givesTermsUsed in
Competition authority cloud market investigationsMarket structure, switching barriers and remediesPublic records, licence per authorityCloud and edge systems
Data protection authority annual reportsComplaints, breaches and enforcementPublic records, licence per authorityData rights and trust
DataCite and Crossref metadataPersistent identifiers for data, software and publicationsOpen, CC0 metadataReproducible pipelines
ESFRI roadmap and access policiesEuropean research infrastructures and their access rulesPublic, EU termsResearch infrastructure access
ESFRI roadmap and landscape analysisEuropean research infrastructure planningPublic, EU termsHigh performance computing
EU data centre reporting under the Energy Efficiency DirectiveEnergy, water and efficiency data from EU data centresPublic summaries, EU terms (to check)Compute energy water
EuroHPC and national HPC allocation statisticsProposals, allocations and usersPublic records, terms per bodyResearch infrastructure access
EuroHPC Joint Undertaking reports and access callsEuropean supercomputers and allocationPublic, EU termsHigh performance computing
European Charter for Access to Research InfrastructuresPrinciples for access modes and policiesPublic, EU termsResearch infrastructure access
Eurostat cloud computing usage in enterprisesShare of enterprises using cloud servicesOpen, Eurostat reuse policyCloud and edge systems
Five Safes framework documentation from statistical agenciesFramework for safe access to sensitive dataPublic, terms per agencyData rights and trust
GÉANT and regional research and education network reportsConnectivity of research institutionsPublic, terms per networkResearch infrastructure access
Global Indigenous Data Alliance CARE principlesPrinciples for Indigenous data governancePublic, GIDA termsData rights and trust
Government cloud strategies and frameworksPublic sector cloud policies and procurementPublic records, licence per governmentCloud and edge systems
Government export control noticesRules on advanced chips and toolsPublic records, licence per governmentChips and semiconductors
Green500 listEnergy efficiency of supercomputersPublic, TOP500 termsCompute energy water
Grid operator load forecastsExpected data centre loadPublic records, terms per operatorCompute energy water
IEA data centre electricity estimatesGlobal and regional demandLicence per product (to check)Compute energy water
National HPC centre annual reportsUsage, allocation and science outputsPublic records, terms per centreHigh performance computing
National open data portals with DCAT cataloguesDataset listings and metadataOpen data, licence per portalPublic interest data infrastructure
OECD digital economy reportsCloud adoption by firms and governmentsPublic, OECD termsCloud and edge systems
OECD Global Science Forum reports on research infrastructuresInternational access and governance practicePublic, OECD termsResearch infrastructure access
OECD studies on semiconductor value chainsConcentration and policy analysisPublic, OECD termsChips and semiconductors
PARIS21 reports on statistical capacity and financingFunding and capacity of national statistical systemsPublic, PARIS21 termsPublic interest data infrastructure
Provider region and service documentationLocations and services offeredPublic, terms per providerCloud and edge systems
Public attitude surveys on data useTrust and acceptability of data sharingLicence per surveyData rights and trust
Public procurement notices for computing systemsPrices, lead times and suppliersPublic records, licence per portalChips and semiconductors
re3data registry of research data repositoriesResearch data repositories and their policiesOpen, licence to checkPublic interest data infrastructure
Reproducibility studies in published literatureMeasured reproduction rates in fieldsLicence per publicationReproducible pipelines
Software Heritage archiveArchived source code with intrinsic identifiersOpen, archive termsReproducible pipelines
TOP500 and Green500 listsPerformance and energy efficiency of the most powerful systemsPublic, TOP500 termsHigh performance computing
TOP500 list architecture and accelerator dataHardware used in leading systemsPublic, TOP500 termsChips and semiconductors
UN Comtrade semiconductor trade (HS 8542)Trade in integrated circuitsFree access with limits, UN termsChips and semiconductors
UN Statistics Division data and the World Population and Housing Census ProgrammeStatus of censuses and published statisticsPublic, UN terms of usePublic interest data infrastructure
UNCTAD Data Protection and Privacy Legislation WorldwideStatus of data protection laws by countryPublic, UNCTAD termsData rights and trust
UNSD civil registration and vital statistics resourcesRegistration completeness and standardsPublic, UN terms of usePublic interest data infrastructure
Uptime Institute global data centre surveyIndustry practices and efficiency trendsPublic summaries, terms to checkCompute energy water
W3C PROV standardA model for representing provenanceOpen standard, W3C termsReproducible pipelines
WMO reports on numerical weather prediction capacityComputing used by meteorological servicesPublic, WMO termsHigh performance computing
Zenodo and institutional repositoriesDeposited data and code with identifiersOpen, licence per recordReproducible pipelines
04Known gaps

Where the data and compute data record is thin.

  • Facility-level energy and water use.
  • Research compute allocation data.
  • Data on public institutions' cloud dependence.
  • Provenance metadata in many public datasets.
05Status

How the register grows.

Sources are added to the register as they are reviewed. A source is listed only once its terms permit the use described.

07Questions

Questions and answers.

Can I suggest a data source?
Yes. Write to Contact with the source, its owner and its terms.
ReportsContribute

Contribute evidence from this page.

Reports is the Consortium's quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

GCRIData and ComputeExponential TechnologyStrategic Systems
Data and Compute

Bring a method, a dataset or a question.

Information and enquiries are open today. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

The Global Centre for Risk and Innovation

Science · evidence · measurement

Not for profit

Our articles, maps and twins are free to read and free to republish. Readers and partners keep it that way.

Partner with us

Who funds us

GCRI is a not-for-profit institution. To ask who funds a piece of work, use the funding questions form.

Independence

Editors and the expert reviewers named on each article decide what we publish. Funders and partners do not review or approve articles before publication.

Licence

Articles: CC BY 4.0. Figures, maps, twins and data: CC BY 4.0. Other uses: ask through the permissions form.