FAQ

Licensing

How to get access to gated datasets

Click-through agreements, credentialed repositories, signed data use agreements and institutional review — what each involves and how long it takes.

A good deal of the most useful data is not a download link. The access routes are well established and more open to industry than people assume — they just take time you should start spending early.

The four levels of gate

Worth distinguishing, because the effort differs by orders of magnitude and so does what you are agreeing to.

GateWhat it involvesTypical timeWhat you agree to
Click-throughaccept terms, maybe log inminutesthe stated licence, often redistribution limits
Request formstate who you are and your purposedaysthe stated purpose, which constrains later reuse
Credentialedtraining course plus a signed DUAdays to weeksa real contract with named obligations
Institutionalethics approval and a negotiated agreementweeks to monthsa bespoke contract, often site-specific
Look for NC first and SA second. Under a CC licence, everything else is an attribution line in your model card.

Credentialed access is more accessible than it looks

Several of the richest clinical and behavioural repositories use this model: complete a recognised human-subjects research training course, then sign a data use agreement.

The training is a genuine course of a few hours covering research ethics and participant protection, and the certificate is reusable across repositories. Many people assume it is restricted to academics; frequently it is not, and industry researchers are accepted with an appropriate affiliation and stated purpose.

What you sign up to in the agreement typically includes: not attempting re-identification, not redistributing the data, limiting access to named individuals, using it only for the stated purpose, and sometimes citation and publication requirements. These are real obligations with real consequences for breach. Depending on the repository they bind you personally, your organisation, or both — PhysioNet's credentialed agreement, for example, is signed by the individual, who undertakes not to share access with anyone else — which is why the next section matters.

Process diagram: three source databases labelled bidmc, metavision and external feed a format-conversion step into one database, then a deidentification step produces MIMIC-IV, whose hospital, ICU and note modules are listed with their tables. A user feedback and corrections box loops back into both steps.
How MIMIC-IV, one of the clinical datasets released through PhysioNet, is built: records from the hospital (BIDMC), its ICU system (MetaVision) and external sources are converted into one format, then de-identified, with user feedback looping back into both steps. What sits behind the gate is already de-identified; getting it takes a training course and a signed data use agreement. Image: Fig. 1 of the article · CC BY 4.0 · from Johnson et al. 2023, Scientific Data, “MIMIC-IV, a freely accessible electronic health record dataset”, doi:10.1038/s41597-022-01899-x

Read what the agreement constrains downstream

The clauses that catch people are not about access but about what happens after.

Redistribution. Almost always prohibited. This includes putting the data in a public bucket, a shared drive accessible beyond named users, or a container image you publish — the last one is a genuinely common accident.

Derived outputs. Some agreements address whether models trained on the data may be released, and on what terms. This is the clause to read most carefully if you intend to ship something, and it is often the one nobody checks before training.

Named users. Access may be limited to individuals listed in the agreement, which has implications for how you store the data internally and what happens when someone leaves.

Purpose. If you stated a research purpose and later build a product, that may be outside the agreement. Describe your actual intended use when you apply — a broader stated purpose approved up front is far easier than a renegotiation later.

This is also the answer to a question people ask about Dataset Finder: a dataset being listed and being downloadable are different things, and the licence field tells you which.

When a request is likely to be declined

Honest guidance, because a declined request costs weeks.

Vague purposes get declined. “Machine learning research” is not a purpose; “training a segmentation model to measure lesion volume in multiple sclerosis” is. Specificity reads as competence and makes the reviewer's job possible.

Mismatched scope gets declined. Asking for a full clinical repository to prototype a demo is a poor trade for the data holder, and they know it.

No institutional backing is the common blocker for the heavier gates. A named organisation that can be held to an agreement is usually required — an individual with no affiliation has difficulty at the credentialed and institutional levels.

And unanswered questions about data handling get declined. Be ready to say where the data will live, who will access it, how it is secured, and when it will be deleted. Having those answers written down before you apply is most of the application.

Diagram of the consortium's access governance: an Executive Committee, an Ethics and Policy Committee and an International Data Access Committee above the Data Access Compliance Office. Data users send a controlled-access application form and sign in through an OpenID system to reach controlled data at the Data Coordination Centre, while open-access data reach them directly.
How the International Cancer Genome Consortium gated its data: open-access data reached users directly, while controlled data, such as genome sequence files, were released only after its Data Access Compliance Office approved an application with a scientific abstract, signed by the researcher and an institutional representative. Applications took about a week; unclear ones were sent back. Image (consortium logo cropped): Figure 1 of the article · CC BY · from Joly et al. 2012, PLOS Computational Biology, “Data Sharing in the Post-Genomic World: The Experience of the International Cancer Genome Consortium (ICGC) Data Access Compliance Office (DACO)”, doi:10.1371/journal.pcbi.1002549

Questions people ask

Can a company get credentialed access?

Frequently yes, with an appropriate affiliation and a clear stated purpose. The requirement is usually an accountable organisation and a signed agreement rather than academic status specifically. Check each repository's policy rather than assuming exclusion.

What if I lose access later?

Agreements can be time-limited or revocable, and many require deletion at the end of the stated purpose. Plan for it: keep your derived artefacts and documentation separate from the raw data, so that losing access does not cost you your ability to explain what you built.

Can I publish a model trained on gated data?

It depends on the agreement, and this is the clause to read before training rather than before release. Some address derived works explicitly; some are silent, in which case ask the data holder rather than assuming.

Is it worth the effort versus using open data?

If the gated data is substantially better for your task, yes — the paperwork is a few hours and the waiting parallelises with other work. If an open dataset would do, use it: fewer obligations, no renewal, no deletion deadline, and nothing to explain to a reviewer.

Stop hunting. Start searching.

Tens of thousands of curated datasets, searchable in plain language — with the licence and size checked before you download anything.

Search Dataset Finder →