FAQ

Licensing

Dataset licences explained, and which ones actually constrain you

CC0 through CC BY-NC-SA, MIT, Apache, ODC-By and the research-only terms — what each permits, and the two clauses that cause nearly all the trouble.

There are a dozen licences you will meet repeatedly and only two clauses that cause most of the difficulty. Learning to spot those two is most of what you need.

The two clauses that matter

Most licence confusion dissolves once you look for these specifically rather than trying to memorise whole licences.

NC — non-commercial. Rules the dataset out of anything commercial. Unambiguous in intent and awkward at the edges: a startup's research prototype, an academic spinout, a commercial entity's internal tool. If you are building a product, treat NC as a stop sign rather than a question.

SA — share-alike. Requires derivative works you share to be licensed on the same terms. The critical uncertainty is whether a trained model counts as a derivative of its training data, which is not settled. If it does, sharing a model trained on share-alike data could oblige you to license it on the same terms. Many organisations avoid SA data in commercial work purely to avoid depending on the answer.

Everything else — attribution, notice requirements, disclaimers — is administratively cheap. Keep a record of what you trained on and you have satisfied it.

Look for NC first and SA second. Under a CC licence, everything else is an attribution line in your model card.

The licences you will actually meet

Roughly in order of permissiveness.

LicenceCommercial useObligationWatch for
CC0 / public domainyesnonecontent rights, privacy, trademark
MITyeskeep the noticewritten for code, applied to data
Apache 2.0yeskeep the notice, state changespatent grant is a plus
ODC-Byyesattributionpurpose-built for databases
CC-BY 4.0yesattributionnone significant
CC-BY-SAyesattribution and share-alikea model you share may need the same licence
CC-BY-NCnoattributionresearch only in practice
CC-BY-NC-SAnoattribution, share-alikemost restrictive common pair
CC-BY-NC-NDnoplus no derivativestraining may be a derivative
Research-only / bespokeusually noread the agreementsigned DUA, terms often not public
Not statedunknownunknownabsence of a grant, not a grant
A clean licence on the dataset you downloaded says nothing about the images inside it. Provenance is the chain, and a restriction anywhere in it is a restriction on what you ship.

Code licences on data, and why it is slightly odd

MIT and Apache 2.0 were written for software, and you will see them on datasets constantly. In practice this works — the intent is clearly permissive and nobody has made trouble about it — but the fit is imperfect, because the things a software licence grants are not quite the rights that attach to a compiled dataset.

ODC-By and the Open Data Commons family were written for databases specifically, which is why you see them on the large text corpora. If you are publishing a dataset, they are the better technical fit; if you are consuming one under MIT or Apache, the permissive intent is clear enough that this is not a practical problem.

Apache 2.0 has one genuine advantage worth knowing: it includes an express patent grant. For data that is rarely relevant, and for an accompanying toolchain it occasionally is.

A horizontal stacked bar chart with one bar for each of speech, text and video. Each bar is divided into three licence bands with a legend reading non-commercial or academic, commercial, and unspecified, and the unspecified band is a substantial slice in every modality.
Commercial, non-commercial, and a large unspecified band that people routinely read as permission. Image: Data-Provenance-Initiative/Data-Provenance-Collection · Apache-2.0 repository · from “Bridging the Data Provenance Gap Across Text, Speech and Video”, arXiv:2412.17847

“Not stated” is the case people misread

A surprising number of datasets, including well-known ones, state no licence at all. The Pile's code is MIT with no licence given for the data. Several robotics and video corpora publish papers with no dataset licence. Our verified inventory includes entries whose licence field reads, verbatim, “Unknown license (use to be verified)” and “Free download, license not explicitly specified”.

Freely accessible is not freely licensed. An unstated licence is the absence of a grant, not an implicit permissive one, and “it was on the internet” has never been a licence.

The practical options are to contact the publisher and ask, which works more often than people expect; to accept the risk explicitly as a documented decision rather than an assumption; or to use something else. For anything commercial, the third is usually cheapest. We kept the vague wording verbatim in Dataset Finder precisely because normalising it to a tidy identifier would have hidden information you need.

A grouped bar chart of benchmark performance from 0 to 80 on ARC, MMLU, HSwag, OBQA, CSQA, PIQA, SIQA and the average, with bars for four openly licensed corpora (KL3M, OLC, CommonCorpus, Comma) and three unlicensed ones (The Pile, OSCAR, FineWeb). Stars mark Comma on ARC and MMLU; averages run from about 36 for KL3M to about 44 for FineWeb, with Comma near 41.
Identical 1.7B-parameter models trained on 28B tokens from each corpus: four openly licensed sets, share-alike included, and three unlicensed web-scale ones. Comma, filtered from the Common Pile, leads the open group and sits among the unlicensed corpora, behind FineWeb. At this scale, a clear licence costs little in quality. Image (cropped): r-three/common-pile · MIT repository · from “The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text”, arXiv:2506.05209

Licences stack

Your model's permissible uses are the intersection of several licences, and people routinely check only one.

The base model's licence. Every training dataset's licence. And if any of your data was generated by another model, that model's terms of service — several explicitly prohibit using outputs to train competing models, and a permissive licence on the resulting dataset does not clear that restriction.

All of them have to permit what you intend. Any one can be the blocker, and the one people miss is usually the third. Check the intersection before training, record what you checked, and the question becomes answerable later instead of alarming.

Two groups of horizontal bars, dataset to model and model to application, each with non-violations, violations solved by tool and violations remaining, for three matrices (Our Matrix, Jiang et al. 2024, EU Matrix). Dataset-to-model non-violations are 35.5%, 34.9% and 47.6%.
How often licence terms conflict as they pass from Hugging Face datasets to the models trained on them (top) and from models to the applications built on them (bottom), judged with three licence-compatibility matrices. Depending on the matrix, only about 35% to 48% of dataset-to-model links are clean. Each hop down the chain can add terms you have to honour. Image: Figure 4 of the paper · CC BY 4.0 · from Jewitt et al. 2025, “From Hugging Face to GitHub: Tracing License Drift in the Open-Source AI Ecosystem”, arXiv:2509.09873

Questions people ask

Is a model trained on share-alike data a derivative work?

Unsettled, and jurisdiction-dependent. Arguments exist both ways and there is no reliable answer to give you. That uncertainty is itself the practical point: many organisations avoid share-alike training data in commercial work specifically so they never need the answer. This is a question for a lawyer, not for a blog.

Can I use non-commercial data for research in a company?

Genuinely ambiguous, and it depends on the licence's wording and your activity. Research that feeds a commercial product looks commercial; pure publication looks less so. Get advice rather than a rule of thumb — this is one of the most commonly rationalised decisions in machine learning.

What if a dataset's licence changed after I trained on it?

Keep dated records of the licence as it stood when you used it, including a copy of the text. That is your evidence of good faith and it costs nothing to collect at the time. It is impossible to reconstruct afterwards, which is why provenance records are worth keeping as a habit rather than a project.

Does attribution mean I have to credit every dataset publicly?

Typically you must give credit in a manner appropriate to the medium, which for a model usually means a credits section in the model card or documentation. A list of datasets with their licences discharges most attribution obligations, and you want that list anyway.

Stop hunting. Start searching.

Tens of thousands of curated datasets, searchable in plain language — with the licence and size checked before you download anything.

Search Dataset Finder →