FAQ

Generative AI

Text-to-image and generative AI datasets

Caption-image pairs, aesthetic subsets and the licence questions that matter more here than anywhere else.

Generative image models are trained on caption-image pairs, and this is the category where the gap between a dataset's licence and the rights in its underlying images is widest.

The structural issue with this category is worth understanding before you download anything. Many large image-text datasets are distributed as lists of URLs plus captions rather than as images, because distributing the images themselves would require rights the compilers do not hold. The dataset's licence then covers the list, not the pictures — and the pictures carry whatever rights their creators hold.

That distinction has become commercially significant. If you are training a generative model you intend to ship, the question is not whether the dataset is openly licensed but whether the images it points at may be used this way. The sets below whose imagery is itself public domain, CC0 or free of known copyright restrictions — PD12M, Megalith-10m and the public-domain works in The Met's collection — are a much shorter list than the sets that are merely openly packaged, and the licence column cannot tell them apart: it shows the licence on the package, not the rights in the images.

A table with columns Dataset, Scale, Licenses, Caption and Governance for Megalith-10m, CC12M, PD12M, CommonCatalog, YFCC100M, LAION-400M, COYO-700M, LAION-5B and DataComp-12B, from 10M to 12.8B images; PD12M is the only row with PD/CC0-only images and community governance.
Nine image–text datasets by scale, image licences, caption type and governance. PD12M, Megalith-10m, CommonCatalog and YFCC100M draw on public-domain or Creative Commons images; CC12M, LAION, COYO and DataComp contain copyrighted images, opted out or not. The licence on the package and the rights in the images are separate questions. Image (rendered from the arXiv HTML): Table 1 of the paper · CC BY 4.0 · from “Public Domain 12M: A Highly Aesthetic Image-Text Dataset with Novel Governance Mechanisms”, arXiv:2410.23144
DatasetModalitySizeLicenceBest for
Midjourney MessagesText55M messagesApache 2.0Text generation or conversational assistants
PD12M: Public Domain Image CollectionImage12.4M imagesCC0 images + CDLA-Permissive-2.0Similarity search and image matching
Laion Aesthetics 12M UMAPImage12M imagesMITVisualising and clustering images by aesthetic
Megalith-10mImage9.6M imagesMITComputer vision models
Midjourney PromptsText9M linesApache 2.0Text-to-image generation models
OpenS2V-5MMultimodal5M triplesCC BY 4.0Video generation
MidJourney v5 Prompt DatasetText4.2M promptsApache 2.0Prompt generation models for MidJourney
LAION Art EN Improved CaptionsImage2.68M pairsCC BY 4.0Text-to-image generators
Text-to-Image 2MImage2M examplesMITText-to-image models
Text2Video - Pika 2.2 Human PreferencesMultimodal756,000 responsesApache 2.0Objectively evaluating text-to-video models
YE-POPImage550,000 imagesApache 2.0Diffusion models to generate artistic images
OpenAccess - The Met CollectionImage470,000 worksCC0Computer vision for classification
Licences in this shortlist — computed from the 12 datasets below. Every licence as labelled in this shortlist is permissive.
A dark-background histogram of aesthetic-score frequency for the image-text pairs in the COYO-700M dataset. The horizontal axis runs over the predicted aesthetic score and the vertical axis over the count of pairs; the distribution is a single broad hump concentrated in the middle of the score range with thin tails at both ends.
Predicted aesthetic score across COYO-700M. An “aesthetic subset” is a cut through this curve, so the threshold somebody chose is the difference between a 600-million-pair corpus and a 10-million-pair one. Image: kakaobrain/coyo-dataset · CC-BY-4.0 repository
№ 01

Midjourney Messages

Text
Size
55 million text messages, JSON format
Licence
Apache 2.0

Over 55 million raw text messages in JSON exchanged between Midjourney users, many of them tied to image generation requests. Far larger than the prompts-only sets, and includes surrounding conversation.

What to train on it

Training text generation or conversational assistants, analysing social dynamics in an artistic community, and studying typical queries in AI image generation.

Source: innovatiana.com

№ 02

PD12M: Public Domain Image Collection

Image
Size
12.4 million public-domain images, JPEG/PNG format, 16-bit half-precision vectors (1152 dimensions) optimised for L2 indexing
Licence
CDLA-Permissive-2.0 for the metadata; the images are CC0 / public domain

About 12.4 million filtered public-domain images in JPEG and PNG, each with EXIF metadata, long descriptions and 1152-dimension half-precision vectors optimised for L2 indexing. Built explicitly to avoid copyright exposure.

What to train on it

Similarity search and image matching in large databases, training and evaluating vision or multimodal models, and building applications on EXIF metadata and embeddings.

Source: innovatiana.com

№ 03

Laion Aesthetics 12M UMAP

Image
Size
Approximately 12 million images with UMAP embeddings, 2.74 GB in Parquet format
Licence
MIT

Two-dimensional UMAP projections of CLIP embeddings for roughly 12 million aesthetically filtered LAION images, 2.74 GB of Parquet, computed at three different n_neighbors settings. An exploration layer rather than an image set.

What to train on it

Visualising and clustering images by aesthetic quality, exploring large image sets by similarity, and building aesthetics-based recommendation systems.

Source: innovatiana.com

№ 04

Megalith-10m

Image
Size
Approximately 9.6 million links to images, 753 MB, Parquet format
Licence
MIT

About 9.6 million links to royalty-free Flickr photographs from public domain and US government sources, indexed in a 753 MB Parquet file. Links rather than pixels, so expect a substantial download step.

What to train on it

Training computer vision models on varied natural images, testing robustness on real diverse scenes, and establishing a base for image recognition research.

Source: innovatiana.com

№ 05

Midjourney Prompts

Text
Size
9 million text lines (JSON, prompts only)
Licence
Apache 2.0

Nine million lines of Midjourney prompts in JSON, text only with no accompanying images. Useful as a corpus of how people actually write generative prompts, including style vocabulary and parameter conventions.

What to train on it

Training or refining text-to-image generation models, analysing creative trends in prompt writing, and building tools that help create optimised prompts.

Source: innovatiana.com

№ 06

OpenS2V-5M

Multimodal
Size
5 million subject-text-video triples in 720p, JSON for metadata and annotations (masks, bboxes in RLE)
Licence
CC-BY 4.0

Five million subject, text and video triples at 720p, with JSON metadata covering resolution, frame rate and aesthetic scores plus masks and bounding boxes in RLE format. Built for subject-consistent video generation.

What to train on it

Training video generation conditioned on subjects or text descriptions, developing multi-view video synthesis, and experimenting with text-subject-video models.

Source: innovatiana.com

Four Weights and Biases line charts from one download run, each over about 260 steps: current/img_per_sec, mostly between 80 and 95 with occasional sharp dips; current/success, rising from about 0.85 to about 0.88; current/failed_to_download, falling from about 0.13 to between 0.10 and 0.11; and current/failed_to_resize, steady at about 0.02.
Live metrics from a run of img2dataset, the usual tool for turning a URL-and-caption list into images. Roughly one URL in ten failed to download and a couple of percent more failed to resize, so a URL-list dataset is never quite the dataset its card describes, and the images that do arrive still carry their creators' rights. Image: rom1504/img2dataset · MIT repository
№ 07

MidJourney v5 Prompt Dataset

Text
Size
4.2 million text prompts, tabular files (.csv, .json), cleaning possible via notebook provided
Licence
Apache 2.0

Over 4.2 million text prompts in CSV and JSON gathered from interactions with the MidJourney Bot, covering artistic styles, detailed scenes and imaginative compositions, with a cleaning notebook supplied.

What to train on it

Creating or refining prompt generation models for MidJourney, DALL-E or Stable Diffusion, analysing stylistic trends in generation queries, and training visual-description NLP.

Source: innovatiana.com

№ 08

LAION Art EN Improved Captions

Image
Size
2.68 million pairs of artistic images and improved captions, 442 MB, Parquet format
Licence
CC-BY 4.0

2.68 million artistic image-caption pairs in a 442 MB Parquet file, where the original alt-text has been replaced by improved English captions generated by a stronger model to tighten image-text alignment.

What to train on it

Fine-tuning text-to-image generators such as Stable Diffusion, building searchable prompt databases, and improving semantic alignment between images and descriptions.

Source: innovatiana.com

№ 09

Text-to-Image 2M

Image
Size
Approximately 2 million examples, 512x512 images (majority), JSON format or similar
Licence
MIT

Roughly two million text-image pairs, mostly at 512x512, in JSON or similar, plus a 10,000-image 1024x1024 subset for high-resolution adaptation. MIT licensed as a package; check where the underlying images came from before commercial use.

What to train on it

Training and refining text-to-image models, improving quality and diversity of generated images, and adapting models to high resolutions.

Source: innovatiana.com

№ 10

Text2Video - Pika 2.2 Human Preferences

Multimodal
Size
756,000 responses (JSON), low resolution GIF videos, and links to HD videos
Licence
Apache 2.0

About 756,000 human pairwise judgments in JSON comparing videos generated by Pika 2.2 from text prompts, with low-resolution GIF previews bundled and links out to the HD versions. A large preference corpus for video.

What to train on it

Objectively evaluating text-to-video models, training preference or reward models for RLHF, and analysing current limitations of video diffusion models.

Source: innovatiana.com

№ 11

YE-POP

Image
Size
About 550,000 image URLs in 11 chunks of 50,000, URL format
Licence
Apache 2.0

Eleven chunks of 50,000 image URLs each, around 550,000 artistic images in total, filtered from Laion-POP and checked both by people and for NSFW content. Distributed as URLs, so images must be fetched separately.

What to train on it

Training diffusion models to generate artistic images, improving automatic image captioning, and benchmarking multimodal models on artistic imagery.

Source: innovatiana.com

№ 12

OpenAccess - The Met Collection

Image
Size
470,000+ works, tabular metadata (CSV/Parquet); images released separately
Licence
CC0 1.0

Metadata for over 470,000 Metropolitan Museum of Art works in CSV and Parquet, released under CC0. Images are not part of the dataset: the Met releases images of public-domain works separately under CC0, while images of works still in copyright are not openly licensed, so filter on the public-domain flag before using any image.

What to train on it

Training computer vision for classification, image search or artistic OCR once paired with the Met's separately released public-domain images, building search and cultural applications on the catalogue metadata, and enriching art history knowledge bases.

Source: innovatiana.com

A Japanese woodblock print of a huge curling blue wave with white claw-like foam about to crash over three long boats of rowers, with snow-capped Mount Fuji small in the distance and a title cartouche in the upper left.
Hokusai's The Great Wave (about 1830–32), released by The Metropolitan Museum of Art as a public-domain Open Access image. Museum open-access programmes are one of the few large sources of images that are free of copyright and come with expert metadata: artist, date, medium and description, a ready-made caption for text-to-image training. Image: The Met Open Access, object 45434 · Public domain (CC0) · Katsushika Hokusai, Under the Wave off Kanagawa, c. 1830–32

How this list was put together

Shortlisted from the 28 datasets in Dataset Finder's verified set of 434 open datasets tagged “Generative AI & text-to-image”. Where the theme holds more than twelve, we prefer datasets whose licence is stated unambiguously and whose published scale is largest, so that the list is usable rather than merely long.

Sizes and licences come from each dataset's own documentation, vague wording included. Where we found a re-upload or catalogue card stating a licence that the original release contradicts, the entry gives the original terms and says so. The comparison table abbreviates licences to standard identifiers and marks vague ones as unclear.

Stop hunting. Start searching.

The datasets listed on this page are in Dataset Finder, alongside tens of thousands more — searchable in plain language.

Search Dataset Finder →