Selling data
How to build a data manifest buyers will trust
By Gareth HoyleLast updated 7 minute readHow we research
In short
A data manifest is the structured inventory a buyer reads before deciding whether your data is worth a sample or an offer. It lists sources, date ranges, record counts, formats, languages, exclusions, de-identification method, rights per source and file hashes. Buyers trust a manifest when it is tied to one exact version of the data and every count can be checked on delivery.
Key takeaways
- A data manifest lets a buyer judge value and risk without seeing the full data, which breaks the trust deadlock between seller and buyer.
- Count records from the export you will deliver, never from a tool's admin dashboard.
- Tie the manifest to one version of the data with SHA-256 file hashes and a version number.
- Borrow structure from Datasheets for Datasets, Croissant and the Data Provenance Standards rather than starting from scratch.
- List exclusions and known defects. Disclosed gaps rarely become disputes, hidden ones often do.
A data manifest is the document a buyer reads before deciding whether your data is worth a sample, a pilot or an offer. A buyer cannot see your full data before signing, and you cannot show it. The manifest is how both sides get past that.
In a July 2026 Hugging Face forum thread on why selling datasets is so hard, the original poster put the problem in two sentences: "The seller can't prove quality without exposing too much." And: "The buyer can't trust quality without seeing enough." A precise manifest tied to an exact version of the data is the most practical answer sellers have.
What is a data manifest?
A data manifest is a structured inventory of a dataset: what it contains, where each part came from, how much there is, what was removed and what rights attach to it. It describes the data without exposing it, so a buyer can judge fit and price before seeing a sample.
It overlaps with other documentation formats, such as the dataset card, but it has a different job. The table shows how they compare.
| Document | Main purpose | Who usually writes it |
|---|---|---|
| Data manifest | Inventory for a sale: contents, counts, sources, rights, exclusions, file hashes | The seller or broker |
| Dataset card | Public description of a dataset on a hub such as Hugging Face | The dataset publisher |
| Datasheet for datasets | Answers to set questions on motivation, composition, collection, preprocessing, uses, distribution and maintenance | The dataset creator |
| Croissant file | Machine-readable metadata built on schema.org, readable by ML tools | The publisher or platform |
| California AB 2013 training data summary | High-level summary of training data that developers of public generative AI systems must post | The AI developer, not the seller |
| EU AI Act training summary | Public summary of training content that general-purpose model providers must publish | The model provider, not the seller |
What should a data manifest include?
A data manifest should include enough detail for a buyer to estimate value and spot legal risk without sending you a long list of questions. These are the fields buyers ask about most.
| Section | Fields | Why buyers ask |
|---|---|---|
| Identity | Dataset name, version number, release date, seller legal entity | Ties every claim to one exact package |
| Sources | Each system exported, such as Slack, Microsoft 365, Jira, GitHub or Zendesk | Shows what kind of work the data captures |
| Coverage | Date range per source, teams or departments covered, gaps | Years of history and continuity affect price |
| Volume | Record counts by type, file counts, total size, tokens or hours | The basis for most pricing |
| Format | File formats, schema, encoding, how threads and attachments link | Shows how much processing the buyer will need |
| Language | Languages and the approximate share of each | Many buyers want English first, others want specific languages |
| Exclusions | What was removed and why, such as HR, payroll or privileged material | Shows the high-risk material is gone |
| De-identification | Method, tools, review sample size, error rate, re-identification test | Evidence the data can be transferred lawfully |
| Rights | Who created each source, IP assignments, contract restrictions, third-party content | Buyers will not sign without a clear chain of title |
| Known issues | Duplicates, corrupt files, missing months, quality limits | Disclosed defects do not become disputes later |
| Sample | How the sample was drawn and its size | Shows whether the sample reflects the whole |
| Integrity | File list with SHA-256 hashes and a hash of the manifest itself | Proves the delivered files match the description |
Several of these fields drive price directly. AIData.Broker, as reported by ddiy.co in October 2026, lists years of records, linked records and settled rights among the factors that raise what buyers pay. Our guide to what your data is worth covers the rest.
How do you count records accurately?
You count records accurately by counting the exported files you will actually deliver, not the figures in a tool's admin dashboard. Dashboards include deleted items, bots, system messages and data outside your export.
- Define the counting unit for each source: message, thread, ticket, file, commit or minute of audio
- Deduplicate before counting, and state the method
- Count after exclusions and de-identification, not before
- Report counts per year so gaps are visible
- Keep the script that produced the counts so the buyer can rerun it on delivery
Manifest accuracy is one of the eight checks in our seller vetting standard: record counts, date ranges, systems and languages in the manifest must match what is actually delivered. A buyer who receives fewer records than the manifest promised has grounds to reprice or reject the delivery.
Which standards can you borrow from?
You can borrow structure from three published frameworks and two training data disclosure rules rather than designing a manifest from scratch. None is a legal requirement for a private license, but buyers recognize them and some will map your manifest onto them.
- Datasheets for Datasets, by Timnit Gebru and six co-authors and first posted in March 2018, sets out questions in seven sections: motivation, composition, collection process, preprocessing and labeling, uses, distribution and maintenance.
- Croissant, announced by Google Research and MLCommons on March 6, 2024, is a machine-readable metadata format built on schema.org. Kaggle, Hugging Face and OpenML support it.
- The Data & Trust Alliance's Data Provenance Standards were developed by a working group from 19 enterprises, including American Express, IBM, Mastercard, Pfizer and Walmart. They track a dataset's origin, how it was created and whether it can be legally used.
- California's AB 2013, in force from January 1, 2026, requires developers of generative AI systems offered to the public to post a high-level summary of their training data, including the sources or owners of the datasets, whether they were purchased or licensed, the number of data points and the collection period, according to Perkins Coie.
- The European Commission's template for the public summary of training content, published on July 24, 2025, asks general-purpose model providers to say whether they used commercially licensed content.
The last two points matter even though the obligations fall on the buyer. A US developer that has to describe your data on its website will want your manifest to back up the summary. Under Article 53 of the EU AI Act, providers of general-purpose AI models must publish the summary from August 2, 2025, and models already on the market before that date have until August 2, 2027, according to WilmerHale. A buyer that has to describe your data publicly will want your manifest to support it. See the EU AI Act and training data transparency.
How do you make a manifest verifiable?
You make a manifest verifiable by binding it to one exact version of the data with file hashes, publishing how the sample was drawn and letting a third party check the claims. A manifest that cannot be checked is just a sales document.
In the same Hugging Face thread, one reply recommended version-bound evidence packs that tie claims to an exact dataset revision, file manifest and hashes, and warned that "a seller-curated set of unusually good examples is a demonstration, not an audit sample". A September 2026 reply suggested a locked preview, where buyers run fixed queries without downloading the data, and third-party attestation.
- Generate a SHA-256 hash for every delivered file and list it in the manifest
- Hash the manifest itself and record that hash in the license
- Draw the sample at random across the archive and state the method
- Raise the version number if anything changes after a buyer has seen the manifest
- Offer an acceptance test in which the buyer checks counts and hashes within a set number of days of delivery
A random representative sample does more for trust than any amount of description. Our guide to evaluating dataset samples shows what buyers do with one.
How do you build a data manifest step by step?
You build a data manifest step by step from a frozen export, so that every figure in it refers to the same files. The order below avoids the most common rework.
- 1
Freeze the export
Export from each system once, store the export read-only and call it version 1.0. Every count and hash must come from this copy.
- 2
Map the sources
List each system, the account or workspace exported, the date range and the teams covered. Note any months missing because of migrations or retention settings.
- 3
Apply exclusions
Remove HR, payroll, privileged, health and other excluded material, and record what was removed by category rather than in detail.
- 4
De-identify and record the method
Follow the steps in our de-identification guide and record the tools, reviewers and error rates.
- 5
Count and describe
Run counting scripts on the final files. Record formats, schema, languages and how records link, such as replies to threads or attachments to tickets.
- 6
Document rights per source
Record who created the material, which staff and contractor IP assignments cover it, and any client contracts or vendor terms that restrict its use.
- 7
Hash, sample and sign off
Hash every file, draw the random sample, and have a named officer or director sign the manifest off as accurate.
What mistakes make buyers lose interest in a manifest?
The mistakes that make buyers lose interest in a manifest are the ones that suggest the seller does not know what is in the data. The most common are:
- Counts taken from dashboards rather than the export
- Date ranges that hide gaps of several months
- No list of exclusions, so the buyer assumes HR and client data are inside
- Rights described as "owned by the company" with no detail on contractors or client contracts
- A sample drawn from the best team or the best year
- A manifest that changes after the sample without a new version number
Each of these turns a quick review into a long negotiation, or ends it.
If you want a buyer-ready manifest without building it alone, book a free consultation. We will look at what you hold and tell you what a buyer will expect to see. You can also start with a free data valuation.
Frequently asked questions
Is a data manifest the same as a dataset card?
Should the manifest show real examples of records?
What file format should a data manifest use?
Who should sign off the manifest?
What happens if the delivered data does not match the manifest?
Sources
- Is selling datasets way harder than building them, or is it just me?, Hugging Face forum, accessed November 2026
- Datasheets for Datasets, Gebru and others, arXiv 1803.09010, accessed November 2026
- Croissant: a metadata format for ML-ready datasets, Google Research, accessed November 2026
- Cross-industry standards for data provenance in AI, Help Net Security, accessed November 2026
- AB 2013: new California AI law mandates disclosure of GenAI training data, Perkins Coie, accessed November 2026
- Commission presents template for general-purpose AI model providers to summarise the data used to train their model, European Commission, accessed November 2026
- European Commission releases mandatory template for public disclosure of AI training data, WilmerHale, accessed November 2026
- How much is company data worth to AI?, ddiy.co, accessed November 2026