Skip to content
Sell My Data To AI

Selling data

How to build a data manifest buyers will trust

By Gareth HoyleLast updated 7 minute readHow we research

In short

A data manifest is the structured inventory a buyer reads before deciding whether your data is worth a sample or an offer. It lists sources, date ranges, record counts, formats, languages, exclusions, de-identification method, rights per source and file hashes. Buyers trust a manifest when it is tied to one exact version of the data and every count can be checked on delivery.

Key takeaways

  • A data manifest lets a buyer judge value and risk without seeing the full data, which breaks the trust deadlock between seller and buyer.
  • Count records from the export you will deliver, never from a tool's admin dashboard.
  • Tie the manifest to one version of the data with SHA-256 file hashes and a version number.
  • Borrow structure from Datasheets for Datasets, Croissant and the Data Provenance Standards rather than starting from scratch.
  • List exclusions and known defects. Disclosed gaps rarely become disputes, hidden ones often do.

A data manifest is the document a buyer reads before deciding whether your data is worth a sample, a pilot or an offer. A buyer cannot see your full data before signing, and you cannot show it. The manifest is how both sides get past that.

In a July 2026 Hugging Face forum thread on why selling datasets is so hard, the original poster put the problem in two sentences: "The seller can't prove quality without exposing too much." And: "The buyer can't trust quality without seeing enough." A precise manifest tied to an exact version of the data is the most practical answer sellers have.

What is a data manifest?

A data manifest is a structured inventory of a dataset: what it contains, where each part came from, how much there is, what was removed and what rights attach to it. It describes the data without exposing it, so a buyer can judge fit and price before seeing a sample.

It overlaps with other documentation formats, such as the dataset card, but it has a different job. The table shows how they compare.

Data manifest compared with other dataset documentation
DocumentMain purposeWho usually writes it
Data manifestInventory for a sale: contents, counts, sources, rights, exclusions, file hashesThe seller or broker
Dataset cardPublic description of a dataset on a hub such as Hugging FaceThe dataset publisher
Datasheet for datasetsAnswers to set questions on motivation, composition, collection, preprocessing, uses, distribution and maintenanceThe dataset creator
Croissant fileMachine-readable metadata built on schema.org, readable by ML toolsThe publisher or platform
California AB 2013 training data summaryHigh-level summary of training data that developers of public generative AI systems must postThe AI developer, not the seller
EU AI Act training summaryPublic summary of training content that general-purpose model providers must publishThe model provider, not the seller

What should a data manifest include?

A data manifest should include enough detail for a buyer to estimate value and spot legal risk without sending you a long list of questions. These are the fields buyers ask about most.

Data manifest fields
SectionFieldsWhy buyers ask
IdentityDataset name, version number, release date, seller legal entityTies every claim to one exact package
SourcesEach system exported, such as Slack, Microsoft 365, Jira, GitHub or ZendeskShows what kind of work the data captures
CoverageDate range per source, teams or departments covered, gapsYears of history and continuity affect price
VolumeRecord counts by type, file counts, total size, tokens or hoursThe basis for most pricing
FormatFile formats, schema, encoding, how threads and attachments linkShows how much processing the buyer will need
LanguageLanguages and the approximate share of eachMany buyers want English first, others want specific languages
ExclusionsWhat was removed and why, such as HR, payroll or privileged materialShows the high-risk material is gone
De-identificationMethod, tools, review sample size, error rate, re-identification testEvidence the data can be transferred lawfully
RightsWho created each source, IP assignments, contract restrictions, third-party contentBuyers will not sign without a clear chain of title
Known issuesDuplicates, corrupt files, missing months, quality limitsDisclosed defects do not become disputes later
SampleHow the sample was drawn and its sizeShows whether the sample reflects the whole
IntegrityFile list with SHA-256 hashes and a hash of the manifest itselfProves the delivered files match the description

Several of these fields drive price directly. AIData.Broker, as reported by ddiy.co in October 2026, lists years of records, linked records and settled rights among the factors that raise what buyers pay. Our guide to what your data is worth covers the rest.

How do you count records accurately?

You count records accurately by counting the exported files you will actually deliver, not the figures in a tool's admin dashboard. Dashboards include deleted items, bots, system messages and data outside your export.

  • Define the counting unit for each source: message, thread, ticket, file, commit or minute of audio
  • Deduplicate before counting, and state the method
  • Count after exclusions and de-identification, not before
  • Report counts per year so gaps are visible
  • Keep the script that produced the counts so the buyer can rerun it on delivery

Manifest accuracy is one of the eight checks in our seller vetting standard: record counts, date ranges, systems and languages in the manifest must match what is actually delivered. A buyer who receives fewer records than the manifest promised has grounds to reprice or reject the delivery.

Which standards can you borrow from?

You can borrow structure from three published frameworks and two training data disclosure rules rather than designing a manifest from scratch. None is a legal requirement for a private license, but buyers recognize them and some will map your manifest onto them.

  • Datasheets for Datasets, by Timnit Gebru and six co-authors and first posted in March 2018, sets out questions in seven sections: motivation, composition, collection process, preprocessing and labeling, uses, distribution and maintenance.
  • Croissant, announced by Google Research and MLCommons on March 6, 2024, is a machine-readable metadata format built on schema.org. Kaggle, Hugging Face and OpenML support it.
  • The Data & Trust Alliance's Data Provenance Standards were developed by a working group from 19 enterprises, including American Express, IBM, Mastercard, Pfizer and Walmart. They track a dataset's origin, how it was created and whether it can be legally used.
  • California's AB 2013, in force from January 1, 2026, requires developers of generative AI systems offered to the public to post a high-level summary of their training data, including the sources or owners of the datasets, whether they were purchased or licensed, the number of data points and the collection period, according to Perkins Coie.
  • The European Commission's template for the public summary of training content, published on July 24, 2025, asks general-purpose model providers to say whether they used commercially licensed content.

The last two points matter even though the obligations fall on the buyer. A US developer that has to describe your data on its website will want your manifest to back up the summary. Under Article 53 of the EU AI Act, providers of general-purpose AI models must publish the summary from August 2, 2025, and models already on the market before that date have until August 2, 2027, according to WilmerHale. A buyer that has to describe your data publicly will want your manifest to support it. See the EU AI Act and training data transparency.

How do you make a manifest verifiable?

You make a manifest verifiable by binding it to one exact version of the data with file hashes, publishing how the sample was drawn and letting a third party check the claims. A manifest that cannot be checked is just a sales document.

In the same Hugging Face thread, one reply recommended version-bound evidence packs that tie claims to an exact dataset revision, file manifest and hashes, and warned that "a seller-curated set of unusually good examples is a demonstration, not an audit sample". A September 2026 reply suggested a locked preview, where buyers run fixed queries without downloading the data, and third-party attestation.

  • Generate a SHA-256 hash for every delivered file and list it in the manifest
  • Hash the manifest itself and record that hash in the license
  • Draw the sample at random across the archive and state the method
  • Raise the version number if anything changes after a buyer has seen the manifest
  • Offer an acceptance test in which the buyer checks counts and hashes within a set number of days of delivery

A random representative sample does more for trust than any amount of description. Our guide to evaluating dataset samples shows what buyers do with one.

How do you build a data manifest step by step?

You build a data manifest step by step from a frozen export, so that every figure in it refers to the same files. The order below avoids the most common rework.

  1. 1

    Freeze the export

    Export from each system once, store the export read-only and call it version 1.0. Every count and hash must come from this copy.

  2. 2

    Map the sources

    List each system, the account or workspace exported, the date range and the teams covered. Note any months missing because of migrations or retention settings.

  3. 3

    Apply exclusions

    Remove HR, payroll, privileged, health and other excluded material, and record what was removed by category rather than in detail.

  4. 4

    De-identify and record the method

    Follow the steps in our de-identification guide and record the tools, reviewers and error rates.

  5. 5

    Count and describe

    Run counting scripts on the final files. Record formats, schema, languages and how records link, such as replies to threads or attachments to tickets.

  6. 6

    Document rights per source

    Record who created the material, which staff and contractor IP assignments cover it, and any client contracts or vendor terms that restrict its use.

  7. 7

    Hash, sample and sign off

    Hash every file, draw the random sample, and have a named officer or director sign the manifest off as accurate.

What mistakes make buyers lose interest in a manifest?

The mistakes that make buyers lose interest in a manifest are the ones that suggest the seller does not know what is in the data. The most common are:

  • Counts taken from dashboards rather than the export
  • Date ranges that hide gaps of several months
  • No list of exclusions, so the buyer assumes HR and client data are inside
  • Rights described as "owned by the company" with no detail on contractors or client contracts
  • A sample drawn from the best team or the best year
  • A manifest that changes after the sample without a new version number

Each of these turns a quick review into a long negotiation, or ends it.

If you want a buyer-ready manifest without building it alone, book a free consultation. We will look at what you hold and tell you what a buyer will expect to see. You can also start with a free data valuation.

Frequently asked questions

Is a data manifest the same as a dataset card?
No. A dataset card is a public description, usually published on a hub such as Hugging Face. A data manifest is a private inventory prepared for a sale, with record counts, exclusions, rights per source and file hashes that a buyer uses to price the data and check delivery. You can produce a dataset card from a manifest, but not the other way round.
Should the manifest show real examples of records?
Keep examples out of the manifest itself. Describe formats and schema in the manifest, and provide real records separately as a redacted sample under a mutual NDA. That way the manifest can circulate to several buyers early without exposing any content, and the sample goes only to buyers who have been vetted.
What file format should a data manifest use?
Most sellers produce a readable document for people and a machine-readable file for tools. JSON or YAML suits the machine-readable part, and the Data & Trust Alliance's metadata generator outputs JSON, XML, YAML or CSV. Croissant, built on schema.org, is supported by Kaggle, Hugging Face and OpenML if the buyer wants a standard format.
Who should sign off the manifest?
An officer, director or another person who can bind the company should sign it off as accurate, because buyers rely on it and the license will usually refer to it. The person who ran the export and counts should sign a technical statement too. In a closed company, the bankruptcy trustee or the board acting for it signs.
What happens if the delivered data does not match the manifest?
That depends on the license. A well-drafted license sets an acceptance test, such as checking counts and file hashes within a fixed number of days, and says what happens on a mismatch: correction, a price adjustment or rejection. Without one, a mismatch becomes a dispute. Hashing every file makes the check quick and objective for both sides.

Sources

  1. Is selling datasets way harder than building them, or is it just me?, Hugging Face forum, accessed November 2026
  2. Datasheets for Datasets, Gebru and others, arXiv 1803.09010, accessed November 2026
  3. Croissant: a metadata format for ML-ready datasets, Google Research, accessed November 2026
  4. Cross-industry standards for data provenance in AI, Help Net Security, accessed November 2026
  5. AB 2013: new California AI law mandates disclosure of GenAI training data, Perkins Coie, accessed November 2026
  6. Commission presents template for general-purpose AI model providers to summarise the data used to train their model, European Commission, accessed November 2026
  7. European Commission releases mandatory template for public disclosure of AI training data, WilmerHale, accessed November 2026
  8. How much is company data worth to AI?, ddiy.co, accessed November 2026

For data owners

Ready to see what buyers will offer?

Book a consultation and we will scope your data, explain our fee in writing and set out the steps to competing offers from vetted buyers.

Related guides