Data sample request checklist
Dataset: [Dataset name and manifest version]
Seller: [Seller legal name]
Prospective buyer: [Buyer legal name]
Prepared by: [Name, title, date]
Before the sample is drawn
- Mutual NDA signed, covering the sample, with no-training and no re-identification terms and a deletion deadline
- Buyer's identity, signatory and intended use confirmed in writing
- Data manifest received by the buyer, version [Version] dated [Date]
- Names of the people who will access the sample: [Names]
- Storage location and access controls agreed: [Location]
- Evaluation period and deletion date agreed: [Date]
Sample specification
- Sample size agreed: [Number of records or share of the archive]
- Stratified random draw across years, systems and teams, not hand-picked
- Random seed or selection script recorded so the draw can be repeated
- Same formats, schema and structure as the full delivery
- Same exclusions and de-identification applied as the full delivery
- Linked records kept together, such as threads with replies, tickets with resolutions and code with its commit history
- File list with a SHA-256 hash for each sample file
Documents sent with the sample
- Sampling method statement, signed off by [Name]
- De-identification report: method, tools, review sample size, error rate and re-identification test results
- Exclusions list, by category
- Rights summary for each source: who created the records, IP assignments, and the contracts and platform terms reviewed
- Privacy notice in force when the data was collected, or confirmation that the sample holds no personal information
- Known issues: duplicates, gaps in coverage and corrupt files
Tests the buyer will run
- Record counts and date ranges against the manifest
- Format, schema and parsing checks
- Scan for personal information and secrets, such as names, email addresses, phone numbers, account numbers and API keys
- Duplicate and near-duplicate rate
- Language mix against the manifest
- Task fitness tests: [Describe each test]
After the review
- Written results shared with the seller by [Date]
- Acceptance criteria for the full delivery agreed, based on the sample results
- Sample deleted and deletion confirmed in writing by an officer of the buyer by [Date]
- Next step agreed: [term sheet], [paid pilot] or [no further action]