Synthetic Data Generation
Dictionairee EntryLiteral Meaning
Using a model to produce training or test data in place of collecting real examples, generally to fill gaps where real data is scarce, restricted or expensive.
Buzzword Usage
Offered as an unlimited supply of training data, which skips the part where generated data carries the assumptions of the model that produced it, and those assumptions are then trained straight back in.
Why Itβs Fluff
- Unlimited Supply, Finite Source: Data generated by a model can only contain what that model already encodes.
- Circularity Unmentioned: Training on your own outputs narrows a model over time, and the pitch describes it as scaling.
- House-Cleaning Reality Check: Like photocopying the only photograph you own and describing it as a growing family album.
Reality Check
Love Island (Season 6): Casa Amor, a second villa of new arrivals introduced by producers for the specific purpose of generating material the existing villa was not producing on its own.
The Operational Reality
βSynthetic data generation gives us effectively unlimited training examples.β
βTraining data produced by a model, which can only contain what that model already encodes.β
Suggested Plain English
Using a model to produce training data instead of collecting real examples.
Example Buzzword Phrase
βSynthetic data generation gives us effectively unlimited training examples.β
Example Plain English
βWe generated 50,000 example clauses with a model, and they only contain patterns that model already knew.β