Synthetic Pretraining

Source: https://vintagedata.org/blog/posts/synthetic-pretraining Author: vintagedata.org Date: 2026-02-02

Summary

Technical post arguing that synthetic pretraining data (AI-generated text used to train AI) is both more viable and more necessary than commonly believed. Addresses quality concerns and proposes filtering strategies.

Key Claims

  • The data wall: high-quality human text is running out; internet-scale pretraining is approaching saturation.
  • Synthetic pretraining quality depends heavily on the generator model — weak generators produce mediocre synthetic data; strong generators produce data that can improve models beyond their own capability.
  • Key technique: bootstrapping — generate with a strong model, filter with quality metrics, train a new model, use it to generate again. Each round can improve quality.
  • Filtering approaches: perplexity, deduplication, classifier-based quality scoring.
  • Surprising finding: diverse synthetic data (many generators, many topics) outperforms monolithic synthetic data even when individual samples are lower quality.
  • Risk: synthetic data amplifies existing model biases — careful monitoring required.

Connection to Other Sources

Companion to Synthetic Data Fine-Tuning (that covered SFT; this covers pretraining). Both by vintagedata.org.

Entities

  • vintagedata.org — data-focused AI research blog

Concepts