FireTofu
KI-Pioneer Sutton calls synthetic data a "big mistake" in the face of an infinitely complex world

Technology · en

KI-Pioneer Sutton calls synthetic data a "big mistake" in the face of an infinitely complex world

The Decoder · Aug 20, 2026, 12:14 PM UTC

Turing Award winner Richard Sutton calls synthetic data a "big mistake" for scaling large language models. The world is infinitely complex, and any simulation of it is "microscopic," with human expertise acting as a bottleneck that blocks real scaling.…