Issue Synthetic data may outweigh real data by 2030 while risking model collapse

Summary

The insight leaves the synthetic data path unresolved: it is used today mainly in narrow settings such as training self driving systems, some experts expect it to matter more than real data by 2030, and training on lower quality generated material could degrade models in a self reinforcing way as generated content comes to fill the internet.