Epoch AI research reveals that final training runs account for only a small fraction of total AI model development costs. Analysis of OpenAI's $5B R&D spend shows roughly 10% went to final training, with the bulk going to scaling, synthetic data generation, and basic research. Similar patterns were found at Chinese AI companies MiniMax and Z.ai. This cost structure explains why AI companies are highly sensitive to model distillation and IP theft — a competitor who learns what works from a frontier model could replicate results at a fraction of the original cost. Google and Anthropic have both raised concerns about such extraction attempts.
Sort: