Epoch AI
Summary
Epoch AI provides comprehensive data and insights on AI model scaling, tracking computational performance, training compute, and model developments across various domains.
Review
Epoch AI represents a critical effort to systematically document and analyze the trajectory of artificial intelligence technologies, focusing on quantitative metrics related to computational scaling. Their research provides unique insights into the exponential growth of AI model training compute, demonstrating that training compute for frontier AI models has grown approximately 5x per year since 2020, with significant implications for understanding technological progress.
The project's key contributions include tracking trends in computational performance, training costs, and model complexity across different domains. By maintaining detailed databases of AI models, computing power, and hardware developments, Epoch AI offers a data-driven perspective on AI's rapid evolution. Their work is particularly valuable for researchers, policymakers, and industry professionals seeking to understand the technical and economic dynamics driving AI advancement.
Key Points
- Training compute for frontier AI models has grown approximately 5x per year since 2020
- Over 30 AI models have been trained at the scale of GPT-4 as of June 2025
- Total available computing power from NVIDIA chips has grown by approximately 2.3x per year since 2019