· 11 min read · AI
Small AI models can beat big ones
Build cost versus run cost for a 70B and an 8B model, how the sizing rules changed in 2020, 2022 and 2024, and a derived break-even of about 2 billion answers.
· 11 min read · AI
Build cost versus run cost for a 70B and an 8B model, how the sizing rules changed in 2020, 2022 and 2024, and a derived break-even of about 2 billion answers.