>_ Posts
Blog
Thoughts on development, engineering, and product.
1 post
- 01|
The 'just run AI locally' advice hides a bill almost nobody shows you
There's a wave of people recommending local AI like it's simple and cheap. In practice, the efficiency of these models on diverse tasks is very low - with a few narrow exceptions - and getting close to a real cloud-grade model pushes the hardware investment from thousands into the tens of thousands of dollars fast.