>_ Posts

Blog

Thoughts on development, engineering, and product.

1 post
  • 01|

    The 'just run AI locally' advice hides a bill almost nobody shows you

    There's a wave of people recommending local AI like it's simple and cheap. In practice, the efficiency of these models on diverse tasks is very low - with a few narrow exceptions - and getting close to a real cloud-grade model pushes the hardware investment from thousands into the tens of thousands of dollars fast.