My employer has this figured out the right way: AI tools in the hands of competent employees can get a lot done. The engineers themselves agree and are long past their initial chilly reaction. They now have their workflows figured out and routinely report that they did something in minutes that would have taken them hours to do manually.
And even under this rosier picture, token budgets are an issue. These guys have agents running agents running agents that use a whole ecosystem of internal MCP servers and skill plugins and on and on. They say they never shut their laptops because they have 6 or 7 things running at all times. The LLM usage is ridiculous.
Once the LLMs cost what they actually cost, there will be a big time reckoning. First companies will crack down, then they will futz with on-premise models, then they will drive for SLMs and other slimmed down stuff. And they will pay the big guys 100x what they are now for 1/100th the usage.
But hey I don’t know why I’m posting in substance about the real world when all we are here to do is say AI is bullshit and CEOs are dumb. Carry on I guess.
My employer has this figured out the right way: AI tools in the hands of competent employees can get a lot done. The engineers themselves agree and are long past their initial chilly reaction. They now have their workflows figured out and routinely report that they did something in minutes that would have taken them hours to do manually.
And even under this rosier picture, token budgets are an issue. These guys have agents running agents running agents that use a whole ecosystem of internal MCP servers and skill plugins and on and on. They say they never shut their laptops because they have 6 or 7 things running at all times. The LLM usage is ridiculous.
Once the LLMs cost what they actually cost, there will be a big time reckoning. First companies will crack down, then they will futz with on-premise models, then they will drive for SLMs and other slimmed down stuff. And they will pay the big guys 100x what they are now for 1/100th the usage.
But hey I don’t know why I’m posting in substance about the real world when all we are here to do is say AI is bullshit and CEOs are dumb. Carry on I guess.