Sources and leaks from Amazon, Adobe, Atlassian, Citi, and more show what is really happening with AI right now: companies are trying to rein in AI use as costs spiral out of control.
No, I work in the industry and am vety actively entwined eith systems where we contract out to train and show companies how to use LLMs better.
And a lot of our clients now are of the “how do we use less tokens” variety, and you walk into the project and see the way they currently operate and go “oh god”
The average developers have absolutely zero clue wtf they are doing, they’ll burn a million tokens on something that outta take 10k.
We often can get token usage down easily 90%+ in the first month just by on boarding and offering some basic training and helping install some basic guard rails, skills, etc.
No, I work in the industry and am vety actively entwined eith systems where we contract out to train and show companies how to use LLMs better.
And a lot of our clients now are of the “how do we use less tokens” variety, and you walk into the project and see the way they currently operate and go “oh god”
The average developers have absolutely zero clue wtf they are doing, they’ll burn a million tokens on something that outta take 10k.
We often can get token usage down easily 90%+ in the first month just by on boarding and offering some basic training and helping install some basic guard rails, skills, etc.
Yeah I can see that you work in the industry…