Don’t all the providers do this, though? Anthropic/Claude has different pricing based on if you’re caching for five mins vs one hour (which are the only two options for cache TTL). https://platform.claude.com/docs/en/about-claude/pricing
Copilot was uniquely awful at this, because up to until literally days before the switch to usage based billing there was no way for people to track token usage, despite repeated calls from the community.
Microsoft only added a billing “projection” feature on the admin page that was meant to download a spreadsheet (which straight up didn’t work for most people) less than a week before the new billing structure.
It was too good to be true. Microsoft had to implement additional 5 hour and week usage limits to cope with demand.
The problem was, for the entire history of copilot, there was literally no way to even check these usage limits. All usage counted towards these limits, even those with a 0x multiplier that didn’t consume premium requests.
It was so bad that many people couldn’t even use the premium requests they paid for the month. The only around it was to switch to auto model routing, which would tend to route to lower quality models.
Don’t all the providers do this, though? Anthropic/Claude has different pricing based on if you’re caching for five mins vs one hour (which are the only two options for cache TTL). https://platform.claude.com/docs/en/about-claude/pricing
Well, the point here is the deception. So, if you can find a similar link from the past from Microsoft…
Copilot was uniquely awful at this, because up to until literally days before the switch to usage based billing there was no way for people to track token usage, despite repeated calls from the community.
Microsoft only added a billing “projection” feature on the admin page that was meant to download a spreadsheet (which straight up didn’t work for most people) less than a week before the new billing structure.
Ahh, that’s not great. I’ve only ever used it for free since I get the $10/month plan for free as an open-source maintainer (https://docs.github.com/en/copilot/how-tos/copilot-on-github/set-up-copilot/enable-copilot/set-up-for-teachers-and-os-maintainers) so I’ve never had to deal with the billing side.
The amount of value they used to provide with the $10 plan felt too good to be true.
It was too good to be true. Microsoft had to implement additional 5 hour and week usage limits to cope with demand.
The problem was, for the entire history of copilot, there was literally no way to even check these usage limits. All usage counted towards these limits, even those with a 0x multiplier that didn’t consume premium requests.
It was so bad that many people couldn’t even use the premium requests they paid for the month. The only around it was to switch to auto model routing, which would tend to route to lower quality models.