The best price for scaling your Azure OpenAI applications

Token Savings Calculator

Monthly spend

$0

Model
GPT-4o
GPT-4-Turbo
GPT-3.5-Turbo
Input**
$4.75
/1M tokens
$9.50
/1M tokens
$0.47
/1M tokens
Output**
$14.25
/1M tokens
$28.50
/1M tokens
$1.43
/1M tokens
Price Discount
5%
5%
5%
Potential
Savings*
25%
25%
25%
*Potential savings include additional average savings of 20% from CogCache serving cached responses.
Actual savings may vary by use case.
**Effective price per 1M token
Show more
Model
GPT-4o
From
$0
$5,000
$10,000
$25,000
$50,000
To
$5,000
$10,000
$25,000
$50,000
Unlimited
Discount
5%
7.5%
10%
12.5%
15%
GPT-4-Turbo
$0
$5,000
$10,000
$25,000
$50,000
$5,000
$10,000
$25,000
$50,000
Unlimited
5%
7.5%
10%
12.5%
15%
GPT-3.5-Turbo
$0
$5,000
$10,000
$25,000
$50,000
$5,000
$10,000
$25,000
$50,000
Unlimited
5%
7.5%
10%
15%
20%

FAQ

What is a token?
+

You can think of tokens as pieces of words used for natural language processing. For English text, 1 token is approximately 4 characters or 0.75 words.

What are the different models offered?
+

We're currently offering GPT-4o, GPT-4-Turbo, and GPT-3.5-Turbo.

How is pricing structured?
+

Pricing is tiered based on monthly spend, with discounts increasing as spend increases.

What are the base token prices for each model?
+

Base prices start with a built-in 5% discount to market prices, and increase as spend increases.

What discounts are available?
+

Discounts range from 5% to 20%, depending on the monthly spend and the specific model used.

What does "Potential savings" mean?
+

Potential savings combine the listed price discount with an additional average 20% savings from CogCache serving cached responses. Actual savings derived from cognitive caching can be lower or higher, depending on the use case.

Is there a maximum discount?
+

The maximum listed price discount is 20% for GPT-3.5-Turbo at the highest spend tier.

Are there any spending limits?
+

If your monthly spend is over $50,000, contact our sales team.

Is a credit card needed to use CogCache?
+

No, a credit card is not required to use CogCache. You can start using CogCache immediately with a $20 credit.

What happens when your credits run out?
+

Credits autofill based on the limits you set.

Query Volume Tracking

We monitor the total number of queries per day to our AI models.

Cache Yield

Our system identifies and caches repetitive queries, addressing them from the cache instead of the LLM.

LLM Query Management

This reduction in direct LLM calls minimizes the computational load, leading to lower operational costs.

Aggregate Savings

Over time, the cumulative savings from reduced LLM queries add up, driving down overall costs and improving efficiency.

Get started with $20 of free tokens

A few more details