The table below contains enrollment limits for tokens per minute (TPM) and requests per minute (RPM) for each enrollment tier in both commercial and US Government (USG) environments. For enrollments with both Azure and OpenAI enabled, enrollment limits will be double what is shown below for Azure and OpenAI. Additionally, for enrollments geo-restricted to a single region, TPM and RPM may be lower than the table indicates in the Large and X-large tiers.
If multiple backends are enabled, the rate limits are summed across all backends.
| Model Name | Model Backend | Per-user Limits | Small Tier | Medium Tier | Large Tier | XLarge Tier |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | Anthropic | 1,000,000 TPM 100 RPM | 600,000 TPM 600 RPM | 1,500,000 TPM 750 RPM | 2,000,000 TPM 875 RPM | 2,500,000 TPM 1,000 RPM |
| Claude Haiku 4.5 | Amazon Bedrock | 1,000,000 TPM 100 RPM | 200,000 TPM 150 RPM | 1,100,000 TPM 300 RPM | 2,600,000 TPM 600 RPM | 5,100,000 TPM 1,100 RPM |
| Claude Haiku 4.5 | Azure | 1,000,000 TPM 100 RPM | 550,000 TPM 550 RPM | 5,000,000 TPM 5,000 RPM | 7,500,000 TPM 7,500 RPM | 10,000,000 TPM 10,000 RPM |
| Claude Haiku 4.5 | Google Vertex | 1,000,000 TPM 100 RPM | 100,000 TPM 50 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| Claude Haiku 4.5 | Google Vertex (USG) | 1,000,000 TPM 100 RPM | 100,000 TPM 50 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| Claude Opus 4.1 | Amazon Bedrock | 400,000 TPM 5 RPM | 100,000 TPM 25 RPM | 500,000 TPM 100 RPM | 1,000,000 TPM 150 RPM | 2,000,000 TPM 200 RPM |
| Claude Opus 4.1 | Google Vertex | 400,000 TPM 5 RPM | 100,000 TPM 25 RPM | 400,000 TPM 100 RPM | 600,000 TPM 150 RPM | 800,000 TPM 200 RPM |
| Claude Opus 4.5 | Anthropic | 1,000,000 TPM 100 RPM | 600,000 TPM 525 RPM | 1,500,000 TPM 700 RPM | 2,000,000 TPM 800 RPM | 2,500,000 TPM 900 RPM |
| Claude Opus 4.5 | Amazon Bedrock | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 100 RPM | 2,000,000 TPM 200 RPM | 4,000,000 TPM 400 RPM |
| Claude Opus 4.5 | Azure | 1,000,000 TPM 100 RPM | 550,000 TPM 550 RPM | 1,500,000 TPM 600 RPM | 2,500,000 TPM 700 RPM | 3,500,000 TPM 800 RPM |
| Claude Opus 4.5 | Google Vertex | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 100 RPM | 1,500,000 TPM 150 RPM | 2,000,000 TPM 200 RPM |
| Claude Opus 4.5 | Google Vertex (USG) | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 100 RPM | 1,500,000 TPM 150 RPM | 2,000,000 TPM 200 RPM |
| Claude Opus 4.6 | Anthropic | 1,500,000 TPM 150 RPM | 100,000 TPM 10 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Claude Opus 4.6 | Amazon Bedrock | 1,500,000 TPM 150 RPM | 200,000 TPM 20 RPM | 3,000,000 TPM 300 RPM | 4,000,000 TPM 400 RPM | 6,000,000 TPM 600 RPM |
| Claude Opus 4.6 | Azure | 1,500,000 TPM 150 RPM | 550,000 TPM 550 RPM | 1,500,000 TPM 600 RPM | 2,500,000 TPM 700 RPM | 3,500,000 TPM 800 RPM |
| Claude Opus 4.6 | Google Vertex | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 4.6 | Google Vertex (USG) | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 4.7 | Anthropic | 1,500,000 TPM 150 RPM | 100,000 TPM 10 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Claude Opus 4.7 | Amazon Bedrock | 1,500,000 TPM 150 RPM | 200,000 TPM 20 RPM | 3,000,000 TPM 300 RPM | 4,000,000 TPM 400 RPM | 6,000,000 TPM 600 RPM |
| Claude Opus 4.7 | Azure | 1,500,000 TPM 150 RPM | 50,000 TPM 50 RPM | 1,000,000 TPM 100 RPM | 2,000,000 TPM 200 RPM | 3,000,000 TPM 300 RPM |
| Claude Opus 4.7 | Google Vertex | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 4.7 | Google Vertex (USG) | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 4.8 | Anthropic | 1,500,000 TPM 150 RPM | 100,000 TPM 10 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Claude Opus 4.8 | Amazon Bedrock | 1,500,000 TPM 150 RPM | 200,000 TPM 20 RPM | 3,000,000 TPM 300 RPM | 4,000,000 TPM 400 RPM | 6,000,000 TPM 600 RPM |
| Claude Opus 4.8 | Amazon Bedrock (USG) | 1,500,000 TPM 150 RPM | 100,000 TPM 25 RPM | 2,500,000 TPM 1,250 RPM | 5,000,000 TPM 2,500 RPM | 7,500,000 TPM 3,750 RPM |
| Claude Opus 4.8 | Azure | 1,500,000 TPM 150 RPM | 50,000 TPM 50 RPM | 1,000,000 TPM 100 RPM | 2,000,000 TPM 200 RPM | 3,000,000 TPM 300 RPM |
| Claude Opus 4.8 | Google Vertex | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 4.8 | Google Vertex (USG) | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 5 | Anthropic | 1,500,000 TPM 150 RPM | 100,000 TPM 10 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Claude Opus 5 | Amazon Bedrock | 1,500,000 TPM 150 RPM | 200,000 TPM 20 RPM | 3,000,000 TPM 300 RPM | 4,000,000 TPM 400 RPM | 6,000,000 TPM 600 RPM |
| Claude Opus 5 | Azure | 1,500,000 TPM 150 RPM | 50,000 TPM 50 RPM | 1,000,000 TPM 100 RPM | 2,000,000 TPM 200 RPM | 3,000,000 TPM 300 RPM |
| Claude Opus 5 | Google Vertex | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Opus 5 | Google Vertex (USG) | 1,500,000 TPM 150 RPM | 200,000 TPM 25 RPM | 5,000,000 TPM 2,000 RPM | 8,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,000 RPM |
| Claude Sonnet 4 | Google Vertex (USG) | 400,000 TPM 25 RPM | 100,000 TPM 25 RPM | 250,000 TPM 50 RPM | 375,000 TPM 75 RPM | 500,000 TPM 100 RPM |
| Claude Sonnet 4.5 | Anthropic | 1,000,000 TPM 100 RPM | 600,000 TPM 525 RPM | 1,500,000 TPM 700 RPM | 2,000,000 TPM 800 RPM | 2,500,000 TPM 900 RPM |
| Claude Sonnet 4.5 | Amazon Bedrock | 1,000,000 TPM 100 RPM | 200,000 TPM 125 RPM | 1,100,000 TPM 300 RPM | 4,100,000 TPM 600 RPM | 8,100,000 TPM 1,100 RPM |
| Claude Sonnet 4.5 | Amazon Bedrock (USG) | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 5,000,000 TPM 2,500 RPM | 7,500,000 TPM 3,750 RPM | 10,000,000 TPM 5,000 RPM |
| Claude Sonnet 4.5 | Azure | 1,000,000 TPM 100 RPM | 550,000 TPM 550 RPM | 1,500,000 TPM 600 RPM | 2,500,000 TPM 700 RPM | 3,500,000 TPM 800 RPM |
| Claude Sonnet 4.5 | Google Vertex | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 500 RPM | 1,500,000 TPM 750 RPM | 2,000,000 TPM 1,000 RPM |
| Claude Sonnet 4.5 | Google Vertex (USG) | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 500,000 TPM 500 RPM | 750,000 TPM 750 RPM | 1,000,000 TPM 1,000 RPM |
| Claude Sonnet 4.6 | Anthropic | 1,000,000 TPM 100 RPM | 600,000 TPM 510 RPM | 1,500,000 TPM 700 RPM | 2,000,000 TPM 800 RPM | 2,500,000 TPM 900 RPM |
| Claude Sonnet 4.6 | Amazon Bedrock | 1,000,000 TPM 100 RPM | 300,000 TPM 120 RPM | 3,000,000 TPM 750 RPM | 6,000,000 TPM 1,500 RPM | 9,000,000 TPM 2,250 RPM |
| Claude Sonnet 4.6 | Azure | 1,000,000 TPM 100 RPM | 550,000 TPM 550 RPM | 1,500,000 TPM 600 RPM | 2,500,000 TPM 700 RPM | 3,500,000 TPM 800 RPM |
| Claude Sonnet 4.6 | Google Vertex | 1,000,000 TPM 100 RPM | 200,000 TPM 20 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| Claude Sonnet 4.6 | Google Vertex (USG) | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| Claude Sonnet 5 | Anthropic | 1,000,000 TPM 100 RPM | 600,000 TPM 510 RPM | 1,500,000 TPM 700 RPM | 2,000,000 TPM 800 RPM | 2,500,000 TPM 900 RPM |
| Claude Sonnet 5 | Amazon Bedrock | 1,000,000 TPM 100 RPM | 300,000 TPM 120 RPM | 3,000,000 TPM 750 RPM | 6,000,000 TPM 1,500 RPM | 9,000,000 TPM 2,250 RPM |
| Claude Sonnet 5 | Amazon Bedrock (USG) | 1,000,000 TPM 100 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 500 RPM | 2,000,000 TPM 1,000 RPM | 3,000,000 TPM 1,500 RPM |
| Claude Sonnet 5 | Azure | 1,000,000 TPM 100 RPM | 1,050,000 TPM 1,050 RPM | 2,500,000 TPM 1,250 RPM | 5,000,000 TPM 2,500 RPM | 7,500,000 TPM 3,750 RPM |
| Claude Sonnet 5 | Google Vertex | 1,000,000 TPM 100 RPM | 200,000 TPM 25 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| Claude Sonnet 5 | Google Vertex (USG) | 1,000,000 TPM 100 RPM | 200,000 TPM 25 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| Gemini 3 Flash (Preview) | Google Vertex | 2,000,000 TPM 400 RPM | 600,000 TPM 600 RPM | 6,500,000 TPM 1,400 RPM | 9,500,000 TPM 2,300 RPM | 12,500,000 TPM 3,500 RPM |
| Gemini 3 Flash (Preview) | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 300 RPM | 1,500,000 TPM 600 RPM | 2,000,000 TPM 1,000 RPM |
| Gemini 3.1 Flash-Lite | Google Vertex | 2,000,000 TPM 400 RPM | 600,000 TPM 600 RPM | 6,500,000 TPM 1,400 RPM | 9,500,000 TPM 2,300 RPM | 12,500,000 TPM 3,500 RPM |
| Gemini 3.1 Flash-Lite | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 100,000 TPM 100 RPM | 6,000,000 TPM 900 RPM | 9,000,000 TPM 1,800 RPM | 12,000,000 TPM 3,000 RPM |
| Gemini 3.1 Pro (Preview) | Google Vertex | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 1,500 RPM | 10,000,000 TPM 2,250 RPM | 15,000,000 TPM 3,750 RPM |
| Gemini 3.1 Pro (Preview) | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 1,500 RPM | 10,000,000 TPM 2,250 RPM | 15,000,000 TPM 3,750 RPM |
| Gemini 3.5 Flash | Google Vertex | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 6,500,000 TPM 1,400 RPM | 9,500,000 TPM 2,300 RPM | 12,500,000 TPM 3,500 RPM |
| Gemini 3.5 Flash | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 500,000 TPM 100 RPM | 6,000,000 TPM 900 RPM | 9,000,000 TPM 1,800 RPM | 12,000,000 TPM 3,000 RPM |
| Gemini 3.5 Flash-Lite | Google Vertex | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| Gemini 3.5 Flash-Lite | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| Gemini 3.6 Flash | Google Vertex | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| Gemini 3.6 Flash | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| Gemini 3.7 Flash | Google Vertex | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| Gemini 3.7 Flash | Google Vertex (USG) | 2,000,000 TPM 400 RPM | 1,000,000 TPM 600 RPM | 7,000,000 TPM 3,000 RPM | 10,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| Llama 3.1 8b Instruct | Amazon Bedrock | 50,000 TPM 100 RPM | 100,000 TPM 100 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Llama 3.1 8b Instruct | Palantir-hosted | 50,000 TPM 100 RPM | 100,000 TPM 100 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Llama 3.3 70b Instruct | Amazon Bedrock | 50,000 TPM 100 RPM | 100,000 TPM 25 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Llama 3.3 70b Instruct | Palantir-hosted | 50,000 TPM 100 RPM | 100,000 TPM 25 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Llama 4 Maverick 17b 128E Instruct | Amazon Bedrock | 100,000 TPM 100 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 500 RPM | 2,000,000 TPM 1,000 RPM | 4,000,000 TPM 2,000 RPM |
| Llama 4 Scout 17b 16E Instruct | Amazon Bedrock | 100,000 TPM 100 RPM | 100,000 TPM 100 RPM | 1,000,000 TPM 500 RPM | 2,000,000 TPM 1,000 RPM | 4,000,000 TPM 2,000 RPM |
| Llama 4 Scout 17b 16E Instruct | Palantir-hosted | 100,000 TPM 100 RPM | 100,000 TPM 100 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Llama 3.2 NV EmbedQA 1B v2 | Palantir-hosted | 50,000 TPM 100 RPM | 60,000 TPM 150 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Llama 3.3 Nemotron Super 49b v1.5 | Palantir-hosted | 50,000 TPM 100 RPM | 100,000 TPM 25 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| NVIDIA Nemotron 3 Nano 30B | Amazon Bedrock | 50,000 TPM 100 RPM | 100,000 TPM 25 RPM | 500,000 TPM 100 RPM | 1,000,000 TPM 150 RPM | 2,000,000 TPM 200 RPM |
| NVIDIA Nemotron 3 Super 120B | Amazon Bedrock | 500,000 TPM 100 RPM | 40,000 TPM 10 RPM | 1,000,000 TPM 200 RPM | 2,000,000 TPM 300 RPM | 4,000,000 TPM 400 RPM |
| GPT-4.1 | Azure | 400,000 TPM 1,000 RPM | 600,000 TPM 525 RPM | 2,000,000 TPM 1,500 RPM | 3,500,000 TPM 2,500 RPM | 5,500,000 TPM 4,500 RPM |
| GPT-4.1 | Azure (USG) | 400,000 TPM 1,000 RPM | 100,000 TPM 25 RPM | 2,000,000 TPM 2,000 RPM | 4,000,000 TPM 4,000 RPM | 6,000,000 TPM 6,000 RPM |
| GPT-4.1 | OpenAI | 400,000 TPM 1,000 RPM | 600,000 TPM 525 RPM | 2,000,000 TPM 1,500 RPM | 3,500,000 TPM 2,500 RPM | 5,500,000 TPM 4,500 RPM |
| GPT-4.1 mini | Azure | 1,000,000 TPM 1,000 RPM | 5,100,000 TPM 5,100 RPM | 15,000,000 TPM 7,500 RPM | 35,000,000 TPM 12,500 RPM | 55,000,000 TPM 17,500 RPM |
| GPT-4.1 mini | Azure (USG) | 1,000,000 TPM 1,000 RPM | 100,000 TPM 100 RPM | 2,000,000 TPM 2,000 RPM | 3,000,000 TPM 3,000 RPM | 4,000,000 TPM 4,000 RPM |
| GPT-4.1 mini | OpenAI | 1,000,000 TPM 1,000 RPM | 1,100,000 TPM 1,100 RPM | 3,000,000 TPM 2,000 RPM | 4,000,000 TPM 3,000 RPM | 6,000,000 TPM 5,000 RPM |
| GPT-4.1 nano | Azure | 1,000,000 TPM 1,000 RPM | 5,100,000 TPM 5,100 RPM | 15,000,000 TPM 7,500 RPM | 35,000,000 TPM 12,500 RPM | 55,000,000 TPM 17,500 RPM |
| GPT-4o | Azure | 400,000 TPM 800 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 1,000 RPM | 1,500,000 TPM 2,000 RPM | 3,000,000 TPM 4,000 RPM |
| GPT-4o | Azure (USG) | 400,000 TPM 800 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 1,000 RPM | 1,500,000 TPM 2,000 RPM | 3,000,000 TPM 4,000 RPM |
| GPT-4o | OpenAI | 400,000 TPM 800 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 1,000 RPM | 1,500,000 TPM 2,000 RPM | 3,000,000 TPM 4,000 RPM |
| GPT-5 | Azure | 1,000,000 TPM 1,000 RPM | 600,000 TPM 525 RPM | 3,500,000 TPM 1,500 RPM | 5,500,000 TPM 3,000 RPM | 10,500,000 TPM 5,500 RPM |
| GPT-5 Codex | Azure | 1,000,000 TPM 1,000 RPM | 100,000 TPM 25 RPM | 2,000,000 TPM 1,000 RPM | 3,000,000 TPM 2,000 RPM | 5,000,000 TPM 4,000 RPM |
| GPT-5 mini | Azure | 1,000,000 TPM 1,000 RPM | 600,000 TPM 600 RPM | 10,500,000 TPM 5,500 RPM | 20,500,000 TPM 10,500 RPM | 30,500,000 TPM 15,500 RPM |
| GPT-5 nano | Azure | 1,000,000 TPM 1,000 RPM | 1,100,000 TPM 1,100 RPM | 11,000,000 TPM 6,000 RPM | 31,000,000 TPM 16,000 RPM | 51,000,000 TPM 26,000 RPM |
| GPT-5.1 | Azure | 1,000,000 TPM 2,000 RPM | 100,000 TPM 25 RPM | 2,000,000 TPM 500 RPM | 4,000,000 TPM 1,000 RPM | 6,000,000 TPM 2,000 RPM |
| GPT-5.1 | Azure (USG) | 1,000,000 TPM 2,000 RPM | 100,000 TPM 25 RPM | 3,000,000 TPM 3,000 RPM | 5,250,000 TPM 5,250 RPM | 7,500,000 TPM 7,500 RPM |
| GPT-5.1 | OpenAI | 1,000,000 TPM 2,000 RPM | 100,000 TPM 25 RPM | 1,500,000 TPM 1,000 RPM | 3,000,000 TPM 2,000 RPM | 5,000,000 TPM 4,000 RPM |
| GPT-5.1 Codex | Azure | 1,000,000 TPM 1,000 RPM | 100,000 TPM 25 RPM | 2,000,000 TPM 1,000 RPM | 3,000,000 TPM 2,000 RPM | 4,000,000 TPM 4,000 RPM |
| GPT-5.1 Codex mini | Azure | 1,000,000 TPM 500 RPM | 100,000 TPM 100 RPM | 2,000,000 TPM 1,000 RPM | 3,000,000 TPM 2,000 RPM | 5,000,000 TPM 4,000 RPM |
| GPT-5.2 | Azure | 500,000 TPM 1,000 RPM | 250,000 TPM 50 RPM | 2,000,000 TPM 500 RPM | 4,000,000 TPM 1,000 RPM | 6,000,000 TPM 2,000 RPM |
| GPT-5.2 | OpenAI | 500,000 TPM 1,000 RPM | 250,000 TPM 50 RPM | 3,000,000 TPM 1,500 RPM | 6,000,000 TPM 3,000 RPM | 10,000,000 TPM 5,000 RPM |
| GPT-5.2 Pro | OpenAI | 400,000 TPM 1,000 RPM | 100,000 TPM 25 RPM | 1,500,000 TPM 1,000 RPM | 3,000,000 TPM 2,000 RPM | 5,000,000 TPM 4,000 RPM |
| GPT-5.3 Codex | Azure | 1,000,000 TPM 1,000 RPM | 100,000 TPM 100 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 4,000 RPM | 8,000,000 TPM 8,000 RPM |
| GPT-5.3 Codex | OpenAI | 1,000,000 TPM 1,000 RPM | 100,000 TPM 25 RPM | 3,000,000 TPM 1,000 RPM | 4,000,000 TPM 2,000 RPM | 5,000,000 TPM 4,000 RPM |
| GPT-5.4 | Azure | 1,000,000 TPM 1,000 RPM | 250,000 TPM 50 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| GPT-5.4 | OpenAI | 1,000,000 TPM 1,000 RPM | 250,000 TPM 50 RPM | 3,000,000 TPM 1,500 RPM | 6,000,000 TPM 3,000 RPM | 10,000,000 TPM 5,000 RPM |
| GPT-5.4 Pro | OpenAI | 400,000 TPM 1,000 RPM | 100,000 TPM 25 RPM | 1,500,000 TPM 1,000 RPM | 3,000,000 TPM 2,000 RPM | 5,000,000 TPM 4,000 RPM |
| GPT-5.4 mini | Azure | 1,000,000 TPM 1,000 RPM | 100,000 TPM 100 RPM | 4,500,000 TPM 2,250 RPM | 9,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| GPT-5.4 mini | OpenAI | 1,000,000 TPM 1,000 RPM | 100,000 TPM 100 RPM | 3,000,000 TPM 1,500 RPM | 6,000,000 TPM 3,000 RPM | 10,000,000 TPM 5,000 RPM |
| GPT-5.4 nano | Azure | 1,000,000 TPM 1,000 RPM | 100,000 TPM 100 RPM | 4,500,000 TPM 2,250 RPM | 9,000,000 TPM 4,500 RPM | 15,000,000 TPM 7,500 RPM |
| GPT-5.4 nano | OpenAI | 1,000,000 TPM 1,000 RPM | 100,000 TPM 100 RPM | 3,000,000 TPM 1,500 RPM | 6,000,000 TPM 3,000 RPM | 10,000,000 TPM 5,000 RPM |
| GPT-5.5 | Azure | 1,000,000 TPM 1,000 RPM | 250,000 TPM 50 RPM | 4,000,000 TPM 2,000 RPM | 6,000,000 TPM 3,000 RPM | 8,000,000 TPM 4,000 RPM |
| GPT-5.5 | OpenAI | 1,000,000 TPM 1,000 RPM | 250,000 TPM 50 RPM | 3,000,000 TPM 1,500 RPM | 6,000,000 TPM 3,000 RPM | 10,000,000 TPM 5,000 RPM |
| GPT-5.6 Luna | Azure | 3,000,000 TPM 1,500 RPM | 250,000 TPM 125 RPM | 5,000,000 TPM 2,500 RPM | 6,000,000 TPM 3,000 RPM | 7,000,000 TPM 3,500 RPM |
| GPT-5.6 Luna | OpenAI | 3,000,000 TPM 1,500 RPM | 250,000 TPM 50 RPM | 5,000,000 TPM 2,500 RPM | 10,000,000 TPM 5,000 RPM | 15,000,000 TPM 7,500 RPM |
| GPT-5.6 Sol | Azure | 5,000,000 TPM 2,500 RPM | 250,000 TPM 125 RPM | 9,000,000 TPM 4,500 RPM | 10,000,000 TPM 5,000 RPM | 11,000,000 TPM 5,500 RPM |
| GPT-5.6 Sol | OpenAI | 5,000,000 TPM 2,500 RPM | 250,000 TPM 50 RPM | 10,000,000 TPM 5,000 RPM | 20,000,000 TPM 10,000 RPM | 30,000,000 TPM 15,000 RPM |
| GPT-5.6 Terra | Azure | 3,000,000 TPM 1,500 RPM | 250,000 TPM 125 RPM | 5,000,000 TPM 2,500 RPM | 6,000,000 TPM 3,000 RPM | 7,000,000 TPM 3,500 RPM |
| GPT-5.6 Terra | OpenAI | 3,000,000 TPM 1,500 RPM | 250,000 TPM 50 RPM | 5,000,000 TPM 2,500 RPM | 10,000,000 TPM 5,000 RPM | 15,000,000 TPM 7,500 RPM |
| GPT-OSS-120B | Palantir-hosted | 50,000 TPM 100 RPM | 100,000 TPM 25 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| GPT-OSS-20B | Palantir-hosted | 50,000 TPM 100 RPM | 100,000 TPM 100 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Text Embedding 3 Large | Azure | 1,000,000 TPM 1,500 RPM | 1,060,000 TPM 1,400 RPM | 2,250,000 TPM 3,500 RPM | 3,500,000 TPM 4,750 RPM | 4,750,000 TPM 8,500 RPM |
| Text Embedding 3 Large | Azure (USG) | 1,000,000 TPM 1,500 RPM | 60,000 TPM 400 RPM | 1,000,000 TPM 2,000 RPM | 2,000,000 TPM 3,000 RPM | 3,000,000 TPM 6,000 RPM |
| Text Embedding 3 Large | OpenAI | 1,000,000 TPM 1,500 RPM | 60,000 TPM 400 RPM | 1,250,000 TPM 2,500 RPM | 2,500,000 TPM 3,750 RPM | 3,750,000 TPM 7,500 RPM |
| Text Embedding 3 Small | Azure | 1,000,000 TPM 1,500 RPM | 1,060,000 TPM 1,400 RPM | 1,625,000 TPM 3,500 RPM | 2,250,000 TPM 4,750 RPM | 2,875,000 TPM 8,500 RPM |
| Text Embedding 3 Small | Azure (USG) | 1,000,000 TPM 1,500 RPM | 60,000 TPM 400 RPM | 500,000 TPM 2,000 RPM | 1,000,000 TPM 3,000 RPM | 1,500,000 TPM 6,000 RPM |
| Text Embedding 3 Small | OpenAI | 1,000,000 TPM 1,500 RPM | 60,000 TPM 400 RPM | 625,000 TPM 2,500 RPM | 1,250,000 TPM 3,750 RPM | 1,875,000 TPM 7,500 RPM |
| Whisper 1 | OpenAI | 1 TPM 50 RPM | 1 TPM 100 RPM | 2 TPM 500 RPM | 3 TPM 1,000 RPM | 4 TPM 2,000 RPM |
| o1 | Azure | 600,000 TPM 5 RPM | 100,000 TPM 25 RPM | 250,000 TPM 50 RPM | 400,000 TPM 60 RPM | 750,000 TPM 75 RPM |
| o3 | Azure | 400,000 TPM 100 RPM | 600,000 TPM 525 RPM | 1,500,000 TPM 1,500 RPM | 2,500,000 TPM 2,500 RPM | 4,500,000 TPM 4,500 RPM |
| o3-mini | Azure (USG) | 300,000 TPM 30 RPM | 100,000 TPM 25 RPM | 1,000,000 TPM 100 RPM | 2,000,000 TPM 200 RPM | 4,000,000 TPM 400 RPM |
| o4-mini | Azure | 300,000 TPM 100 RPM | 1,100,000 TPM 1,025 RPM | 2,000,000 TPM 2,000 RPM | 3,000,000 TPM 3,000 RPM | 5,000,000 TPM 5,000 RPM |
| text-embedding-ada-002 | Azure | 1,000,000 TPM 1,500 RPM | 1,450,000 TPM 1,450 RPM | 3,625,000 TPM 3,625 RPM | 4,875,000 TPM 4,875 RPM | 6,250,000 TPM 6,250 RPM |
| text-embedding-ada-002 | Azure (USG) | 1,000,000 TPM 1,500 RPM | 450,000 TPM 450 RPM | 3,000,000 TPM 3,500 RPM | 4,000,000 TPM 4,500 RPM | 5,000,000 TPM 5,500 RPM |
| text-embedding-ada-002 | OpenAI | 1,000,000 TPM 1,500 RPM | 950,000 TPM 950 RPM | 3,125,000 TPM 3,125 RPM | 4,437,500 TPM 4,438 RPM | 5,750,000 TPM 5,750 RPM |
| Document Information Extraction | Palantir-hosted | 1,000,000 TPM 40 RPM | 1,000,000 TPM 40 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 450 RPM | 3,000,000 TPM 600 RPM |
| Gemma 4 26B A4B | Amazon Bedrock | 50,000 TPM 100 RPM | 250,000 TPM 25 RPM | 5,000,000 TPM 500 RPM | 10,000,000 TPM 1,000 RPM | 20,000,000 TPM 2,000 RPM |
| Gemma 4 26B A4B | Palantir-hosted | 50,000 TPM 100 RPM | 100,000 TPM 25 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Schematic 7B | Palantir-hosted | 50,000 TPM 100 RPM | 60,000 TPM 150 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Whisper Large V3 | Palantir-hosted | 50,000 TPM 100 RPM | 60,000 TPM 150 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Snowflake Arctic Embed Medium | Palantir-hosted | 500,000 TPM 500 RPM | 60,000 TPM 150 RPM | 300,000 TPM 450 RPM | 450,000 TPM 675 RPM | 600,000 TPM 900 RPM |
| Grok 4.3 | xAI | 500,000 TPM 100 RPM | 50,000 TPM 20 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Grok 4.5 | xAI | 1,000,000 TPM 200 RPM | 100,000 TPM 40 RPM | 3,000,000 TPM 800 RPM | 4,000,000 TPM 1,200 RPM | 5,000,000 TPM 1,600 RPM |
| Grok 420 Non-Reasoning Latest | xAI | 500,000 TPM 100 RPM | 50,000 TPM 20 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Grok 420 Reasoning Latest | xAI | 500,000 TPM 100 RPM | 50,000 TPM 20 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |
| Grok Build 0.1 | xAI | 400,000 TPM 100 RPM | 50,000 TPM 20 RPM | 1,000,000 TPM 200 RPM | 1,500,000 TPM 300 RPM | 2,000,000 TPM 400 RPM |