AI Platform (AIP)AdministrationLLM enrollment rate limits

LLM enrollment rate limits

The table below contains enrollment limits for tokens per minute (TPM) and requests per minute (RPM) for each enrollment tier. For enrollments with both Azure and OpenAI enabled, enrollment limits will be double what is shown below for Azure and OpenAI. Additionally, for enrollments geo-restricted to a single region, TPM and RPM may be lower than the table indicates in the Large and X-large tiers.

If multiple backends are enabled, the rate limits are summed across all backends.

Model Name	Model Backend	Per-user Limits	Small Tier	Medium Tier	Large Tier	XLarge Tier
Claude 3 Haiku	Amazon Bedrock	270K TPM 770 RPM	100K TPM 100 RPM	600K TPM 1K RPM	1.5M TPM 1.5K RPM	2M TPM 2K RPM
Claude 3.5 Haiku	Google Vertex	500K TPM 1K RPM	100K TPM 100 RPM	500K TPM 250 RPM	750K TPM 375 RPM	1M TPM 500 RPM
Claude 3.5 Haiku	Amazon Bedrock	500K TPM 1K RPM	100K TPM 100 RPM	1M TPM 1K RPM	1.5M TPM 1.5K RPM	2M TPM 2K RPM
Claude 3.7 Sonnet	Direct Anthropic	400K TPM 100 RPM	100K TPM 25 RPM	500K TPM 500 RPM	750K TPM 750 RPM	1M TPM 1K RPM
Claude 3.7 Sonnet	Google Vertex	400K TPM 100 RPM	100K TPM 25 RPM	400K TPM 50 RPM	600K TPM 75 RPM	800K TPM 100 RPM
Claude 3.7 Sonnet	Amazon Bedrock	400K TPM 100 RPM	100K TPM 25 RPM	2M TPM 500 RPM	3M TPM 750 RPM	4M TPM 1K RPM
Claude Sonnet 4	Direct Anthropic	400K TPM 25 RPM	100K TPM 25 RPM	500K TPM 500 RPM	750K TPM 750 RPM	1M TPM 1K RPM
Claude Sonnet 4	Google Vertex	400K TPM 25 RPM	100K TPM 25 RPM	500K TPM 50 RPM	750K TPM 75 RPM	1M TPM 100 RPM
Claude Sonnet 4	Amazon Bedrock	400K TPM 25 RPM	100K TPM 25 RPM	2M TPM 500 RPM	3M TPM 750 RPM	4M TPM 1K RPM
Claude Opus 4	Direct Anthropic	100K TPM 5 RPM	100K TPM 25 RPM	250K TPM 250 RPM	375K TPM 375 RPM	500K TPM 500 RPM
Claude Opus 4	Google Vertex	100K TPM 5 RPM	100K TPM 25 RPM	150K TPM 50 RPM	200K TPM 75 RPM	250K TPM 100 RPM
Claude Opus 4	Amazon Bedrock	100K TPM 5 RPM	100K TPM 25 RPM	125K TPM 50 RPM	150K TPM 75 RPM	200K TPM 100 RPM
Claude Opus 4.1	Direct Anthropic	400K TPM 5 RPM	100K TPM 25 RPM	500K TPM 200 RPM	750K TPM 300 RPM	1M TPM 400 RPM
Claude Opus 4.1	Google Vertex	400K TPM 5 RPM	100K TPM 25 RPM	400K TPM 100 RPM	600K TPM 150 RPM	800K TPM 200 RPM
Claude Opus 4.1	Amazon Bedrock	400K TPM 5 RPM	100K TPM 25 RPM	500K TPM 100 RPM	1M TPM 150 RPM	2M TPM 200 RPM
Claude Sonnet 4.5	Direct Anthropic	1M TPM 100 RPM	100K TPM 25 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Claude Sonnet 4.5	Google Vertex	1M TPM 100 RPM	100K TPM 25 RPM	1M TPM 500 RPM	1.5M TPM 750 RPM	2M TPM 1K RPM
Claude Sonnet 4.5	Amazon Bedrock	1M TPM 100 RPM	100K TPM 25 RPM	1M TPM 200 RPM	4M TPM 500 RPM	8M TPM 1K RPM
Claude Opus 4.5	Direct Anthropic	1M TPM 100 RPM	100K TPM 25 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Claude Opus 4.5	Google Vertex	1M TPM 100 RPM	100K TPM 25 RPM	1M TPM 100 RPM	1.5M TPM 150 RPM	2M TPM 200 RPM
Claude Opus 4.5	Amazon Bedrock	1M TPM 100 RPM	100K TPM 25 RPM	1M TPM 100 RPM	2M TPM 200 RPM	4M TPM 400 RPM
Claude Haiku 4.5	Direct Anthropic	1M TPM 100 RPM	100K TPM 100 RPM	1M TPM 250 RPM	1.5M TPM 375 RPM	2M TPM 500 RPM
Claude Haiku 4.5	Google Vertex	1M TPM 100 RPM	100K TPM 50 RPM	1M TPM 100 RPM	1.5M TPM 150 RPM	2M TPM 200 RPM
Claude Haiku 4.5	Amazon Bedrock	1M TPM 100 RPM	100K TPM 50 RPM	1M TPM 200 RPM	2.5M TPM 500 RPM	5M TPM 1K RPM
Claude Opus 4.6	Direct Anthropic	1.5M TPM 150 RPM	100K TPM 10 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Claude Opus 4.6	Google Vertex	1.5M TPM 150 RPM	200K TPM 20 RPM	1M TPM 100 RPM	1.5M TPM 150 RPM	2M TPM 200 RPM
Claude Opus 4.6	Amazon Bedrock	1.5M TPM 150 RPM	200K TPM 20 RPM	3M TPM 300 RPM	4M TPM 400 RPM	6M TPM 600 RPM
Claude Sonnet 4.6	Direct Anthropic	1M TPM 100 RPM	100K TPM 10 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Claude Sonnet 4.6	Google Vertex	1M TPM 100 RPM	200K TPM 20 RPM	1M TPM 500 RPM	1.5M TPM 750 RPM	2M TPM 1K RPM
Claude Sonnet 4.6	Amazon Bedrock	1M TPM 100 RPM	200K TPM 20 RPM	2M TPM 250 RPM	4M TPM 500 RPM	8M TPM 1K RPM
Claude Opus 4.7	Direct Anthropic	1.5M TPM 150 RPM	100K TPM 10 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Claude Opus 4.7	Google Vertex	1.5M TPM 150 RPM	200K TPM 20 RPM	1M TPM 100 RPM	1.5M TPM 150 RPM	2M TPM 200 RPM
Claude Opus 4.7	Amazon Bedrock	1.5M TPM 150 RPM	200K TPM 20 RPM	3M TPM 300 RPM	4M TPM 400 RPM	6M TPM 600 RPM
Llama 3.1 8b Instruct	Palantir Hub	50K TPM 100 RPM	100K TPM 100 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.1 8b Instruct	Amazon Bedrock	50K TPM 100 RPM	100K TPM 100 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.1 70b Instruct	Palantir Hub	50K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.1 70b Instruct	Amazon Bedrock	50K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.3 70b Instruct	Palantir Hub	50K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.3 70b Instruct	Amazon Bedrock	50K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 4 Scout 17b 16E Instruct	Palantir Hub	100K TPM 100 RPM	100K TPM 100 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 4 Scout 17b 16E Instruct	Amazon Bedrock	100K TPM 100 RPM	100K TPM 100 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 4 Maverick 17b 128E Instruct	Amazon Bedrock	100K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.3 Nemotron Super 49b v1.5	Palantir Hub	50K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Llama 3.2 NV EmbedQA 1B v2	Palantir Hub	50K TPM 100 RPM	60K TPM 150 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
NVIDIA Nemotron 3 Nano 30B	Amazon Bedrock	50K TPM 100 RPM	100K TPM 25 RPM	500K TPM 100 RPM	1M TPM 150 RPM	2M TPM 200 RPM
NVIDIA Nemotron 3 Super 120B	Amazon Bedrock	500K TPM 100 RPM	40K TPM 10 RPM	1M TPM 200 RPM	2M TPM 300 RPM	4M TPM 400 RPM
Grok 3	xAI	100K TPM 100 RPM	100K TPM 25 RPM	1M TPM 100 RPM	2M TPM 250 RPM	3M TPM 500 RPM
Grok 4	xAI	1M TPM 100 RPM	500K TPM 100 RPM	4M TPM 200 RPM	8M TPM 500 RPM	12M TPM 1K RPM
Grok 4 Fast (Reasoning)	xAI	1M TPM 100 RPM	100K TPM 25 RPM	4M TPM 200 RPM	8M TPM 400 RPM	12M TPM 1K RPM
Grok 4 Fast (Non-Reasoning)	xAI	1M TPM 100 RPM	100K TPM 100 RPM	4M TPM 200 RPM	8M TPM 400 RPM	12M TPM 1K RPM
Grok 4.1 Fast (Reasoning)	xAI	1M TPM 100 RPM	100K TPM 25 RPM	4M TPM 200 RPM	8M TPM 400 RPM	12M TPM 1K RPM
Grok 4.1 Fast (Non-Reasoning)	xAI	1M TPM 100 RPM	100K TPM 100 RPM	4M TPM 200 RPM	8M TPM 400 RPM	12M TPM 1K RPM
Grok Code Fast 1	xAI	400K TPM 100 RPM	100K TPM 100 RPM	2M TPM 200 RPM	4M TPM 400 RPM	6M TPM 1K RPM
Grok 3 Mini (with Thinking)	xAI	50K TPM 100 RPM	100K TPM 25 RPM	600K TPM 50 RPM	1M TPM 100 RPM	1.2M TPM 150 RPM
Grok 420 0121 Reasoning	xAI	500K TPM 100 RPM	100K TPM 25 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Grok 420 0118 Reasoning	xAI	500K TPM 100 RPM	100K TPM 25 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Grok 420 Reasoning Latest	xAI	500K TPM 100 RPM	50K TPM 20 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Grok 420 Non-Reasoning Latest	xAI	500K TPM 100 RPM	50K TPM 20 RPM	1M TPM 200 RPM	1.5M TPM 300 RPM	2M TPM 400 RPM
Schematic 7B	Palantir Hub	50K TPM 100 RPM	60K TPM 150 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
Document Information Extraction	Palantir Hub	1M TPM 40 RPM	1M TPM 40 RPM	1.5M TPM 300 RPM	2M TPM 450 RPM	3M TPM 600 RPM
Snowflake Arctic Embed Medium	Palantir Hub	500K TPM 500 RPM	60K TPM 150 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
GPT-4o	Direct OpenAI	400K TPM 800 RPM	100K TPM 25 RPM	1M TPM 1K RPM	1.5M TPM 2K RPM	3M TPM 4K RPM
GPT-4o	Azure OpenAI	400K TPM 800 RPM	100K TPM 25 RPM	1M TPM 1K RPM	1.5M TPM 2K RPM	3M TPM 4K RPM
GPT-4o mini	Direct OpenAI	300K TPM 800 RPM	100K TPM 100 RPM	1M TPM 1K RPM	1.5M TPM 2K RPM	3M TPM 4K RPM
GPT-4o mini	Azure OpenAI	300K TPM 800 RPM	100K TPM 100 RPM	1M TPM 1K RPM	1.5M TPM 2K RPM	3M TPM 4K RPM
GPT-4.1	Direct OpenAI	400K TPM 1K RPM	100K TPM 25 RPM	1.5M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-4.1	Azure OpenAI	400K TPM 1K RPM	100K TPM 25 RPM	1.5M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-4.1 mini	Direct OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	2M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-4.1 mini	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	10M TPM 2.5K RPM	30M TPM 7.5K RPM	50M TPM 12.5K RPM
GPT-4.1 nano	Direct OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	2M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-4.1 nano	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	1M TPM 2.5K RPM	30M TPM 7.5K RPM	50M TPM 12.5K RPM
GPT-5	Direct OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	3M TPM 1.5K RPM	6M TPM 3K RPM	10M TPM 5K RPM
GPT-5	Azure OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	3M TPM 1K RPM	5M TPM 2.5K RPM	10M TPM 5K RPM
GPT-5 mini	Direct OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	3M TPM 1K RPM	5M TPM 2K RPM	7M TPM 4K RPM
GPT-5 mini	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	10M TPM 5K RPM	20M TPM 10K RPM	30M TPM 15K RPM
GPT-5 nano	Direct OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	5M TPM 2.5K RPM	10M TPM 5K RPM	20M TPM 10K RPM
GPT-5 nano	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	10M TPM 5K RPM	30M TPM 15K RPM	50M TPM 25K RPM
GPT-5 Codex	Direct OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	3M TPM 1K RPM	4M TPM 2K RPM	5M TPM 4K RPM
GPT-5 Codex	Azure OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	2M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-5.1	Direct OpenAI	500K TPM 1K RPM	100K TPM 25 RPM	1.5M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-5.1	Azure OpenAI	500K TPM 1K RPM	100K TPM 25 RPM	2M TPM 500 RPM	4M TPM 1K RPM	6M TPM 2K RPM
GPT-5.1 Codex	Direct OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	3M TPM 1K RPM	4M TPM 2K RPM	5M TPM 4K RPM
GPT-5.1 Codex	Azure OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	2M TPM 1K RPM	3M TPM 2K RPM	4M TPM 4K RPM
GPT-5.1 Codex mini	Direct OpenAI	1M TPM 500 RPM	100K TPM 100 RPM	3M TPM 1K RPM	4M TPM 2K RPM	5M TPM 4K RPM
GPT-5.1 Codex mini	Azure OpenAI	1M TPM 500 RPM	100K TPM 100 RPM	2M TPM 1K RPM	3M TPM 2K RPM	5M TPM 4K RPM
GPT-5.2	Direct OpenAI	500K TPM 1K RPM	250K TPM 50 RPM	3M TPM 1.5K RPM	6M TPM 3K RPM	10M TPM 5K RPM
GPT-5.2	Azure OpenAI	500K TPM 1K RPM	250K TPM 50 RPM	2M TPM 500 RPM	4M TPM 1K RPM	6M TPM 2K RPM
GPT-5.4	Direct OpenAI	1M TPM 1K RPM	250K TPM 50 RPM	3M TPM 1.5K RPM	6M TPM 3K RPM	10M TPM 5K RPM
GPT-5.4	Azure OpenAI	1M TPM 1K RPM	250K TPM 50 RPM	4M TPM 2K RPM	6M TPM 3K RPM	8M TPM 4K RPM
GPT-5.4 mini	Direct OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	3M TPM 1.5K RPM	6M TPM 3K RPM	10M TPM 5K RPM
GPT-5.4 mini	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	4.5M TPM 2.2K RPM	9M TPM 4.5K RPM	15M TPM 7.5K RPM
GPT-5.4 nano	Direct OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	3M TPM 1.5K RPM	6M TPM 3K RPM	10M TPM 5K RPM
GPT-5.4 nano	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	4.5M TPM 2.2K RPM	9M TPM 4.5K RPM	15M TPM 7.5K RPM
GPT-5.3 Codex	Direct OpenAI	1M TPM 1K RPM	100K TPM 25 RPM	3M TPM 1K RPM	4M TPM 2K RPM	5M TPM 4K RPM
GPT-5.3 Codex	Azure OpenAI	1M TPM 1K RPM	100K TPM 100 RPM	4M TPM 2K RPM	6M TPM 4K RPM	8M TPM 8K RPM
GPT-OSS-20B	Palantir Hub	50K TPM 100 RPM	100K TPM 100 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
GPT-OSS-120B	Palantir Hub	50K TPM 100 RPM	100K TPM 25 RPM	300K TPM 450 RPM	450K TPM 675 RPM	600K TPM 900 RPM
o1	Azure OpenAI	600K TPM 5 RPM	100K TPM 25 RPM	250K TPM 50 RPM	400K TPM 60 RPM	750K TPM 75 RPM
o3	Direct OpenAI	400K TPM 100 RPM	100K TPM 25 RPM	1M TPM 1K RPM	2M TPM 2K RPM	4M TPM 4K RPM
o3	Azure OpenAI	400K TPM 100 RPM	100K TPM 25 RPM	1M TPM 1K RPM	2M TPM 2K RPM	4M TPM 4K RPM
o4-mini	Direct OpenAI	300K TPM 100 RPM	100K TPM 25 RPM	1M TPM 1K RPM	2M TPM 2K RPM	4M TPM 4K RPM
o4-mini	Azure OpenAI	300K TPM 100 RPM	100K TPM 25 RPM	1M TPM 1K RPM	2M TPM 2K RPM	4M TPM 4K RPM
text-embedding-ada-002	Direct OpenAI	1M TPM 1.5K RPM	450K TPM 450 RPM	2.1M TPM 2.1K RPM	3.1M TPM 3.1K RPM	4.2M TPM 4.2K RPM
text-embedding-ada-002	Azure OpenAI	1M TPM 1.5K RPM	450K TPM 450 RPM	2.1M TPM 2.1K RPM	3.1M TPM 3.1K RPM	4.2M TPM 4.2K RPM
Text Embedding 3 Small	Direct OpenAI	1M TPM 1.5K RPM	60K TPM 400 RPM	500K TPM 2K RPM	1M TPM 3K RPM	1.5M TPM 6K RPM
Text Embedding 3 Small	Azure OpenAI	1M TPM 1.5K RPM	60K TPM 400 RPM	500K TPM 2K RPM	1M TPM 3K RPM	1.5M TPM 6K RPM
Text Embedding 3 Large	Direct OpenAI	1M TPM 1.5K RPM	60K TPM 400 RPM	1M TPM 2K RPM	2M TPM 3K RPM	3M TPM 6K RPM
Text Embedding 3 Large	Azure OpenAI	1M TPM 1.5K RPM	60K TPM 400 RPM	1M TPM 2K RPM	2M TPM 3K RPM	3M TPM 6K RPM
Gemini 2.5 Flash	Google Vertex	1M TPM 200 RPM	100K TPM 25 RPM	2M TPM 1.2K RPM	3M TPM 2.4K RPM	4M TPM 4K RPM
Gemini 2.5 Pro	Google Vertex	1M TPM 200 RPM	100K TPM 25 RPM	4M TPM 600 RPM	6M TPM 1.2K RPM	8M TPM 2K RPM
Gemini 2.5 Flash Lite	Google Vertex	1M TPM 200 RPM	100K TPM 100 RPM	2M TPM 1.2K RPM	3M TPM 2.4K RPM	4M TPM 4K RPM
Gemini 3 Flash (Preview)	Google Vertex	1M TPM 200 RPM	100K TPM 100 RPM	6M TPM 900 RPM	9M TPM 1.8K RPM	12M TPM 3K RPM
Gemini 3.1 Pro (Preview)	Google Vertex	1M TPM 200 RPM	500K TPM 100 RPM	6M TPM 900 RPM	9M TPM 1.8K RPM	12M TPM 3K RPM

←

PREVIOUSLLM capacity management

NEXTBring your own model / Bring your own model to AIP

→