Supported LLMs

Palantir AIP supports a wide range of LLMs (large language models) and text embedding models from leading providers, including xAI, OpenAI, Anthropic, Meta, and Google. Supported models are listed on this page and can be used across the Palantir platform to power AIP workflows, though availability may differ across enrollments (for instance, due to georestriction).

Learn how to configure the selection of LLMs available for use on your enrollment..

Available LLMs

The following LLMs are supported for use with AIP, subject to enrollment availability.

Available text embedding models

Palantir AIP also supports the following text embedding models:

LLM availability prerequisites

AIP is model-agnostic and supports a diverse selection of models for LLM-powered use cases; for more information, refer to this list of all models available in AIP.

However, LLM selection and availability differs across enrollments based on certain prerequisites for a specific model to be available on an enrollment. The criteria are listed below:

  • Model has been integrated with AIP: Palantir aims to support the latest flagship models in the industry and is actively developing support in line with model releases and updates.
  • Legal acknowledgment has been given where required: Enrollment administrators must accept the legal requirements and terms of use of a provider to have certain models enabled. This can usually be done in Control Panel under the Model enablement tab.
  • AIP has been enabled on an enrollment to use an LLM: For usage in products such as AIP Logic, Transforms, Functions, and Pipeline Builder, the permissions for AIP capabilities for custom workflows must be enabled for intended user groups.
  • Regional availability compatibility (for external provider models): For models like GPT, Claude, and Gemini, you may need to consider regional availability if you are on a geography-restricted enrollment. For example, GPT4o and Claude3 Sonnet were both only available in the US on release before they were available in the EU, UK, and other regions. Review the model georestriction section for details.
  • Additional reviews have been conducted (for certain Palantir-provided models): Open-source models, such as Llama and Mixtral, may require an additional Palantir engineering review to support your environment.
  • Sufficient time to integration with a specific AIP frontend product: New LLMs take time to be fully supported on all AIP products (for example, in AIP Logic and in Pipeline Builder's use LLM node feature).
  • Risk consideration (for experimental models): As experimental models might break or require a manual migration to a newer model, we limit their rollout and customers may be required to acknowledge the same before usage is enabled. The term "experimental" is as described by the model provider and not intended for operational usage.

LLM rate limits

For information on LLM rate limits, review the documentation on LLM capacity management.

LLM availability by geography

Some enrollments may have access to a limited set of models because of geographical restriction (or georestriction for short); georestriction for a certain region means that any AIP request to a LLM stays within the boundaries of that region. For example, if an enrollment is defined as EU geo-restricted, all LLM requests will be processed in the EU. Non-georestricted enrollments have access to the full set of Palantir-supported models.

The following table indicates the regional georestriction options for the various models supported by AIP. Note that the regional georestriction refers to the enrollment setup, not to the location of a specific user.

Model ProviderModelUSEUUKCAAUJP
xAIGrok-3-beta
xAIGrok-3-mini-beta
BedrockClaude 4 Sonnet
BedrockClaude 3.7 Sonnet
BedrockClaude3.5 Haiku
VertexGemini 1.5 Pro
VertexGemini 2.0 Flash
Azure / OpenAIGPT-4.1
Azure / OpenAIGPT-4.1-mini
Azure / OpenAIGPT-4.1-nano
Azure / OpenAIada002
Azure / OpenAIembedding3-large
Azure / OpenAIembedding3-small
Azureo4-mini
Azureo3
Azure / OpenAIo1-mini
Azure / OpenAIo1-preview
xAIGrok-2
xAIGrok-2-vision
BedrockClaude 4 Opus
BedrockClaude3.5 Sonnet v2
BedrockClaude3.5 Sonnet
BedrockClaude3 Sonnet
BedrockClaude3 Haiku
VertexGemini 1.5 Flash
Azure / OpenAIGPT-4o
Azure / OpenAIGPT-4o-mini
Azureo3-mini
Azure / OpenAIo1-mini
Azure / OpenAIo1-preview
AzureGPT4 (8K, 32K)
AzureGPT3.5
Open source (Palantir-hosted)Llama3 8B
Open source (Palantir-hosted)Llama3 70B
Open source (Palantir-hosted)Llama3.1 8B
Open source (Palantir-hosted)Llama3.1 70B
Open source (Palantir-hosted)Llama3.3 70B
Open source (Palantir-hosted)Mixtral 8x7B
Open source (Palantir-hosted)Document Information Extraction

Bring your own model (LLM)

Bring your own model is a capability that provides first-class support for customers that would like to connect their own LLMs or accounts to use in AIP with all Palantir developer products - AIP Logic, Pipeline Builder, Agent Studio, Workshop, etc.

Review the bring your own model documentation to learn how to register models for use in AIP.


Note: AIP feature availability is subject to change and may differ between customers.

The "OpenAI" name and the “GPT” brands are property of OpenAI.

All third-party trademarks (including logos and icons) referenced remain the property of their respective owners. No affiliation or endorsement is implied.