• Documentation
    • Search documentation
    karat

    +

    K

    API Reference ↗
    AI Platform (AIP)Supported LLMs

    Supported LLMs

    Palantir AIP supports a wide range of LLMs (large language models) and text embedding models from leading providers, including xAI, OpenAI, Anthropic, Meta, and Google. Supported models are listed on this page and can be used across the Palantir platform to power AIP workflows, though availability may differ across enrollments (for instance, due to georestriction).

    Learn how to configure the selection of LLMs available for use on your enrollment..

    Available LLMs

    The following LLMs are supported for use with AIP, subject to enrollment availability.

    Available text embedding models

    Palantir AIP also supports the following text embedding models:

    LLM availability prerequisites

    AIP is model-agnostic and supports a diverse selection of models for LLM-powered use cases; for more information, refer to this list of all models available in AIP.

    However, LLM selection and availability differs across enrollments based on certain prerequisites for a specific model to be available on an enrollment. The criteria are listed below:

    • Model has been integrated with AIP: Palantir aims to support the latest flagship models in the industry and is actively developing support in line with model releases and updates.
    • Legal acknowledgment has been given where required: Enrollment administrators must accept the legal requirements and terms of use of a provider to have certain models enabled. This can usually be done in Control Panel under the Model enablement tab.
    • AIP has been enabled on an enrollment to use an LLM: For usage in products such as AIP Logic, Transforms, Functions, and Pipeline Builder, the permissions for AIP capabilities for custom workflows must be enabled for intended user groups.
    • Regional availability compatibility (for external provider models): For models like GPT, Claude, and Gemini, you may need to consider regional availability if you are on a geography-restricted enrollment. For example, GPT4o and Claude3 Sonnet were both only available in the US on release before they were available in the EU, UK, and other regions. Review the model georestriction section for details.
    • Additional reviews have been conducted (for certain Palantir-provided models): Open-source models, such as Llama and Mixtral, may require an additional Palantir engineering review to support your environment.
    • Sufficient time to integration with a specific AIP frontend product: New LLMs take time to be fully supported on all AIP products (for example, in AIP Logic and in Pipeline Builder's use LLM node feature).
    • Risk consideration (for experimental models): As experimental models might break or require a manual migration to a newer model, we limit their rollout and customers may be required to acknowledge the same before usage is enabled. The term "experimental" is as described by the model provider and not intended for operational usage.

    LLM rate limits

    For information on LLM rate limits, review the documentation on LLM capacity management.

    LLM availability by geography

    Some enrollments may have access to a limited set of models because of geographical restriction (or georestriction for short); georestriction for a certain region means that any AIP request to a LLM stays within the boundaries of that region. For example, if an enrollment is defined as EU geo-restricted, all LLM requests will be processed in the EU. Non-georestricted enrollments have access to the full set of Palantir-supported models.

    The following table indicates the regional georestriction options for the various models supported by AIP. Note that the regional georestriction refers to the enrollment setup, not to the location of a specific user.

    Model ProviderModelUSEUUKCAAUJP
    xAIGrok-3-beta✅
    xAIGrok-3-mini-beta✅
    BedrockClaude 4 Sonnet✅✅
    BedrockClaude 3.7 Sonnet✅✅
    BedrockClaude3.5 Haiku✅
    VertexGemini 1.5 Pro✅✅✅
    VertexGemini 2.0 Flash✅✅
    Azure / OpenAIGPT-4.1✅✅
    Azure / OpenAIGPT-4.1-mini✅
    Azure / OpenAIGPT-4.1-nano✅✅
    Azure / OpenAIada002✅✅✅✅✅✅
    Azure / OpenAIembedding3-large✅✅✅
    Azure / OpenAIembedding3-small✅✅✅✅
    Azureo4-mini✅
    Azureo3
    Azure / OpenAIo1-mini✅✅
    Azure / OpenAIo1-preview✅✅
    xAIGrok-2✅
    xAIGrok-2-vision✅
    BedrockClaude 4 Opus✅✅
    BedrockClaude3.5 Sonnet v2✅✅✅
    BedrockClaude3.5 Sonnet✅✅
    BedrockClaude3 Sonnet✅✅✅✅✅
    BedrockClaude3 Haiku✅✅✅✅
    VertexGemini 1.5 Flash✅✅✅
    Azure / OpenAIGPT-4o✅✅✅✅✅✅
    Azure / OpenAIGPT-4o-mini✅✅
    Azureo3-mini✅✅
    Azure / OpenAIo1-mini✅✅
    Azure / OpenAIo1-preview✅✅
    AzureGPT4 (8K, 32K)✅✅✅✅✅✅
    AzureGPT3.5✅✅✅✅✅✅
    Open source (Palantir-hosted)Llama3 8B✅✅✅✅✅
    Open source (Palantir-hosted)Llama3 70B✅✅✅✅✅
    Open source (Palantir-hosted)Llama3.1 8B✅✅✅✅✅
    Open source (Palantir-hosted)Llama3.1 70B✅✅✅✅✅
    Open source (Palantir-hosted)Llama3.3 70B✅✅✅✅✅
    Open source (Palantir-hosted)Mixtral 8x7B✅✅✅✅✅
    Open source (Palantir-hosted)Document Information Extraction✅✅✅✅✅

    Bring your own model (LLM)

    Bring your own model is a capability that provides first-class support for customers that would like to connect their own LLMs or accounts to use in AIP with all Palantir developer products - AIP Logic, Pipeline Builder, Agent Studio, Workshop, etc.

    Review the bring your own model documentation to learn how to register models for use in AIP.

    Note: AIP feature availability is subject to change and may differ between customers.

    The "OpenAI" name and the “GPT” brands are property of OpenAI.

    All third-party trademarks (including logos and icons) referenced remain the property of their respective owners. No affiliation or endorsement is implied.