• Documentation
    • Search documentation
    karat

    +

    K

    API Reference ↗
    AI Platform (AIP)Supported LLMs

    Supported LLMs

    Palantir AIP supports a wide range of LLMs (large language models) and text embedding models from leading providers, including xAI, OpenAI, Anthropic, Meta, and Google. Supported models are listed on this page and can be used across the Palantir platform to power AIP workflows, though availability may differ across enrollments (for instance, due to georestriction).

    To use a specific model, an enrollment administrator must first enable the model family for use through Control Panel. Learn how to configure the selection of LLMs available for use on your enrollment.

    Available LLMs

    The following LLMs are supported for use with AIP, subject to enrollment availability.

    Available text embedding models

    Palantir AIP also supports the following text embedding models:

    Available audio models

    Recording and consent are your responsibility

    Before deploying any application that records or transcribes human speech, ensure participants are notified and that you have consent flows in place where required by the jurisdictions you operate in. This may apply whether the participant is the application user, a third party on a call, or anyone else whose voice is captured. See Recording, transcription, and consent.

    Palantir AIP supports two categories of audio models: realtime speech-to-speech models for building conversational voice applications, and transcription models for converting audio into text. To learn how to use audio models from a browser-based application authenticated as a Foundry user, see Build a voice-enabled OSDK application. For a high-level overview of audio on Foundry, see Realtime audio.

    The Mode column indicates which usage paths each model supports:

    • Realtime: streaming bidirectional WebSocket. The model handles voice activity detection, turn-taking, and streaming output; the application sends raw audio as it is captured.
    • Static: request-response HTTP. The application sends a bounded audio payload and receives the transcription back. Suited to transcribing previously recorded audio files. Also viable for live transcription if the application performs its own audio chunking — a trade-off that adds application complexity in exchange for lower and more predictable per-minute cost. This approach also helps when a realtime model is not available on your enrollment. Latency depends on chunk size and model, so evaluate it for your use case.

    Realtime speech-to-speech

    Realtime speech-to-speech models accept streaming audio input, make tool calls during the conversation, and return streaming audio output over a WebSocket connection.

    ModelAPI nameProviderMode
    GPT Realtime 1.5 ↗gpt-realtime-1.5OpenAI Direct, Azure OpenAIRealtime
    GPT Realtime 2.0 ↗gpt-realtime-2OpenAI DirectRealtime

    Transcription

    Transcription models convert audio into text. Most support both realtime (streaming WebSocket) and static (request-response HTTP) modes; Whisper_large_v3 is Palantir-hosted and supports static only.

    ModelAPI nameProviderMode
    Whisper 1 ↗whisper-1OpenAI Direct, Azure OpenAIRealtime, Static
    GPT-4o Transcribe ↗gpt-4o-transcribeOpenAI Direct, Azure OpenAIRealtime, Static
    GPT-4o Mini Transcribe ↗gpt-4o-mini-transcribeOpenAI Direct, Azure OpenAIRealtime, Static
    GPT-4o Transcribe Diarize ↗gpt-4o-transcribe-diarizeOpenAI Direct, Azure OpenAIRealtime, Static
    Whisper Large V3 ↗Whisper_large_v3Palantir-hostedStatic

    Use gpt-4o-transcribe-diarize when you need speaker diarization for multi-speaker audio such as meetings. For general-purpose transcription where diarization is not required, use gpt-4o-transcribe, gpt-4o-mini-transcribe, or whisper-1 depending on the quality, cost, and latency trade-offs that fit your use case. Use Whisper_large_v3 in environments where OpenAI Direct or Azure OpenAI integrations are not available.

    For per-enrollment availability across geographic regions, see the LLM availability by geography table below.

    LLM availability prerequisites

    AIP is model-agnostic and supports a diverse selection of models for LLM-powered use cases; for more information, refer to this list of all models available in AIP.

    However, LLM selection and availability differs across enrollments based on certain prerequisites for a specific model to be available on an enrollment. These prerequisites determine whether a model family appears as enabled, disabled, or disallowed in Control Panel. Learn more about model states in the Model enablement interface.

    The criteria are listed below:

    • Model has been integrated with AIP: Palantir aims to support the latest flagship models in the industry and is actively developing support in line with model releases and updates.
    • Legal acknowledgment has been given where required: Enrollment administrators must accept the legal requirements and terms of use of a provider to have certain models enabled. This can usually be done in Control Panel under the Model enablement tab. Models awaiting legal acknowledgment appear in a disabled state.
    • AIP has been enabled on an enrollment to use an LLM: For usage in products such as AIP Logic, Transforms, Functions, and Pipeline Builder, the permissions for AIP capabilities for custom workflows must be enabled for intended user groups.
    • Regional availability compatibility (for external provider models): For models like GPT, Claude, and Gemini, you may need to consider regional availability if you are on a geography-restricted enrollment. For example, GPT4o and Claude 3 Sonnet were both only available in the US on release from each respective model provider before they were available in the EU, UK, and other regions. Review the model georestriction section for details. Models unavailable due to geographical restrictions appear in a disallowed state.
    • Additional reviews have been conducted (for certain Palantir-provided models): Open-source models, such as Llama and Mixtral, may require an additional Palantir engineering review to support your environment. Models requiring these reviews appear in a disallowed state.
    • Sufficient time to integration with a specific AIP frontend product: New LLMs take time to be fully supported on all AIP products (for example, in AIP Logic and in Pipeline Builder's use LLM node feature).
    • Risk consideration (for experimental models): As experimental models might break or require a manual migration to a newer model, we limit their rollout and customers may be required to acknowledge the same before usage is enabled. The term "experimental" is as described by the model provider and not intended for operational usage.

    LLM rate limits

    For information on LLM rate limits, review the documentation on LLM capacity management.

    LLM availability by geography

    Some enrollments may have access to a limited set of models because of geographical restriction (or georestriction for short); georestriction for a certain region means that any AIP request to a LLM stays within the boundaries of that region. For example, if an enrollment is defined as EU geo-restricted, all LLM requests will be processed in the EU. Non-georestricted enrollments have access to the full set of Palantir-supported models.

    The following table indicates the regional georestriction options for the various models supported by AIP. Note that the regional georestriction refers to the enrollment setup, not to the location of a specific user.

    Model ProviderModelUSEUUKCAAUJPKSAIL2IL4IL5
    xAIGrok-4✅
    xAIGrok 4.1 Fast (Reasoning)✅
    xAIGrok 4.1 Fast (Non-Reasoning)✅
    Bedrock / Vertex / AnthropicClaude 4.5 Sonnet✅✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4.5 Haiku✅✅✅✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4.5 Opus✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4.6 Opus✅✅✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4.6 Sonnet✅✅✅✅✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4.7 Opus✅✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4.8 Opus✅✅✅✅
    VertexGemini 2.5 Flash Lite✅✅✅✅
    VertexGemini 3 Flash✅✅✅✅
    VertexGemini 3.1 Pro✅✅✅✅
    VertexGemini 3.1 Flash Lite✅✅✅✅
    VertexGemini 3.5 Flash✅✅✅✅
    Azure / OpenAIGPT-5.1✅✅✅
    Azure / OpenAIGPT-5.1 Codex✅
    Azure / OpenAIGPT-5.1 Codex Max✅
    Azure / OpenAIGPT-5.1 Codex Mini✅
    Azure / OpenAIGPT-5-mini✅✅
    Azure / OpenAIGPT-5-nano✅✅
    Azure / OpenAIGPT-4.1✅✅✅✅✅
    Azure / OpenAIGPT-4.1-mini✅✅✅✅✅✅
    Azure / OpenAIGPT-4.1-nano✅✅
    Azure / OpenAIada002✅✅✅✅✅✅✅✅✅
    Azure / OpenAIembedding3-large✅✅✅✅✅✅
    Azure / OpenAIembedding3-small✅✅✅✅✅✅✅
    Azureo4-mini✅✅
    Azureo3✅✅
    BedrockLlama4 16B Scout✅
    BedrockLlama4 128B Maverick✅
    xAIGrok-3✅
    xAIGrok-3 mini✅
    xAIGrok-Code-Fast-1✅
    xAIGrok 4 Fast (Reasoning)✅
    xAIGrok 4 Fast (Non-Reasoning)✅
    Bedrock / Vertex / AnthropicClaude 4.1 Opus✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 4 Sonnet✅✅✅✅
    Vertex / AnthropicClaude 4 Opus✅✅✅✅
    Bedrock / Vertex / AnthropicClaude 3.7 Sonnet✅✅✅✅✅✅
    BedrockClaude 3 Haiku✅✅✅
    BedrockClaude 3.5 Haiku✅✅
    BedrockClaude3.5 Sonnet v2✅✅
    BedrockClaude3.5 Sonnet✅✅✅✅✅
    VertexGemini 2.5 Pro✅✅✅✅
    VertexGemini 2.5 Flash✅✅✅✅✅
    Azure / OpenAIGPT-5✅✅
    Azure / OpenAIGPT-5 Pro
    Azure / OpenAIGPT-5 Codex✅
    Azure / OpenAIGPT-5.2✅
    Azure / OpenAIGPT-5.2 Codex✅
    Azure / OpenAIGPT-5.3 Codex✅
    Azure / OpenAIGPT-5.4✅
    Azure / OpenAIGPT-5.4 mini✅
    Azure / OpenAIGPT-5.4 nano✅
    Azure / OpenAIGPT-5.5✅✅
    Azure / OpenAIGPT-4o✅✅✅✅✅✅✅✅✅
    Azure / OpenAIGPT-4o-mini✅✅✅✅✅✅✅
    Azure / OpenAIWhisper 1✅
    Azure / OpenAIGPT-4o Transcribe✅
    Azure / OpenAIGPT-4o Mini Transcribe✅
    Azure / OpenAIGPT-4o Transcribe Diarize✅
    Azure / OpenAIGPT Realtime 1.5✅
    OpenAIGPT Realtime 2.0✅
    Azureo3-mini✅✅✅✅✅
    Azureo1✅✅
    Open source (Palantir-hosted)Llama3.1 8B✅✅✅✅✅✅✅✅✅
    Open source (Palantir-hosted)Llama3.3 70B✅✅✅✅✅✅✅✅✅
    Open source (Palantir-hosted)Llama3.3 Nemotron Super 49b v1.5✅✅✅✅✅✅✅✅✅
    Open source (Palantir-hosted)Llama3.2 NV EmbedQA 1B v2✅✅✅✅✅✅✅✅✅
    Open source (Palantir-hosted)Mixtral 8x7B✅✅✅✅✅✅✅✅✅
    Open source (Palantir-hosted)Document Information Extraction✅✅✅✅✅✅✅✅✅
    Open source (Palantir-hosted)Whisper Large V3✅✅✅✅✅

    Bring your own model (LLM)

    Bring your own model is a capability that provides first-class support for customers that would like to connect their own LLMs or accounts to use in AIP with all Palantir developer products - AIP Logic, Pipeline Builder, Chatbot Studio, Workshop, etc.

    Review the bring your own model documentation to learn how to register models for use in AIP.

    Note: AIP feature availability is subject to change and may differ between customers.

    The "OpenAI" name and the “GPT” brands are property of OpenAI.

    All third-party trademarks (including logos and icons) referenced remain the property of their respective owners. No affiliation or endorsement is implied.