Data connectivity & integrationGeospatial and geotemporalGeotemporal seriesIntegrate geotemporal series with the Ontology

Integrate geotemporal series with the Ontology

To establish a geotemporal series in the Ontology that drives analysis and visualization within Palantir applications, such as a Gaia map, you will use Pipeline Builder to:

Create a geotemporal series sync using the geotemporal series output.
Create a geotemporal series object type using the object type pipeline output.
Connect the geotemporal series sync to the geotemporal series object type using a geotemporal series reference (GTSR) property type. The object type also includes live and static information, such as a vessel's current position and call sign.

If you plan to add data from the Ontology to a Foundry map and not Gaia, use time series to view and analyze data associated with geospatial or geotemporal objects. Learn more about this in our geospatial time series use case tutorial.

Review the geospatial FAQ page or contact Palantir Support with additional questions about which integration type you should use to index your geotemporal data into the Ontology based on your enrollment and specific use case.

Follow the instructions below to add a geotemporal series sync output as a reference to a geotemporal series object type.

Create a new pipeline in Pipeline Builder

Navigate to Pipeline Builder and select the green New pipeline button.
Name your pipeline and select a project where it will be saved.
Choose Streaming pipeline before selecting Create pipeline. Geotemporal series are also compatible with batch pipelines, but streaming allows for real-time updates to tracked entities.

Import and transform your geotemporal dataset

Review the existing documentation on geotemporal data modeling before proceeding.

Identify the streaming dataset that will back your geotemporal series sync and object type and follow the instructions below to add them to your pipeline.

Select Add Foundry data if you have already ingested your data into the platform.
Search for your files in the Add data modal and select the + icon to add each dataset to your pipeline.
Select Add data in the bottom right corner of the Add data modal.

A streaming dataset is displayed on a pipeline's graph canvas.

Create your geotemporal series sync

Learn more about configuring your geotemporal series sync in Pipeline Builder.

At a minimum, your streaming dataset should contain columns that capture a tracked entity's movement over time, such as its latitude and longitude at a given timestamp, as well as a string column that enables you to join the geotemporal series sync to the object type. Columns that contain data that changes over time are referred to as live fields, whereas those that remain consistent (such as an entity's name) are called static.

Your transform needs may vary depending on your streaming dataset's raw state upon ingest into Foundry. The example data outlined below contains the following columns that map to the sync's primary fields:

Series_ID: A string column used to join the geotemporal series sync to the object type. Learn more about configuring a series ID.
Timestamp: A timestamp column containing the time recorded for the entity's location.
Geopoint: A geopoint column containing the entity's latitude and longitude pair.

The primary fields of a geotemporal series sync are displayed.

The dataset contains additional columns which will map to the geotemporal series sync's Properties but are not required for the sync to function in a Palantir map application.

The additional properties within a geotemporal series sync are displayed.

If necessary, use Pipeline Builder's Cast and Create GeoPoint transforms to prepare your raw streaming dataset for output as a geotemporal series sync.

Pipeline Builder's Cast and Create GeoPoint transform cards are displayed.

Follow the instructions below to create a geotemporal series sync output from your transformed streaming data:

Select the streaming dataset or transform node to render the vertical menu bar, where you will choose the gold + icon to add a New geotemporal series sync output.
Enter a name and optionally change the default icon for your sync in Name and icon.
Select your Destination namespace to which Foundry will write the sync.
Assign the relevant columns from your streaming dataset to the sync's Primary fields.
Set your sync's Observation schema if one already exists. If one does not exist, then you can leave this field empty; Foundry will generate a new one from your sync's mapped properties. Learn more about observation schema.
Optionally toggle the Live icon to the right of any additional Properties to mark one or multiple as static.

An explanatory tooltip renders after hovering over Live in the Properties panel.

Foundry records a Live property value for every new observation, such as an entity's velocity at a given timestamp. If you mark a property as static, then Foundry records and applies the latest value of that property for all observations in the series.

Optionally configure any Styles for your sync to control its downstream rendering.
Optionally configure the integration's storage settings.
Reference an interface that represents your geotemporal series object type's properties by choosing Reference interface then mapping the properties in your geotemporal series sync.

Referencing the Geotemporal Series interface in a geotemporal series sync is displayed.

The Geotemporal Series interface is available for installation in Palantir's Core Ontology that is suitable for most use cases. Contact Palantir Support to install this interface on your enrollment if you are unable to access it in Ontology Manager.

Select Save to save your geotemporal series sync.

Create your geotemporal series object type

Next, you will transform your geotemporal dataset to create a geotemporal series object type that is linked to your geotemporal series sync though a geotemporal series reference (GTSR).

Select the geotemporal dataset in your pipeline and choose Transform to insert a new transform.
Search for and select Apply expression.
Select the input field labeled Column, expression, or value and choose your dataset's primary key column from Columns. In this example, the dataset's mmsi column contains a unique vessel identifier that can be used as the primary key.
Create a new column titled Series_ID that is a copy of the dataset's unique identifier, such as mmsi. You will use this new column to link your geotemporal series sync to the object type.

An Apply expression transform block in Pipeline Builder displays an expression copying one column's value into another.

Select Apply before saving the changes to your pipeline and previewing your data.

A dataset preview is displayed in Pipeline Builder.

After transforming your geotemporal dataset, follow the instructions below to create a geotemporal series object type using Pipeline Builder's ontology output.

Select the transform node you just created to render the vertical menu bar, where you will choose the gold + icon to add a New object type output.

The Add output menu accessible from a transform node is displayed.

Enter a name and optionally change the default icon for your sync in Name and icon.
Select the ellipsis icon on the right side of a displayed property to set your primary key and title properties.

Primary key and title properties are displayed.

Select the link icon next to your Series_ID property to map the GTSR property to your object type by choosing Geotemporal series > From this pipeline. You may also select a geotemporal series sync from another pipeline by choosing From Foundry... and selecting the corresponding geotemporal series integration.

A GTSR is linked to an object type's property.

An object type can have at most one geotemporal series reference property, and it may not be an array of geotemporal series references.

Select Implement interface at the bottom of your screen and choose the same interface referenced by your geotemporal series sync.

The Geotemporal Series interface modal is displayed.

Choose Next to implement the required properties on the interface, then Confirm and implement to navigate back to the object type creation window in Pipeline Builder before saving your changes.

Deploy your pipeline

After configuring your geotemporal series sync, creating an object type and interface, and establishing a link between the two via the GTSR, follow the instructions below to deploy your pipeline:

Ensure all changes made to your pipeline are saved.

The Save button is disabled in Pipeline Builder, as all changes made have been saved.

Select Deploy to render the Deploy this pipeline panel.

The Deploy this pipeline panel is displayed.

Optionally Replay on deploy to re-run your pipeline from a specified point in time. Depending on your stream's size, replaying a pipeline may impact the pipeline's deployment speed. Learn more about additional options for streaming pipelines in Pipeline Builder.
Select Deploy pipeline.

Once your pipeline deploys and your object type is created in your ontology, you can visualize its observations on a map.

A successful pipeline deployment notification is displayed.

Visualize your geotemporal data

Gaia is only accessible if your enrollment contains Gotham. Contact Palantir Support with questions about access to Gaia or its additional documentation available in platform.

Once your geotemporal series is integrated with the ontology, you can add its associated object type to your Gaia map.

Geotemporal series reference (GTSR) properties in Ontology Manager

You may also configure a GTSR property type directly in Ontology Manager. Using the geotemporal series sync you created above in a new or the same Pipeline Builder pipeline:

Import or use the same geotemporal dataset you used to create the geotemporal series sync.
Select the geotemporal dataset in your pipeline and choose Transform to insert a new transform.
Search for and select the Create geotemporal series reference expression.

Displays the create geotemporal series reference expression in Pipeline Builder.

For Series ID select the same column you selected as the series ID of your geotemporal series sync.
For Geotemporal series integration RID select the RID of your deployed geotemporal series sync.
Select Apply before saving the changes to your pipeline and previewing your data.
Exit the transform and select the transform node to render the vertical menu bar, where you will choose the gold + icon to add a New dataset output.
Deploy the pipeline with the dataset that has your geotemporal series column.

In Ontology Manager, create a new object type with the new dataset you created as the data source. The corresponding Geotemporal Series Reference property type should be automatically configured from the column you created in Pipeline Builder. If not, you can add or edit an existing property type with the Geotemporal Series Reference type.

Displays the geotemporal series reference property type configuration panel in Ontology Manager.

You must set the correct geotemporal series sync's RID to proceed. You should also implement the geotemporal interface in this workflow.

An object type can have at most one geotemporal series reference property, and it may not be an array of geotemporal series references.

←

PREVIOUSData modeling

NEXTFAQ

→