Integrate geotemporal series with the Ontology

To establish a geotemporal series in the Ontology that drives analysis and visualization within Palantir applications, such as a Gaia map, you will use Pipeline Builder to:

• Create a geotemporal series sync using the geotemporal series output. The output will contain a geotemporal series reference property (GTSR) to capture movement over time.
• Create a geotemporal series object type using the object type pipeline output. The object type will contain the GTSR and static information about the tracked entity, such as a vessel's call sign or name.
• Map the geotemporal series reference property from your geotemporal series sync to your single geotemporal series object type.

Follow the instructions below to add a geotemporal series sync output as a reference to a geotemporal series object type.

Create a new pipeline in Pipeline Builder

1. Navigate to Pipeline Builder and select the green New pipeline button.
2. Name your pipeline and select a project where it will be saved.
3. Choose Streaming pipeline before selecting Create pipeline.

Enable advanced geotemporal series features

After creating a new, empty pipeline, toggle on Pipeline Builder's advanced geotemporal capabilities.

1. Select Settings > Pipeline feature flags... from the top ribbon.
2. Ensure that Enable advanced geotemporal series features is set to Enabled before you close out of the Pipeline feature flags window.

Import and transform your geotemporal datasets

Identify the streaming and static datasets that will back your geotemporal series sync and object type and follow the instructions below to add them to your pipeline. While you can create both a geotemporal series object type and geotemporal series sync from one dataset, the steps below provide instructions using two: a live stream to back the geotemporal series sync and a static dataset to back the object type.

1. Select Add Foundry data if you have already ingested your data into the platform.
2. Search for your files in the Add data modal and select the + icon to add each dataset to your pipeline.
3. Select Add data in the bottom right corner of the Add data modal.

Transform your streaming dataset

Your transform needs may vary depending on your streaming dataset's raw state upon ingest into Foundry. The example data outlined below contains the following columns that map to the sync's primary fields:

• Series_ID: A string column used to join the geotemporal series sync to the static dataset-backed object type. Learn more about configuring a series ID.
• Timestamp: A timestamp column containing the time recorded for the entity's location.
• Geopoint: A geopoint column containing the entity's latitude and longitude pair.

The dataset contains additional columns which will map to the geotemporal series sync's Properties but are not required for the sync to function in a Palantir map application.

If necessary, use Pipeline Builder's Cast and Create GeoPoint transforms to prepare your raw streaming dataset for output as a geotemporal series sync.

Follow the instructions below to create a geotemporal series sync output from your transformed streaming data:

1. Select the streaming dataset or transform node to render the vertical menu bar, where you will choose the gold + icon to add a New geotemporal series sync output.
2. Enter a name and optionally change the default icon for your sync in Name and icon.
3. Select your Destination namespace to which Foundry will write the sync.
4. Assign the relevant columns from your streaming dataset to the sync's Primary fields.
5. Set your sync's Observation schema if one already exists. If one does not exist, then you can leave this field empty; Foundry will generate a new one from your sync's mapped properties. Learn more about observation schema.
6. Optionally toggle the Live icon to the right of any additional Properties to mark one or multiple as static.

7. Optionally configure any Styles for your sync to control its downstream rendering.
8. Optionally select Dataset archive in Advanced settings to retain all your sync's data in a long-term historical archive beyond the default live retention window of 14 days. You should select Dataset archive if you plan to visualize your objects on Foundry's Map application.

9. Select Save to save your geotemporal series sync.

Transform your static dataset

Next, you will transform your object type backing dataset to ensure it can be linked to your geotemporal series sync though a geotemporal series reference (GTSR).

1. Select the static dateset in your pipeline and choose Transform to insert a new transform.
2. Search for and select Apply expression.
3. Select the input field labeled Column, expression, or value and choose your dataset's primary key column from Columns. In this example, the dataset's mmsi column contains a unique vessel identifier that can be used as the primary key.
4. Create a new column titled Series_ID that is a copy of the dataset's unique identifier, such as mmsi. You will use this new column to link your geotemporal series sync to the object type.

5. Select Apply before saving the changes to your pipeline and previewing your data.

Create an object type output

After transforming your static dataset, follow the instructions below to create an object type output and implement the Tracked Entity interface.

1. Select the transform node you just created to render the vertical menu bar, where you will choose the gold + icon to add a New object type output.

2. Enter a name and optionally change the default icon for your sync in Name and icon.
3. Select the ellipsis icon on the right side of a displayed property to set your primary key and title properties.

4. Select the link icon next to your Series_ID property to map the GTSR property to your object type by choosing Geotemporal series > From this pipeline.

5. Select Implement interface at the bottom of your screen and choose the Tracked Entity interface from the Palantir Core Ontology.

6. Choose Implement and go to mapping to navigate back to the object type creation window in Pipeline Builder before saving your changes.

Deploy your pipeline

After configuring your geotemporal series sync, creating an object type and interface, and establishing a link between the two via the GTSR, follow the instructions below to deploy your pipeline:

1. Ensure all changes made to your pipeline are saved.

2. Select Deploy to render the Deploy this pipeline panel.

3. Optionally Replay on deploy to re-run your pipeline from a specified point in time. Depending on your stream's size, replaying a pipeline may impact the pipeline's deployment speed. Learn more about additional options for streaming pipelines in Pipeline Builder.
4. Select Deploy pipeline.

Once your pipeline deploys and your object type is created in your ontology, you can visualize its observations on a map.

Visualize your geotemporal data

Gaia

To ensure Gotham can access object types in your Foundry ontology and render objects as part of a data layer on a Gaia map, you must follow the instructions to type map your object type in Ontology Manager.

Once you ensure your object type is discoverable by Gotham, you can add it to your Gaia map.

In addition to adding data from your ontology, you can review the existing documentation to learn more about creating ontology data from Gaia.

Map

With your pipeline deployed, you can add your object type as a layer on a new or existing map in Foundry. Object data on a map will update in real-time when upstream changes are made, with those updates stored both within the object type and the sync's dataset archive.

Learn more about visualizing data from your ontology in Foundry.