API ReferenceIngest

Reingest From Datasets

Re-ingests data from provided source datasets into either an existing target dataset, or a new one. Only supported for CSV and Parquet dataset files. Cannot ingest from streaming (V2) datasets due to data loss for tags and streaming data.

Headers

AuthorizationstringRequired

Bearer authentication of the form Bearer <token>, where token is your auth token.

Request

This endpoint expects an object.
sourceDatasetslist of stringsRequired

The datasets to reingest data from. Can only include tagless, non-streaming datasets (V1). The datasets must be of the same granularity and must only include CSV or Parquet files. Will attempt to reingest from datasets in list order.

targetDatasetobjectRequired

The dataset to ingest data into. Can either be a new dataset or an existing dataset RID.

ingestMetadatamap from strings to objectsRequired

Mapping of dataset to ingest metadata. Ingest metadata will be recovered from existing files if possible. If unrecoverable, will fall back to ingest metadata provided in this field.

Response

This endpoint returns an object.
datasetsmap from strings to objects