API ReferenceIngest

Reingest From Datasets

Re-ingests data from provided source datasets into either an existing target dataset, or a new one. Only supported for CSV and Parquet dataset files. Will only reingest dataset files and will drop streaming data from datasets.

Headers

AuthorizationstringRequired

Bearer authentication of the form Bearer <token>, where token is your auth token.

Request

This endpoint expects an object.
sourceDatasetslist of stringsRequired

The datasets to reingest data from. Can only include tagless, non-streaming datasets (V1). The datasets must be of the same granularity and must only include CSV or Parquet files. Will attempt to reingest from datasets in list order.

targetDatasetobjectRequired

The dataset to ingest data into. Can either be a new dataset or an existing dataset RID.

ingestMetadatamap from strings to objectsRequired

Mapping of dataset to ingest metadata. Ingest metadata only needs to be provided in request if it cannot be recovered from prior ingests. See documentation on each field to determine what metadata can be auto-recovered.

Response

This endpoint returns an object.
datasetsmap from strings to objects