engine.schema_fields

The engine.schema_fields dataset contains metadata about a specific dataset, including a series of snapshots that serve as a chronological log of the dataset’s structural changes over time. Each snapshot captures the schema at a given moment—detailing which fields were present and the data types they used at that point.

In addition to schema snapshots, this dataset also includes contextual information such as the dataset’s name and the dataspace it belongs to. Like any other DataPrime dataset, the data in engine.schema_fields can be queried, aggregated, and manipulated using standard DataPrime operations.

Just like any other dataset, engine.schema_fields supports the three primary access control mechanisms: $d, $m, and $l, ensuring consistent and secure data governance across all datasets.

engine.schema_fields

Schema field metadata and characteristics for a dataset in the 'system' dataspace.

dataspace

Indicates the dataspace this dataset belongs to. Example: "system".

dataset

The dataset name. Example: "engine.schema_fields".

flatPath

Flattened path representation used for referencing contexts. Example: "$d.dataset".

dataprimePath

Path used for Dataprime processing. Example: "$d.dataset".

pathParts

Path breakdown used for data reference resolution.

pathParts[0]

The first element of the path. Example: "$d".

pathParts[1]

The second element of the path. Example: "dataset".

snapshotId

Unique identifier of the dataset snapshot. Example: "043c5e02-0924-45f0-83dd-2aa5659e323e".

snapshotStartTime

Start time of the snapshot in epoch nanoseconds. Example: 1750611600000000000.

snapshotDuration

Duration of the snapshot in epoch nanoseconds. Example: "3600000000000".

partitioningScheme

Partitioning scheme of the dataset. Example: "dt/hr".

type

Type of the field. Example: "string".

examples

Example values of the dataset.

Example[0]

Example: ["rumEventsPoc"].

distinctValueCount

Number of distinct values. Example: 1.

labels

Optional labels associated with the field.

{}

highCardinalityLabels

High-cardinality labels, if any.

highCardinalityLabels[0]

metadata

Additional metadata.

entityType

pillar

priorityClass

Priority classification. Example: "Medium".

severity

Severity level. Example: "3".

Possible `engine.schema_fields` keys

keypath	json_type
dataprimePath	string
dataset	string
dataspace	string
distinctValueCount	number
examples	stringarray
flatPath	string
labels	object
labels.category	string
labels.className	string
labels.methodName	string
labels.thread	string
metadata	object
metadata.entityType	string
metadata.pillar	string
metadata.priorityClass	string
metadata.severity	string
partitioningScheme	string
pathParts	stringarray
snapshotDuration	string
snapshotId	string
snapshotStartTime	number
type	string

Schema Management

Next Metric Explorer

engine.schema_fields

engine.schema_fields

Possible engine.schema_fields keys

Possible `engine.schema_fields` keys