Specification
Schemas
Learning Materials
RFCs
Whitepaper
schemas
/
datasets
/
v1alpha1
Index of
/schemas/datasets/v1alpha1/
.. (parent)
📁
actions/
📄
AddData.json
Indicates that data has been ingested into a root dataset.
2.2 KB
📄
AllowAnonymousRead.json
Controls whether the dataset is readable by users who did not authenticate. Materialized into the auth engine by the Dataset controller.
509 B
📄
AllowPublicRead.json
Controls whether the dataset is readable by any authenticated principal. Materialized into the auth engine by the Dataset controller.
503 B
📄
AttachmentEmbedded.json
Embedded attachment item.
507 B
📄
Attachments.json
Defines the source of attachment files.
1.0 KB
📄
Checkpoint.json
Describes a checkpoint produced by an engine
566 B
📄
DataSlice.json
Describes a slice of data added to a dataset or produced via transformation
995 B
📄
Dataset.json
Represents a desired state of a dataset.
1.0 KB
📄
DatasetHandle.json
Link to a dataset.
887 B
📄
DatasetKind.json
Represents type of the dataset.
437 B
📄
DatasetRef.json
Reference to a dataset.
1.0 KB
📄
DatasetSelector.json
Selects one or more datasets by name pattern and optional filters.
1.5 KB
📄
DatasetSpec.json
Represents a desired state of the dataset metadata.
1.5 KB
📄
DatasetSpecInput.json
Represents a desired state of the dataset metadata.
1.5 KB
📄
DatasetVocabulary.json
Specifies the mapping of system columns onto dataset schema.
844 B
📄
ExecuteTransform.json
Indicates that derivative transformation has been performed.
2.0 KB
📄
ExecuteTransformInput.json
Describes a slice of the input dataset used during a transformation
1.9 KB
📄
MetadataBlock.json
An individual block in the metadata chain that captures the history of modifications of a dataset.
1005 B
📄
MetadataEvent.json
Represents a transaction that occurred on a dataset.
4.8 KB
📄
OffsetInterval.json
Describes a range of data as a closed arithmetic interval of offsets
593 B
📄
Projection.json
Represents a projection of a dataaset history into a state for fast lookups.
1.0 KB
📄
ProjectionSpec.json
Represents a projection of a dataaset history into a state for fast lookups.
814 B
📄
ProjectionSpecInput.json
Represents a projection of a dataaset history into a state for fast lookups.
909 B
📄
Seed.json
Establishes the identity of the dataset. Always the first metadata event in the chain.
666 B
📄
SetAttachments.json
Associates a set of files with this dataset.
502 B
📄
SetDataSchema.json
Specifies the complete schema of Data Slices added to the Dataset following this event.
836 B
📄
SetInfo.json
Provides basic human-readable information about a dataset.
579 B
📄
SetLicense.json
Defines a license that applies to this dataset.
771 B
📄
SetTransform.json
Defines a transformation that produces data in a derivative dataset.
808 B
📄
SetVocab.json
Lets you manipulate names of the system columns to avoid conflicts.
729 B
📄
SqlQueryStep.json
Defines a query in a multi-step SQL transformation.
640 B
📄
TemporalTable.json
Temporary Flink-specific extension for creating temporal tables from streams.
643 B
📄
Transform.json
Engine-specific processing queries that shape the resulting data.
2.1 KB
📄
TransformInput.json
Describes a derivative transformation input
773 B
📄
Watermark.json
Represents a watermark in the event stream.
609 B