Scheduled Dataset Creation edit

The Generated Data Platform team provides capabilities to schedule automated processes to run to support dataset creation.

Data Pipeline Onboarding contains some documentation to help you move your project to our system.

Airflow Coding Conventions describes the coding conventions of batch jobs, such as algorithms, intended to run on Platform Engineering’s datapipelines.