Platform Engineering Team/Data Value Stream/Scheduled Dataset Creation

= Scheduled Dataset Creation =

The Generated Data Platform team provides capabilities to schedule automated processes to run to support dataset creation.

Platform Engineering Team/Data Value Stream/Data Pipeline Onboarding/ contains some documentation to help you move your project to our system.

User:CAndrew (WMF)/Airflow Coding Convention describes the coding conventions of batch jobs, such as algorithms, intended to run on Platform Engineering’s datapipelines.

How do I start the process?
Start by entering a Phabricator ticket (need template?). The below process defines the steps you will go through to have your code deployed on our automated scheduling tool.



What code checks are in place?
<>

Platform Engineering Team/Data Value Stream/Data Pipeline Onboarding/ provides information about our code standards and continuous integration checks.

How can I monitor my job?
<>