Platform Engineering Team/Data Value Stream/Scheduled Dataset Creation

= Scheduled Dataset Creation =

The Generated Data Platform team provides capabilities to schedule automated processes to run to support dataset creation.

To start the process of moving your


 * 1) Branch: https://gitlab.wikimedia.org/gmodena/platform-airflow-dags/-/tree/multi-project-dags-repo/ (do we want to request branch name format?) - is that the correct repo?
 * 2) How do I download skeleton tools? Command...
 * 3) Create folder like image-matching - (do we want to request folder name format?) - only make changes in that folder

How do I start the process?
Start by entering a Phabricator ticket (need template?). The below process defines the steps you will go through to have your code deployed on our automated scheduling tool.



What code checks are in place?
<>

What are unit tests?
<>

How can I monitor my job?
<>