Scheduling validation runs directly from GX Cloud is here! Automating your data validation is now easier to implement and much more accessible to nontechnical users.
What’s new
Each Expectation Suite now has an associated schedule that you can configure without leaving GX Cloud, and which will run automatically once enabled.
For new Expectation Suites, you’ll select the frequency and timing of your schedule when you create them.
Since you’ll need to configure and iterate on your Expectations to start, the schedule is paused by default. You can enable it when your Expectation Suite is ready for prime time!
For existing Expectation Suites, a default schedule has been created and paused. You can change the frequency and timing of the schedule when you activate it.
Why schedule data validations?
Every time you get new data in the table you’re monitoring (or when data is removed!) there’s the potential for a data quality issue to be introduced.
Regular data quality checks are critical to making sure that your data’s quality remains high over time, and automation is key to making sure those recurring checks actually happen.
Where is scheduling in GX Cloud?
You can find the scheduling functionality in your Data Asset, under the “Expectations” tab. The schedule is shown for the selected Expectation Suite.
How to start using GX Cloud automated scheduling
Automated scheduling is available in GX Cloud right now, for both new and existing accounts!
Log in to or create your GX Cloud account to try it out.
And consider adding Slack alerts to your scheduled Expectation Suites, so you can be notified of the results as soon as your Expectations complete their scheduled run!
PS: If you’re currently scheduling your GX Cloud validation runs through integration with Airflow, you can keep doing that—GX Cloud’s orchestrator integrations are unchanged.
