backgroundImage

Community roundup: March 2023

March’s community roundup features the second part of our tutorial on using GX with AWS, a demo of the new fluent way to configure Datasources, and more!

Erica Howard
March 23, 2023
March 2023 event cover with two cartoon people looking engaged/thoughtful

At this month’s meetup, we:

  • Learned more about how to use GX with AWS S3 and Pandas for data validation

  • Heard about the v0.16 release, which includes the fluent method of configuring Datasources

  • Saw a demo of this new fluent way of configureing Datasources

  • And more!

You can watch the complete recording below:

The Great Expectations community gathers on the third Tuesday of every month: sign up here to join the next one.

Thanks and kudos

The GX community is a key part of our success! 

Special recognition this month goes out to Richard O’Hara, Marcin Szymański, Carlos Iguaran, and Luke Dyer for their recent contributions!

  • [BUGFIX] Use Path().glob Instead of Path(). Issue #7239 (#7327) (thanks Richard O’Hara

  • [FEATURE] Improve Trino types support (#6588) (thanks Marcin Szymański)

  • [BUGFIX] Adding exception logging to store-related failures (#7202) (thanks Carlos Iguaran)

  • [BUGFIX] AssertError Duing GX Installation (#7285) (thanks Richard O’Hara)

  • [BUGFIX] Allow CLI to work with RuntimeDataConnector (#7187) (thanks Luke Dyer)

And big kudos to our top Slack supporters this month:

March 2023 Slack contributors

Feature demo: Using GX with AWS S3 and Pandas (part II)

Ruben, a developer advocate at GX, covered the second part of how to use our new set of end-to-end integration guides for AWS with a live demo. In today’s demo, Ruben walked us through how to profile data, validate data, and generate the Data Docs site with results in S3:

 

Product updates

v0.16 Release

GX’s product manager, Tal, shared what’s in this release: fluent-configuration Datasources!

Fluent-config Datasources will make it simpler to get started with GX by making it possible to set up a Datasource with just a couple of lines of code. Benefits include:

  • Usability improvements

  • Makes working with multiple batches easy

  • Building and contributing new Datasources is a pleasure

  • Compatibility with the current Datasources, no breaking changes

Feature demo: new fluent method of configuring Datasources

Next, Ruben was back to demo the new fluent method of configuring Datasources. He showed how you need just a few lines of code to get started. He shared his Jupyter Notebooks (file system, AWS S3), showing how simple it is to connect a Datasource. Once connected, you can create an expectation suite and add a validator, create a checkpoint and run it, and review the Data Docs. We’re very excited about this new feature and can’t wait for you to try it!

 

We’re especially interested in hearing about your experience with fluent-config Datasources! If you have thoughts you’d like to share or any questions, please contact @Tal in the GX Slack. Your feedback will be important in prioritizing future work on fluent-config Datasources.

Join the conversation

Additional updates

Have you done something cool with GX that you'd like to share? If you're interested in demoing or have a piece of data quality content you'd like us to feature, DM @Josh Zheng on our Slack.

Search our blog for the latest on data quality.


©2024 Great Expectations. All Rights Reserved.