At this month’s meetup, we:
Shared the latest accomplishments of the community
Learned about using GX and Microsoft Fabric for semantic model data validation from Markus Cozowicz (Microsoft)
Heard an exciting product announcement!
And more
Check out the recording if you missed it:
Sign up here to join us in December.
Thanks and kudos
Huge thanks to everyone who contributed to GX this month—we truly appreciate everything you do!
Our featured contributors for November are:
The ExpectMultiColumnValuesToNotBeNull Expectation now supports SqlAlchemy thanks to Itai Sevitt.
A new Expectation, ExpectColumnValueToBeAboveSpecifiedPercentile, is now available in Pandas due to the efforts of kurt1984.
Our Slack supporters are the members of the GX community who go above and beyond in engaging with others—kudos to them:
Introducing the GX Champions program
GX Champions have set themselves apart with their ongoing involvement in one or more facets of the community, including:
Answering questions from other community members
Contributing to the GX codebase or documentation
Creating and sharing GX or data quality content and starting engaging discussions
Providing in-depth feedback on GX Cloud or OSS
You can learn more about the Champion program and meet the current Champions on our website!
Roadmap update
Erik Hencier, a senior product manager at GX, shared that users can now create Expectation Suites and group tests in the GX Cloud UI. Upcoming plans include:
Support for time-based splitting of SQL tables in the GX Cloud UI
Creating Expectations from GX Cloud’s descriptive column metrics
Viewing the change history of Expectations in the GX Cloud UI
GX and Microsoft Fabric: semantic model data validation
Markus Cozowicz, a principal data scientist at Microsoft and an architect on Microsoft Fabric, gave a great talk about Great Expectations’ new integration with Fabric and semantic link!
Markus covered:
An overview of some major challenges facing data and analytics today
An introduction to Microsoft Fabric and semantic link
How GX can now be used not just in the Fabric data lake, but with semantic link to expose Power BI concepts as native GX artifacts
He also shared a code sample showing how this new integration works in practice.
Watch Markus’ presentation here:
The tutorial Markus references in the talk is here.
Product announcement
Next, Don Heppner, GX’s director of engineering, shared an exciting announcement:
We are preparing for GX 1.0!
During the move to 1.0, we’ll be focusing on streamlining our API and improving the experience for everyone who uses, contributes to, and maintains the code.
Watch Don’s announcement here:
Additional updates
Next month’s community event is Tuesday, Dec 12 at noon ET! Click here to add it to your calendar.
GX co-founder and CTO James Campbell appeared on the Engineering Founders podcast: Capturing & synthesizing unbiased insights from users, your open source community & yourself
Check out this talk from Lawrence Bruhmuller, GX’s VP of engineer, from ELC 2023: When your team breaks: the messy growth stage of a startup and how to navigate it
Have you done something cool with Great Expectations that you'd like to share? If you're interested in demoing or have a piece of data quality content that you'd like us to feature, DM @Mollie Pettit on our Slack.
