Expect the column values to have a DataProfiler confidence threshold greater than or equal to the specified threshold for the data label.
expect_column_values_confidence_for_data_label_to_be_greater_than_or_equal_to_threshold
This expectation level is EXPERIMENTAL
Contributors:
Tags:
Metrics:
Description
Expect the column values to have a DataProfiler confidence threshold greater than or equal to the specified threshold for the data label.
This function builds upon the custom column map expectations of Great Expectations. This function asks the question a yes/no question of each row in the user-specified column; namely, does the confidence threshold provided by the DataProfiler model exceed the user-specified threshold.
Args:
- column (str): The column name that you want to check.
- data_label(str): The data label for which you want to check confidences against the threshold value
- threshold (float): The value, usually as a decimal (e.g. .32), you want to use to flag low confidence predictions
df.expect_column_values_confidence_for_data_label_to_be_greater_than_or_equal_to_threshold(
column,
data_label=<>,
threshold=float(0<=1)
)
Want to make your own Expectation or an improvement to this one?
We've put together some great how to guides (including videos) on how to create your own expectations in a flash!
You can see those resources here: Contributor Resources