Skip to content

feat: [google-cloud-dataplex] added DataQualityResult.score, dimension_score, column_score #12032

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
parthea merged 2 commits into from
Nov 17, 2023
Merged

feat: [google-cloud-dataplex] added DataQualityResult.score, dimension_score, column_score #12032

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
3b2c863
feat: added DataQualityResult.score, dimension_score, column_score
gcf-owl-bot[bot] Nov 17, 2023
f1f5944
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Nov 17, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion packages/google-cloud-dataplex/google/cloud/dataplex/gapic_version.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
__version__ = "1.8.1" # {x-release-please-version}
__version__ = "0.0.0" # {x-release-please-version}
2 changes: 1 addition & 1 deletion packages/google-cloud-dataplex/google/cloud/dataplex_v1/gapic_version.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
__version__ = "1.8.1" # {x-release-please-version}
__version__ = "0.0.0" # {x-release-please-version}
43 changes: 43 additions & 0 deletions packages/google-cloud-dataplex/google/cloud/dataplex_v1/types/logs.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -613,6 +613,13 @@ class EventType(proto.Enum):
BigQuery set iam policy for policy tag.
ACCESS_POLICY_UPDATE (14):
Access policy update event.
GOVERNANCE_RULE_MATCHED_RESOURCES (15):
Number of resources matched with particular
Query.
GOVERNANCE_RULE_SEARCH_LIMIT_EXCEEDS (16):
Rule processing exceeds the allowed limit.
GOVERNANCE_RULE_ERRORS (17):
Rule processing errors.
"""
EVENT_TYPE_UNSPECIFIED = 0
RESOURCE_IAM_POLICY_UPDATE = 1
Expand All @@ -627,6 +634,9 @@ class EventType(proto.Enum):
BIGQUERY_POLICY_TAG_DELETE = 12
BIGQUERY_POLICY_TAG_SET_IAM_POLICY = 13
ACCESS_POLICY_UPDATE = 14
GOVERNANCE_RULE_MATCHED_RESOURCES = 15
GOVERNANCE_RULE_SEARCH_LIMIT_EXCEEDS = 16
GOVERNANCE_RULE_ERRORS = 17

class Entity(proto.Message):
r"""Information about Entity resource that the log event is
Expand Down Expand Up @@ -844,6 +854,25 @@ class DataQualityResult(proto.Message):
key of the map is the name of the dimension. The value is
the bool value depicting whether the dimension result was
``pass`` or not.
score (float):
The table-level data quality score for the data scan job.

The data quality score ranges between [0, 100] (up to two
decimal points).
dimension_score (MutableMapping[str, float]):
The score of each dimension for data quality result. The key
of the map is the name of the dimension. The value is the
data quality score for the dimension.

The score ranges between [0, 100] (up to two decimal
points).
column_score (MutableMapping[str, float]):
The score of each column scanned in the data scan job. The
key of the map is the name of the column. The value is the
data quality score for the column.

The score ranges between [0, 100] (up to two decimal
points).
"""

row_count: int = proto.Field(
Expand All @@ -859,6 +888,20 @@ class DataQualityResult(proto.Message):
proto.BOOL,
number=3,
)
score: float = proto.Field(
proto.FLOAT,
number=4,
)
dimension_score: MutableMapping[str, float] = proto.MapField(
proto.STRING,
proto.FLOAT,
number=5,
)
column_score: MutableMapping[str, float] = proto.MapField(
proto.STRING,
proto.FLOAT,
number=6,
)

class DataProfileAppliedConfigs(proto.Message):
r"""Applied configs for data profile type data scan job.
Expand Down
2 changes: 1 addition & 1 deletion ...e-cloud-dataplex/samples/generated_samples/snippet_metadata_google.cloud.dataplex.v1.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
],
"language": "PYTHON",
"name": "google-cloud-dataplex",
"version": "1.8.1"
"version": "0.1.0"
},
"snippets": [
{
Expand Down