Skip to content

Data Enrichment functionalities #1277

@SvenHoeffler

Description

@SvenHoeffler

In order to better organize and prepare integration data, the Data Hub will be expanded with a suite of functionalities to enhance, enrich, and cleanse stored data sets. Due to the variety of use-cases, these functionalities will be highly configurable and expandable.

As an initial proof of concept, these functions will be implemented first:

  • Scoring: Automatically assign a numerical score to objects based on configured criteria
  • Tagging: Automatically assign one or several tags to objects based on configured criteria
  • Deduplication: Merge and eliminate duplicate and/or similar entries
  • Formatting: Change the format of certain fields or entire objects
  • Filtering: Delete objects based on configured criteria.

Acceptance Criteria:

  • Data Hub offers endpoint for executing these functions
  • Data Hub offers framework for these and future functions
  • Scoring implemented
  • Tagging implemented
  • Deduplication implemented
  • Formatting implemented
  • Filtering implemented

Metadata

Metadata

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions