Skip to content

feat(dbt ingestion): emit Query entities from meta.queries #15150

@przemekd

Description

@przemekd

Teams often document “this is the correct way to query this model” directly in dbt, under model.meta.queries.

We’d like the dbt ingestion source to read meta.queries and create DataHub Query entities for each entry, e.g.:

models:
  - name: dim_customer
    meta:
      queries:
        - name: "Active customers (30d)"
          description: "Standard engagement pull"
          sql: |
            select ...
          tags: ["production"]
          terms: ["CustomerData"]

For each query:

  • set name, description, and sqlqueryProperties.statement
  • map tagsglobalTags, termsglossaryTerms
  • link it to the model’s dataset URN via querySubjects, so it shows up in that dataset’s Queries tab

This would make dbt the single source of truth for “blessed” usage patterns and surface them in DataHub without manual curation.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions