Skip to content

Feast Ingestion not exporting success metrics to statsd #747

@pmjacinto

Description

@pmjacinto

Expected Behavior

The dataflow step WriteSuccessMetrics should be executed and produce metrics.

Current Behavior

In the previous step, the "dummy" PTransform always seems to output zero rows.
https://github.com/feast-dev/feast/blob/v0.5.0/storage/connectors/bigquery/src/main/java/feast/storage/connectors/bigquery/writer/BigQueryWrite.java#L93-L105

This leads to the metrics transform never getting any inputs.

Is this an expected behaviour?

Screenshot 2020-05-27 at 16 32 13

---

Screenshot 2020-05-27 at 16 32 34

Steps to reproduce

  • Create an ingestion pipeline
  • Ingest a row
  • Check dataflow metrics

Specifications

  • Version: 0.5.0
  • Platform: GKE, Dataflow
  • Subsystem: Feast Ingestion

Possible Solution

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions