Skip to content

Feast Ingestion not exporting success metrics to statsd #747

@pmjacinto

Description

@pmjacinto

Expected Behavior

The dataflow step WriteSuccessMetrics should be executed and produce metrics.

Current Behavior

In the previous step, the "dummy" PTransform always seems to output zero rows.
https://github.com/feast-dev/feast/blob/v0.5.0/storage/connectors/bigquery/src/main/java/feast/storage/connectors/bigquery/writer/BigQueryWrite.java#L93-L105

This leads to the metrics transform never getting any inputs.

Is this an expected behaviour?

Screenshot 2020-05-27 at 16 32 13

---

Screenshot 2020-05-27 at 16 32 34

Steps to reproduce

  • Create an ingestion pipeline
  • Ingest a row
  • Check dataflow metrics

Specifications

  • Version: 0.5.0
  • Platform: GKE, Dataflow
  • Subsystem: Feast Ingestion

Possible Solution

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions