Skip to content

A short description of the bug #15196

@juergenhemelt

Description

@juergenhemelt

OpenLineage JobEvents are not processed.

To Reproduce
Steps to reproduce the behavior:

  1. Run this statement in a terminal:
curl --request POST \
  --url http:///gmsserver.foo.org/openapi/openlineage/api/v1/lineage \
  --header 'authorization: Bearer ***' \
  --header 'content-type: application/json' \
  --data '{
  "eventType": "OTHER",
  "eventTime": "2025-11-03T19:52:00.001+10:00",
  "job": {
    "namespace": "Customer Relationship Management",
    "name": "load_dp_customer"
  },
  "inputs": [
    {
      "namespace": "customer_unload",
      "name": "customer",
      "facets": {
        "schema": {
          "_producer": "https://some.producer.com/version/1.0",
          "_schemaURL": "https://openlineage.io/spec/facets/1-1-1/SchemaDatasetFacet.json",
          "fields": [
            {
              "name": "customer_id",
              "type": "string",
              "description": "Identifier of a customer."
            },
            {
              "name": "first_name",
              "type": "string",
              "description": "First name of the customer."
            },
            {
              "name": "surname",
              "type": "string",
              "description": "Surname of the customer."
            }
          ]
        }
      }
    }
  ],
  "outputs": [
    {
      "namespace": "dataproducts",
      "name": "dp_customer",
      "facets": {
        "schema": {
          "_producer": "https://some.producer.com/version/1.0",
          "_schemaURL": "https://openlineage.io/spec/facets/1-1-1/SchemaDatasetFacet.json",
          "fields": [
            {
              "name": "str_customer_id",
              "type": "string",
              "description": "Zu einem Zeitpunkt eindeutige Nummer der Person."
            },
            {
              "name": "str_name",
              "type": "string",
              "description": "Firstname and surname of the customer."
            },
            {
              "name": "load_tms",
              "type": "timestamp",
              "description": "Timestamp of the last update."
            }
          ]
        }
      }
    }
  ],
  "producer": "https://github.com/OpenLineage/OpenLineage/blob/v1-0-0/client"
}'
  1. Open the log of the datahub_action container.
  2. See error
2025-11-04 18:44:48,321 [qtp1207334820-269] ERROR i.d.o.o.controller.LineageApiImpl:64 - java.lang.NullPointerException: Cannot invoke "io.openlineage.client.OpenLineage$Run.getFacets()" because the return value of "io.openlineage.client.OpenLineage$RunEvent.getRun()" is null

Expected behavior
The request is a valid OpenLineage JobEvent and should result in a pipeline and a task with an input dataset and an output dataset.

  • OS: macOS, Datahub in Podman with Minikube
  • Browser: None
  • Version 1.30 (Datahub)

Metadata

Metadata

Assignees

Labels

bugBug report

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions