-
Notifications
You must be signed in to change notification settings - Fork 3.3k
Open
Labels
bugBug reportBug report
Description
OpenLineage JobEvents are not processed.
To Reproduce
Steps to reproduce the behavior:
- Run this statement in a terminal:
curl --request POST \
--url http:///gmsserver.foo.org/openapi/openlineage/api/v1/lineage \
--header 'authorization: Bearer ***' \
--header 'content-type: application/json' \
--data '{
"eventType": "OTHER",
"eventTime": "2025-11-03T19:52:00.001+10:00",
"job": {
"namespace": "Customer Relationship Management",
"name": "load_dp_customer"
},
"inputs": [
{
"namespace": "customer_unload",
"name": "customer",
"facets": {
"schema": {
"_producer": "https://some.producer.com/version/1.0",
"_schemaURL": "https://openlineage.io/spec/facets/1-1-1/SchemaDatasetFacet.json",
"fields": [
{
"name": "customer_id",
"type": "string",
"description": "Identifier of a customer."
},
{
"name": "first_name",
"type": "string",
"description": "First name of the customer."
},
{
"name": "surname",
"type": "string",
"description": "Surname of the customer."
}
]
}
}
}
],
"outputs": [
{
"namespace": "dataproducts",
"name": "dp_customer",
"facets": {
"schema": {
"_producer": "https://some.producer.com/version/1.0",
"_schemaURL": "https://openlineage.io/spec/facets/1-1-1/SchemaDatasetFacet.json",
"fields": [
{
"name": "str_customer_id",
"type": "string",
"description": "Zu einem Zeitpunkt eindeutige Nummer der Person."
},
{
"name": "str_name",
"type": "string",
"description": "Firstname and surname of the customer."
},
{
"name": "load_tms",
"type": "timestamp",
"description": "Timestamp of the last update."
}
]
}
}
}
],
"producer": "https://github.com/OpenLineage/OpenLineage/blob/v1-0-0/client"
}'
- Open the log of the datahub_action container.
- See error
2025-11-04 18:44:48,321 [qtp1207334820-269] ERROR i.d.o.o.controller.LineageApiImpl:64 - java.lang.NullPointerException: Cannot invoke "io.openlineage.client.OpenLineage$Run.getFacets()" because the return value of "io.openlineage.client.OpenLineage$RunEvent.getRun()" is null
Expected behavior
The request is a valid OpenLineage JobEvent and should result in a pipeline and a task with an input dataset and an output dataset.
- OS: macOS, Datahub in Podman with Minikube
- Browser: None
- Version 1.30 (Datahub)
coderabbitai
Metadata
Metadata
Assignees
Labels
bugBug reportBug report