Skip to content

Lateness for nested fields #7575

Open
Open

Description

@anandbraman

Currently, lateness can only be defined for top level columns. In some use cases, users have a timestamp column in a nested field, for example a struct in a delta table. This feature would allow users to define lateness for a nested field.

Activity

  1. mihaibudiu commented on Oct 21, 2026

    @mihaibudiu
    Contributor

    We have lateness in tables and views. These are slightly different.

  2. mihaibudiu commented on Oct 21, 2026

    @mihaibudiu
    Contributor

    For a view this can be done by creating another local view which extracts the field to a column and applying lateness to that.
    For a table this trick won't work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    DBSP coreRelated to the core DBSP library

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions