Skip to content

Materialization into Datastore leads to contention error #1575

@woop

Description

@woop

This issue was reported directly to us by a user. Documenting the failure here for posterity:

Materializing 1 feature views from 2021-04-29 21:19:00-07:00 to 2021-04-29 21:19:05-07:00 into the datastore online store.
my_fv:
  8%|████▋                                                    | 2720/33120 [00:07<01:18, 388.10it/s]

[SNIP]

google.api_core.exceptions.Aborted: 409 too much contention on these datastore entities. please try again. entity groups: 

Example of the data used for ingestion https://pastebin.com/raw/GCJ2CLSb (this is just a sample, the actual ingestion contains many more rows)

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions