Skip to content

Distribute Feast with Dask #1953

@qooba

Description

@qooba

Is your feature request related to a problem? Please describe.
I would like to add possibility to distribute Feast feature store with Dask library

Describe the solution you'd like
I will extend Feast with the Dask library. Thanks to this the users will be able to distribute historical feature handling on the clusters (eg. VMs, k8s, yarn, local machine). This will help to handle huge datasets.

Describe alternatives you've considered
Dask is the best solution because we stay in the python stack others like Spark will need additional setup and maintenance.

Additional context
No

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions