Is your feature request related to a problem? Please describe.
Data Ingestion, feature query and some other components relies on GCP services like BidQuery, DataFlow. In order to make feast work on AWS. We'd like to add support for AWS using services like Athena, Glue or EMR.
Currently, AWS doesn't have managed Apache Beam jobs support, but there's lots of alternatives like Beam with Spark or Flink runner.
Describe the solution you'd like
- We need to make interface generic enough to support different cloud providers.
- Add AWS services support in feast.
Describe alternatives you've considered
Additional context
We'd like to know if feast internally already have some discussion on this. I am from AWS and would love to take design and implementation work.
Is your feature request related to a problem? Please describe.
Data Ingestion, feature query and some other components relies on GCP services like BidQuery, DataFlow. In order to make feast work on AWS. We'd like to add support for AWS using services like Athena, Glue or EMR.
Currently, AWS doesn't have managed Apache Beam jobs support, but there's lots of alternatives like Beam with Spark or Flink runner.
Describe the solution you'd like
Describe alternatives you've considered
Additional context
We'd like to know if feast internally already have some discussion on this. I am from AWS and would love to take design and implementation work.