Skip to content

Change serving and ingestion to use storage API#553

Merged
feast-ci-bot merged 2 commits intofeast-dev:storage-refactorfrom
zhilingc:storage-refactor-impl
Mar 25, 2020
Merged

Change serving and ingestion to use storage API#553
feast-ci-bot merged 2 commits intofeast-dev:storage-refactorfrom
zhilingc:storage-refactor-impl

Conversation

@zhilingc
Copy link
Copy Markdown
Collaborator

@zhilingc zhilingc commented Mar 20, 2020

What this PR does / why we need it:
Swaps out specific storage implementations in the serving service and ingestion code for the interfaces defined in the serving service.

Additionally addresses Issue #489: the WriteResult is used to write metrics only after successful writes.

@feast-ci-bot
Copy link
Copy Markdown
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: zhilingc

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@zhilingc zhilingc changed the title Change serving to use storage API Change serving and ingestion to use storage API Mar 23, 2020
@zhilingc zhilingc force-pushed the storage-refactor-impl branch from 464c046 to 7a9c900 Compare March 23, 2020 05:41
@zhilingc zhilingc force-pushed the storage-refactor-impl branch from 7a9c900 to 056c06d Compare March 23, 2020 05:56
@zhilingc
Copy link
Copy Markdown
Collaborator Author

/retest

@woop
Copy link
Copy Markdown
Member

woop commented Mar 25, 2020

/lgtm

@feast-ci-bot feast-ci-bot merged commit 5328a1b into feast-dev:storage-refactor Mar 25, 2020
zhilingc pushed a commit that referenced this pull request Mar 29, 2020
* Change serving and ingestion to use storage API

* Remove extra exclusion clause
zhilingc pushed a commit that referenced this pull request Apr 3, 2020
* Change serving and ingestion to use storage API

* Remove extra exclusion clause
zhilingc pushed a commit that referenced this pull request Apr 7, 2020
* Change serving and ingestion to use storage API

* Remove extra exclusion clause
feast-ci-bot pushed a commit that referenced this pull request Apr 7, 2020
…567)

* Add storage interfaces, basic file structure (#529)

* Add storage interfaces, basic file structure

* Apply spotless, add comments

* Move parseResponse and isEmpty to response object

* Make changes to write interface to be more beam-like

* Pass feature specs to the retriever

* Pass feature specs to online retriever

* Add FeatureSetRequest

* Add mistakenly removed TestUtil

* Add mistakenly removed TestUtil

* Add BigQuery storage (#546)

* Add Redis storage implementation (#547)

* Add Redis storage

* Remove staleness check; can be checked at the service level

* Remove staleness related tests

* Add dependencies to top level pom

* Clean up code

* Change serving and ingestion to use storage API (#553)

* Change serving and ingestion to use storage API

* Remove extra exclusion clause

* Storage refactor API and docstring tweaks (#569)

* API and docstring tweaks

* Fix javadoc linting errors

* Apply spotless

* Fix javadoc formatting

* Drop result from HistoricalRetrievalResult constructors

* Change pipeline to use DeadletterSink API (#586)

* Add better code docs to storage refactor (#601)

* Add better code documentation, make GetFeastServingInfo independent of retriever

* Make getStagingLocation method of historical retriever

* Apply spotless

* Clean up dependencies, remove exclusions at serving (#607)

* Clean up OnlineServingService code (#605)

* Clean up OnlineServingService code to be more readable

* Revert Metrics

* Rename storage API packages to nouns
@ches ches added this to the v0.5.0 milestone Apr 26, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants