Skip to content

feat: Store and read feature data as serialized protos for scylladb sorted feature view#253

Merged
piket merged 1 commit intofeature/range-query-improvementsfrom
sortedfv-save-protos-for-nulls
Jun 20, 2025
Merged

feat: Store and read feature data as serialized protos for scylladb sorted feature view#253
piket merged 1 commit intofeature/range-query-improvementsfrom
sortedfv-save-protos-for-nulls

Conversation

@piket
Copy link
Copy Markdown
Collaborator

@piket piket commented Jun 18, 2025

What this PR does / why we need it:

Due to limitations with go primitive types, we can't properly read null values for some features. To retain nulls, we need to use a serialized proto for all non-sort key features. This impacts both writing and reading data.

Which issue(s) this PR fixes:

Null feature values are properly read from scylladb

Created integration tests for full-path OnlineReadRange with ScyllaDB

Created Integration tests for Cassandra Online Store

Misc

refactor integration test data directory structure

add build tag for unit tests for complete separation of integration and unit tests

added go integration tests to PR workflow

@piket piket force-pushed the sortedfv-save-protos-for-nulls branch 2 times, most recently from 2926105 to a6c28b6 Compare June 18, 2025 16:05
…orted feature view

refactor integration test data directory structure

add build tag for unit tests for complete separation of integration and unit tests
@piket piket removed the ok-to-test label Jun 18, 2025
@piket piket force-pushed the sortedfv-save-protos-for-nulls branch from a6c28b6 to 12a7478 Compare June 18, 2025 16:25
@piket piket marked this pull request as ready for review June 18, 2025 16:37
@EXPEbdodla
Copy link
Copy Markdown
Collaborator

LGTM

@piket piket merged commit 40c05f8 into feature/range-query-improvements Jun 20, 2025
26 checks passed
@piket piket deleted the sortedfv-save-protos-for-nulls branch June 20, 2025 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants