Skip to content

feat: Implement Databricks Unity Catalog offline store integration#6515

Open
falloficaruss wants to merge 1 commit into
feast-dev:masterfrom
falloficaruss:feat/databricks-uc-provider
Open

feat: Implement Databricks Unity Catalog offline store integration#6515
falloficaruss wants to merge 1 commit into
feast-dev:masterfrom
falloficaruss:feat/databricks-uc-provider

Conversation

@falloficaruss

Copy link
Copy Markdown

What this PR does / why we need it:

  • Implemented DatabricksUCOfflineStoreConfig (inheriting from SparkOfflineStoreConfig) to specify workspace, token, cluster_id, default_catalog, and default_schema.
  • Implemented get_databricks_session helper that securely handles active sessions or connects remotely using Databricks Connect V2 configurations.
  • Implemented DatabricksUCOfflineStore which inherits from SparkOfflineStore, overriding operations to guarantee Databricks session initialization before executing queries.
  • Registered "databricks_uc" in the first-class OFFLINE_STORE_CLASS_FOR_TYPE mapping.

Which issue(s) this PR fixes:

Partially Fixes - #6499

Checks

  • I've made sure the tests are passing.
  • My commits are signed off (git commit -s)
  • My PR title follows conventional commits format

Testing Strategy

  • Unit tests
  • Integration tests
  • Manual tests
  • Testing is not required for this change

Signed-off-by: Abhishek Shinde <norizzabhii@gmail.com>
@falloficaruss falloficaruss requested a review from a team as a code owner June 14, 2026 10:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant