Skip to content

docs: Blog on Operational Metrics for offline store retrieval and SOX Compliance metrics#6485

Merged
ntkathole merged 1 commit into
feast-dev:masterfrom
jyejare:offline_metrics_complaince
Jun 10, 2026
Merged

docs: Blog on Operational Metrics for offline store retrieval and SOX Compliance metrics#6485
ntkathole merged 1 commit into
feast-dev:masterfrom
jyejare:offline_metrics_complaince

Conversation

@jyejare

@jyejare jyejare commented Jun 9, 2026

Copy link
Copy Markdown
Collaborator

What this PR does / why we need it:

Adds a blog post extending Feast Feature Server Monitoring to cover two new observability capabilities introduced in PR #6340:

  1. Offline Store RED Metrics — Prometheus counters and histograms (feast_offline_store_request_total, feast_offline_store_request_latency_seconds, feast_offline_store_row_count) for offline store retrieval operations, closing the observability gap between online serving and offline training paths.

  2. SOX Audit Logging — Structured JSON audit log entries emitted via a dedicated feast.audit Python logger for both online and offline feature access, designed for compliance with SOX, GDPR, HIPAA, and similar regulatory frameworks.

The blog covers:

  • Why offline store metrics and audit logging matter in production ML systems
  • The three new Prometheus metrics and their label structure
  • SOX audit log entry format for online and offline paths (with PII-minimization by design)
  • YAML configuration to enable offline_features and audit_logging
  • PromQL queries, Prometheus alert rules, and extended Grafana dashboard panels
  • How to route audit logs to compliance sinks (Splunk, ELK, S3 WORM)
  • Step-by-step demo using the feast-prometheus-metrics setup

Which issue(s) this PR fixes:

Documentation for PR #6340 (Offline store metrics and SOX audit logging)

Checks

  • I've made sure the tests are passing.
  • My commits are signed off (git commit -s)
  • My PR title follows conventional commits format

Testing Strategy

  • Testing is not required for this change (documentation only)

@jyejare jyejare requested a review from a team as a code owner June 9, 2026 12:42
@jyejare jyejare changed the title docs: Blog on Operational Metrics for offline store retrieval and SOX Complai… docs: Blog on Operational Metrics for offline store retrieval and SOX Complaince metrics Jun 9, 2026
@ntkathole ntkathole changed the title docs: Blog on Operational Metrics for offline store retrieval and SOX Complaince metrics docs: Blog on Operational Metrics for offline store retrieval and SOX Compliance metrics Jun 9, 2026
Comment thread infra/website/docs/blog/feast-offline-store-sox-metrics.md Outdated
Comment thread infra/website/docs/blog/feast-offline-store-sox-metrics.md Outdated

# Extending Feast Observability: Offline Store Metrics and SOX Audit Logging

In [our previous post](https://feast.dev/blog/feast-feature-server-monitoring/), we introduced built-in Prometheus metrics for the Feast feature server — covering the full online serving lifecycle from HTTP request handling through online store reads, on-demand feature transformations, materialization pipelines, and feature freshness tracking.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
In [our previous post](https://feast.dev/blog/feast-feature-server-monitoring/), we introduced built-in Prometheus metrics for the Feast feature server — covering the full online serving lifecycle from HTTP request handling through online store reads, on-demand feature transformations, materialization pipelines, and feature freshness tracking.
In [our previous post](/blog/feast-feature-server-monitoring), we introduced built-in Prometheus metrics for the Feast feature server — covering the full online serving lifecycle from HTTP request handling through online store reads, on-demand feature transformations, materialization pipelines, and feature freshness tracking.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually I wanted this to be rediractiable, so that reader can see online store metrics config, usage that is done in previous blog.

@ntkathole

Copy link
Copy Markdown
Member

infra/website/public/images/blog/offline_store_operational_metrics.png image format needs to fix

@jyejare jyejare force-pushed the offline_metrics_complaince branch from 8d97b60 to 6a97a54 Compare June 10, 2026 08:52
@jyejare

jyejare commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator Author

@ntkathole Resolved comments, please revisit.

…nce metrics

Signed-off-by: Jitendra Yejare <11752425+jyejare@users.noreply.github.com>
@jyejare jyejare force-pushed the offline_metrics_complaince branch from 6a97a54 to 5c0b275 Compare June 10, 2026 08:56
@ntkathole ntkathole merged commit 7d1ef73 into feast-dev:master Jun 10, 2026
31 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants