Expected Behavior

The app which is using 'write_to_online_store' consumes memory in a stable way.

Current Behavior

The memory consumed by the app which is using 'write_to_online_store' keeps growing. (See further comments that point to usage.py being the cause)

Steps to reproduce

The App is based on FastApi, which receives data with a throughput 2-3 req/s. The App creates dataframe from the data posted by client, which has around 10 features, and then writes these features to the online store with the function 'write_to_online_store'.

We can observe the memory consumption of the App keeps growing, and its writing time also keeps growing.

The online store is based on Postgresql.

We also saves raw data to Postgresql with psycopg2, which acts as the offline store, its memory consumption and writing time is quite stable. (we have tried to only use psycopg2 to write to Postgresql, and no 'write_to_online_store', to check App's memory consumption situation)

Specifications

• Version:
  Feast 0.22.2
  Python 3.7

• Platform:
  kubernetes

• Subsystem:

Possible Solution