Skip to content

Save/load historic_embeddings to/from disk#121

Merged
opentaco merged 8 commits intostagingfrom
feature/save-historic-diversity
Aug 8, 2023
Merged

Save/load historic_embeddings to/from disk#121
opentaco merged 8 commits intostagingfrom
feature/save-historic-diversity

Conversation

@opentaco
Copy link
Contributor

@opentaco opentaco commented Aug 8, 2023

Save/load historic_embeddings to/from disk

  • Periodically saves historic_embeddings to disk via save_state.
  • 15500 (history range) x 768 (embedding) x 32 bits = 47 MB (projected max size)
  • Loads historic_embeddings from disk via load_state upon validator start.
  • Fixes model load neuron_weights tensorization.

@opentaco opentaco changed the base branch from main to staging August 8, 2023 16:35
@opentaco opentaco merged commit d509f27 into staging Aug 8, 2023
@opentaco opentaco deleted the feature/save-historic-diversity branch August 8, 2023 17:34
@p-ferreira p-ferreira mentioned this pull request Aug 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants