Skip to content

Conversation

@rafid-dev
Copy link
Contributor

@rafid-dev rafid-dev commented Mar 29, 2024

There's need to check validation loss to know if the net is generalizing well. So I added validation loss reporting

  • Add --val-data as the launch argument for passing the validation datasets paths
  • Print validation loss after each epoch
  • Write the validation to the loss.csv file
  • Add two helper functions in dataset: dataset::fetch_dataset_paths for retrieving all files found in directory and dataset::count_total_positions for counting total number of positions given a list of files
  • Add --epoch-size as a launch arguments

@Luecx Luecx merged commit 0453f4e into Luecx:main Mar 29, 2024
@jhonnold
Copy link
Collaborator

Not everyone uses validation data, this should've been made optional not required.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants