Commits

Commit history

1. Commits on Jan 8, 2024

   • Update README.md (#586)

     StellaAthena

     authored
     3340c2fView commit details

     Copy full SHA for 3340c2f

     Browse repository at this point
2. Commits on Oct 30, 2023

   • fix model state_dict retrieving in zero3 (#576)

     Show description for c26d450
     

     Jingru

     and

     聂靖入

     authored
     c26d450View commit details

     Copy full SHA for c26d450

     Browse repository at this point
3. Commits on Oct 26, 2023

   • fix(modeling_base): partial loading of a sharded checkpoint (#578)

     maxreciprocate

     authored
     91a0f43View commit details

     Copy full SHA for 91a0f43

     Browse repository at this point

   • support customized run_name in tracker (#573)

     Show description for 0575ce5
     

     Jingru

     and

     聂靖入

     authored
     0575ce5View commit details

     Copy full SHA for 0575ce5

     Browse repository at this point
4. Commits on Oct 23, 2023

   • support extra model and tokenizer configs during loading by from_pretrained in accelerate trainer (#568)

     Show description for bcbcdac
     

     3 peopleauthored
     bcbcdacView commit details

     Copy full SHA for bcbcdac

     Browse repository at this point

   • docs: update documentation (#557)

     Show description for 69b02b0
     maxreciprocate

     authored
     69b02b0View commit details

     Copy full SHA for 69b02b0

     Browse repository at this point
5. Commits on Oct 20, 2023

   • fix(examples/t5_summarize_cnn): move labels into `reward_fn` kwargs (#570)

     Show description for db466cb
     maxreciprocate

     authored
     db466cbView commit details

     Copy full SHA for db466cb

     Browse repository at this point
6. Commits on Oct 17, 2023

   • fix(modeling_base): re-order `model.forward_kwargs` initialization (#566)

     Show description for d03fea7
     maxreciprocate

     authored
     d03fea7View commit details

     Copy full SHA for d03fea7

     Browse repository at this point
7. Commits on Oct 11, 2023

   • feat: add rejection finetuning trainer (#554)

     Show description for bcd237f
     maxreciprocate

     authored
     bcd237fView commit details

     Copy full SHA for bcd237f

     Browse repository at this point
8. Commits on Sep 25, 2023

   • add default llama2 config converter (#563)

     Show description for 78c7faa
     

     PhungVanDuy

     and

     Duy Phung

     authored
     78c7faaView commit details

     Copy full SHA for 78c7faa

     Browse repository at this point
9. Commits on Sep 22, 2023

   • Llama NeMo support (#542)

     Show description for ffa5ba1
     

     4 peopleauthored
     ffa5ba1View commit details

     Copy full SHA for ffa5ba1

     Browse repository at this point
10. Commits on Sep 1, 2023

    • Update README.md (#550)

      Dahoas

      authored
      3685a75View commit details

      Copy full SHA for 3685a75

      Browse repository at this point

    • fix(examples/hh): old gpt-j checkpoint loading (#552)

      maxreciprocate

      authored
      bf0fe38View commit details

      Copy full SHA for bf0fe38

      Browse repository at this point
11. Commits on Aug 31, 2023

    • chore(requirements.txt): update everything to the latest (#547)

      Show description for a7eb066
      maxreciprocate

      authored
      a7eb066View commit details

      Copy full SHA for a7eb066

      Browse repository at this point
12. Commits on Aug 29, 2023

    • Add DS-Chat comparison (#538)

      Show description for dad174c
      

      cat-state

      and

      cat-state

      authored
      dad174cView commit details

      Copy full SHA for dad174c

      Browse repository at this point
13. Commits on Aug 28, 2023

    • revert(ppo_trainer): keep `save_pretrained` only over the base model (#551)

      Show description for 3e45789
      maxreciprocate

      authored
      3e45789View commit details

      Copy full SHA for 3e45789

      Browse repository at this point
14. Commits on Aug 21, 2023

    • mpt support (#546)

      Show description for 900040a
      

      50m-regent

      and

      50mRegent

      authored
      900040aView commit details

      Copy full SHA for 900040a

      Browse repository at this point
15. Commits on Aug 8, 2023

    • fix(modeling): deepspeed checkpoint loading (#482)

      Show description for 2e667e6
      

      maxreciprocate

      and

      jon-tow

      authored
      2e667e6View commit details

      Copy full SHA for 2e667e6

      Browse repository at this point
16. Commits on Aug 2, 2023

    • Value branch (#530)

      Show description for 67bc8ba
      Dahoas

      authored
      67bc8baView commit details

      Copy full SHA for 67bc8ba

      Browse repository at this point

    • Freeze "output" embedding when using tied embeddings. (#543)

      Show description for 5735bf3
      

      cat-state

      and

      cat-state

      authored
      5735bf3View commit details

      Copy full SHA for 5735bf3

      Browse repository at this point
17. Commits on Jul 31, 2023

    • fix reward model state dict loading (#541)

      maxjeblick

      authored
      1d69f90View commit details

      Copy full SHA for 1d69f90

      Browse repository at this point

    • Fix LLaMA example (LLaMA 2) (#539)

      Show description for acd0a41
      

      4 peopleauthored
      acd0a41View commit details

      Copy full SHA for acd0a41

      Browse repository at this point

    • Fix ordering of ppo epoch iteration (#522)

      Show description for 6f7f59d
      

      RobertKirk

      and

      maxreciprocate

      authored
      6f7f59dView commit details

      Copy full SHA for 6f7f59d

      Browse repository at this point
18. Commits on Jul 24, 2023

    • fix(modeling_ppo): load reference head under zero3 (#489)

      Show description for e36fe9d
      maxreciprocate

      authored
      e36fe9dView commit details

      Copy full SHA for e36fe9d

      Browse repository at this point

    • Fix logging (#526)

      Show description for dbdefd8
      

      Dahoas

      and

      maxreciprocate

      authored
      dbdefd8View commit details

      Copy full SHA for dbdefd8

      Browse repository at this point
19. Commits on Jul 21, 2023

    • Update README.md (#537)

      Dahoas

      authored
      5d0f04dView commit details

      Copy full SHA for 5d0f04d

      Browse repository at this point
20. Commits on Jul 20, 2023

    • Fix: rename model_tok to tokenizer is reward_fn arg (#534)

      Dahoas

      authored
      288d4cbView commit details

      Copy full SHA for 288d4cb

      Browse repository at this point
21. Commits on Jul 19, 2023

    • Dense reward carper (Fine grained feedback) (#514)

      Show description for 0c94ee8
      

      3 peopleauthored
      0c94ee8View commit details

      Copy full SHA for 0c94ee8

      Browse repository at this point
22. Commits on Jul 17, 2023

    • fix(ci): don't rely on cache in `actions/setup-python` (#524)

      maxreciprocate

      authored
      ba947e5View commit details

      Copy full SHA for ba947e5

      Browse repository at this point
23. Commits on Jul 13, 2023

    • feat(readme): add instructions to avoid OOMs with hyperparameters (#470)

      Show description for 5c5abca
      maxreciprocate

      authored
      5c5abcaView commit details

      Copy full SHA for 5c5abca

      Browse repository at this point
24. Commits on Jul 10, 2023

    • Update README.md

      LouisCastricato

      authored
      1446523View commit details

      Copy full SHA for 1446523

      Browse repository at this point
25. Commits on Jul 5, 2023

    • fix peft config cause tensorboard type error (#515)

      congchan

      authored
      b9c16f5View commit details

      Copy full SHA for b9c16f5

      Browse repository at this point

    • fix(modeling_base): handle parent directory for peft head save (#516)

      congchan

      authored
      cf865faView commit details

      Copy full SHA for cf865fa

      Browse repository at this point
26. Commits on Jun 26, 2023

    • feat(modeling_ppo): add GPTBigCodeModelBranch (#507)

      Show description for 9c83cee
      

      congchan

      and

      maxreciprocate

      authored
      9c83ceeView commit details

      Copy full SHA for 9c83cee

      Browse repository at this point
27. Commits on Jun 23, 2023

    • Release: v0.7.0 (#511)

      jon-tow

      authored
      475a284View commit details

      Copy full SHA for 475a284

      Browse repository at this point