Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Sep 30, 2025

• Merge pull request #39 from ContextualAI/research

  Show description for 4831988
  kawine

  authored
  4831988

  Copy full SHA for 4831988

Commits on Jul 13, 2025

• remove humanline iters

  kawine

  committed
  714a6e9

  Copy full SHA for 714a6e9

Commits on Jun 27, 2025

• update scripts

  kawine

  committed
  09f4830

  Copy full SHA for 09f4830

Commits on Jun 8, 2025

• minor fix: update which ckpt is loaded when resumed

  kawine

  committed
  078cbcf

  Copy full SHA for 078cbcf

• finalize grpo scripts

  kawine

  committed
  53a4d98

  Copy full SHA for 53a4d98

Commits on Jun 5, 2025

• finalize kto scripts

  kawine

  committed
  aff9276

  Copy full SHA for aff9276

Commits on Jun 1, 2025

• finalize dpo scripts

  kawine

  committed
  a7236be

  Copy full SHA for a7236be

Commits on May 29, 2025

• improve logging for humanline

  kawine

  committed
  85a3187

  Copy full SHA for 85a3187

Commits on May 28, 2025

• add scores to ultrafeedback armorm

  kawine

  committed
  c58b0e3

  Copy full SHA for c58b0e3

Commits on May 24, 2025

• Merge pull request #38 from sijial430/research-new

  Show description for 01060de
  kawine

  authored
  01060de

  Copy full SHA for 01060de

• fixed conflicts

  sijial430

  authored
  a230e40

  Copy full SHA for a230e40

• added max-gap and threshold-gap variants for creating pairwise feedback

  sijial430

  committed
  6feb479

  Copy full SHA for 6feb479

Commits on May 23, 2025

• update scripts

  kawine

  committed
  503268a

  Copy full SHA for 503268a

• support clamp-based humanline

  kawine

  committed
  2f136e0

  Copy full SHA for 2f136e0

Commits on May 22, 2025

• remove humanline SFT trainer

  kawine

  committed
  0feb8d8

  Copy full SHA for 0feb8d8

• fix issues with GRPO

  kawine

  committed
  ae56561

  Copy full SHA for ae56561

• add gemma version of ultrafeedback armorm

  kawine

  committed
  cc71237

  Copy full SHA for cc71237

Commits on May 19, 2025

• add new online pair method

  kawine

  committed
  14f0186

  Copy full SHA for 14f0186

• update transformers version

  kawine

  committed
  2a72277

  Copy full SHA for 2a72277

Commits on May 15, 2025

• fix merge

  kawine

  committed
  233d5c0

  Copy full SHA for 233d5c0

• update kto/grpo scripts to only train on 10k examples

  kawine

  committed
  0c709eb

  Copy full SHA for 0c709eb

• change sample batch size for online dpo

  kawine

  committed
  16a707b

  Copy full SHA for 16a707b

Commits on May 14, 2025

• support labelling with Armo RM

  kawine

  committed
  a065013

  Copy full SHA for a065013

• finalize offline, online, humanline dpo scripts

  kawine

  committed
  14ae664

  Copy full SHA for 14ae664

Commits on May 13, 2025

• change grpo defaults

  kawine

  committed
  e9fef37

  Copy full SHA for e9fef37

• Merge pull request #37 from Muennighoff/patch-1

  Show description for 1e3817a
  kawine

  authored
  1e3817a

  Copy full SHA for 1e3817a

• fix issue with sum vs. mean for grad acc

  kawine

  committed
  e8c4e34

  Copy full SHA for e8c4e34

• reintroduce threshold for pairs

  kawine

  committed
  5718703

  Copy full SHA for 5718703

Commits on May 12, 2025

• average instead of sum losses

  Muennighoff

  authored
  cd3a380

  Copy full SHA for cd3a380

• change system prompt and creation of preference pairs

  kawine

  committed
  0e44349

  Copy full SHA for 0e44349

Commits on May 10, 2025

• fix bugs in PPOTrainer

  kawine

  committed
  e7e5b05

  Copy full SHA for e7e5b05

Commits on May 5, 2025

• add scripts

  kawine

  committed
  5d8621e

  Copy full SHA for 5d8621e

• change length defaults

  kawine

  committed
  70606da

  Copy full SHA for 70606da

• fix issue with humanline hanging

  kawine

  committed
  ab75d18

  Copy full SHA for ab75d18

Commits on May 4, 2025

• modify grpo dataloader to support different-sized groups

  kawine

  committed
  f74ee12

  Copy full SHA for f74ee12

Pagination

Previous

Next