Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 31, 2023

• Update DeepSpeed copyright license to Apache 2.0 (#3111)

  Show description for b361c72
  

  mrwyattii

  and

  jeffra

  authored
  b361c72

  Copy full SHA for b361c72

Commits on Mar 27, 2023

• update formatter version and style settings (#3098)

  jeffra

  authored
  91d63e0

  Copy full SHA for 91d63e0

Commits on Jan 26, 2023

• Abstract accelerator (step 3) (#2677)

  Show description for 98cc35b
  

  3 peopleauthored
  98cc35b

  Copy full SHA for 98cc35b

Commits on Dec 17, 2022

• fixes #2498 (#2603)

  Show description for 0f0e38c
  

  3 peopleauthored
  0f0e38c

  Copy full SHA for 0f0e38c

Commits on Nov 29, 2022

• Report progress at gradient accumulation boundary (#2553)

  Show description for 340fc0c
  ShijieZZZZ

  authored
  340fc0c

  Copy full SHA for 340fc0c

Commits on Jul 26, 2022

• Allow turning off loss scaling wrt GAS + update tput calculator (#2140)

  jeffra

  authored
  5bd09a8

  Copy full SHA for 5bd09a8

Commits on Jul 25, 2022

• Add flake8 to pre-commit checks (#2051)

  aphedges

  authored
  316c4a4

  Copy full SHA for 316c4a4

• DeepSpeed Communication Profiling and Logging (#2012)

  Show description for 5349347
  

  3 peopleauthored
  5349347

  Copy full SHA for 5349347

Commits on Jul 13, 2022

• fixed "None type has no len()" (#2091)

  Show description for b052378
  

  xiazeyu

  and

  cli99

  authored
  b052378

  Copy full SHA for b052378

Commits on Jun 20, 2022

• fix import errors (#2026)

  Show description for 735406e
  

  KMFODA

  and

  mrwyattii

  authored
  735406e

  Copy full SHA for 735406e

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

  Copy full SHA for 36ad311

Commits on May 19, 2022

• Fix timer typo (#1964)

  Show description for 0d36893
  

  Quentin-Anthony

  and

  jeffra

  authored
  0d36893

  Copy full SHA for 0d36893

Commits on Apr 20, 2022

• Use cuda events to improve timing for multi-stream execution (#1881)

  Show description for fee7313
  

  tjruwase

  and

  jeffra

  authored
  fee7313

  Copy full SHA for fee7313

Commits on Jan 21, 2022

• Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453)

  Show description for 4912e0a
  

  4 peopleauthored
  4912e0a

  Copy full SHA for 4912e0a

Commits on Nov 13, 2021

• Autotuning (#1554)

  Show description for 9caa74e
  

  4 peopleauthored
  9caa74e

  Copy full SHA for 9caa74e

Commits on May 12, 2021

• Improve flops profiler functionality (#1065)

  Show description for 4544b7d
  cli99

  authored
  4544b7d

  Copy full SHA for 4544b7d

Commits on Feb 12, 2021

• Replace timer print rank 0 with logging (#732)

  Show description for 6fb1610
  

  Sean Naren

  and

  jeffra

  authored
  6fb1610

  Copy full SHA for 6fb1610

Commits on Nov 14, 2020

• Dependency pruning (#528)

  Show description for 0dc8420
  jeffra

  authored
  0dc8420

  Copy full SHA for 0dc8420

Commits on Sep 10, 2020

• Pipeline parallel training engine. (#392)

  Show description for 65c2f97
  

  Shaden Smith

  and

  jeffra

  authored
  65c2f97

  Copy full SHA for 65c2f97

Commits on Sep 2, 2020

• Sparse attn + ops/runtime refactor + v0.3.0 (#343)

  Show description for e5bbc2e
  

  jeffra

  and

  arashashari

  authored
  e5bbc2e

  Copy full SHA for e5bbc2e

Loading