DeepSpeed offers high-performance implementations of Adam optimizer on CPU; FusedAdam, FusedLamb, OnebitAdam, OnebitLamb optimizers on GPU.

.. autoclass:: deepspeed.ops.adam.DeepSpeedCPUAdam

.. autoclass:: deepspeed.ops.adam.FusedAdam

.. autoclass:: deepspeed.ops.lamb.FusedLamb

.. autoclass:: deepspeed.runtime.fp16.onebit.adam.OnebitAdam

.. autoclass:: deepspeed.runtime.fp16.onebit.zoadam.ZeroOneAdam

.. autoclass:: deepspeed.runtime.fp16.onebit.lamb.OnebitLamb