Skip to content

pipeline.rst

Latest commit

 

History

History
26 lines (20 loc) · 530 Bytes

pipeline.rst

File metadata and controls

26 lines (20 loc) · 530 Bytes

Pipeline Parallelism

Model Specification

.. autoclass:: deepspeed.pipe.PipelineModule
    :members:


.. autoclass:: deepspeed.pipe.LayerSpec
    :members:


.. autoclass:: deepspeed.pipe.TiedLayerSpec
    :members:


.. autoclass:: deepspeed.runtime.pipe.ProcessTopology
    :members:

Training

.. automodule:: deepspeed.runtime.pipe.engine
    :members:

Extending Pipeline Parallelism

.. automodule:: deepspeed.runtime.pipe.schedule
    :members: