Model Checkpointing DeepSpeed provides routines for checkpointing model state during training. Loading Training Checkpoints .. autofunction:: deepspeed.DeepSpeedEngine.load_checkpoint Saving Training Checkpoints .. autofunction:: deepspeed.DeepSpeedEngine.save_checkpoint