Could you maybe elaborate a bit more where this is useful?

@universome a gentle ping

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@universome Would it be possible to handle the merge conflict? We can merge this after.

Hi @DN6 , sorry for the late reply. Basically, my use-case is the following.
I'm training a video latent diffusion model with the CogVideoX autoencoder with FSDP wrapping.
I instantiate the autoencoder inside the base model class, wrap the base model in FSDP, and now I need to make sure that it does not get FSDP-wrapped (to avoid extra syncs for it since it's quite small in terms of the parameter counts anyway).
One way to do this is to simply convert AE parameters to buffers (which would cause the error above). The other is to add changes to FSDP wrap policy to make sure it's not wrapped. I felt that the conversion to buffers is simpler since in this case I also do not need to bother about setting requires_grad to False for them.