Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward#7992
Open
roycho96 wants to merge 1 commit intodeepspeedai:masterfrom
Open
Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward#7992roycho96 wants to merge 1 commit intodeepspeedai:masterfrom
roycho96 wants to merge 1 commit intodeepspeedai:masterfrom
