Skip to content

Fix BF16_Optimizer last-microbatch grad leak under ZeRO-1 - #7985

Merged
delock merged 3 commits into
deepspeedai:masterfrom
maxyu1115:fix/bf16-optimizer-grad-accum-boundary-leak
Apr 29, 2026
Merged

Fix BF16_Optimizer last-microbatch grad leak under ZeRO-1#7985
delock merged 3 commits into
deepspeedai:masterfrom
maxyu1115:fix/bf16-optimizer-grad-accum-boundary-leak

fix #7985 for non-BF16 optimizer

d5e54e8
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Apr 29, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO