Ra#125

Merged

jamesthesnake merged 18 commits into

lfrom

Aug 5, 2023

Commits on Jul 31, 2023

[zero] refactor low level zero for shard evenly (#4030)

Gy-Lu
authored and
ver217
committed
[zero]support no_sync method for zero1 plugin (#4138)

Gy-Lu
authored and
ver217
committed
[zero] allow passing process group to zero12 (#4153)

Gy-Lu
authored and
ver217
committed
[zero] add state dict for low level zero (#4179)

Gy-Lu
authored and
ver217
committed
[zero] support shard optimizer state dict of zero (#4194)

Gy-Lu
authored and
ver217
committed
[zero] optimize the optimizer step time (#4221)

Gy-Lu
authored and
ver217
committed

Commits on Aug 2, 2023

[chat] fix bugs and add unit tests (#4213)
cwher
authored

Commits on Aug 3, 2023

Merge pull request #117 from hpcaitech/main
jamesthesnake
authored

Commits on Aug 5, 2023

Merge pull request #124 from hpcaitech/main
jamesthesnake
authored