Skip to content

[shardformer] support sharded optimizer checkpointIO of HybridParallelPlugin#4540

Merged
Fridge003 merged 15 commits into
hpcaitech:feature/shardformerfrom
Fridge003:feature/shardformer
Aug 31, 2023
Merged

[shardformer] support sharded optimizer checkpointIO of HybridParallelPlugin#4540
Fridge003 merged 15 commits into
hpcaitech:feature/shardformerfrom
Fridge003:feature/shardformer

fix master/working mapping in fp16 amp

ae93561
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs