Skip to content

[shardformer] support GPTJ auto model sharding (except lazy init)#4825

Merged
ppt0011 merged 9 commits into
hpcaitech:feature/shardformerfrom
ppt0011:feature/shardformer
Oct 13, 2023
Merged

[shardformer] support GPTJ auto model sharding (except lazy init)#4825
ppt0011 merged 9 commits into
hpcaitech:feature/shardformerfrom
ppt0011:feature/shardformer

[shardformer] sync gptj config with hf due to flash attn head dim req…

341effc
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs