[sync] sync feature/shardformer with develop#3931

Merged

FoolPlayer merged 14 commits into

hpcaitech:mainfrom

FrankLeeeee:sync/develop-to-shardformer

Jun 9, 2023

Commits on May 25, 2023

[dtensor] polish sharding spec docstring (#3838)
ver217
authored

Commits on Jun 7, 2023

Commits on Jun 8, 2023

[dtensor] updated api and doc (#3845)
FrankLeeeee
authored
Merge pull request #3926 from hpcaitech/feature/dtensor
FrankLeeeee
authored
[shardformer] init shardformer code structure (#3731)

FoolPlayer
authored and
FrankLeeeee
committed
[shardformer]: Feature/shardformer, add some docstring and readme (#3816)

FoolPlayer
authored and
FrankLeeeee
committed
[shardformer] updated readme (#3827)
FrankLeeeee
committed
[shardformer] refactored the user api (#3828)
FrankLeeeee
committed
[shardformer] update readme with modules implement doc (#3834)

FoolPlayer
authored and
FrankLeeeee
committed
[shardformer] add Dropout layer support different dropout pattern (#3856)

FoolPlayer
authored and
FrankLeeeee
committed
update README (#3909)

FoolPlayer
authored and
FrankLeeeee
committed
[shardformer] add gpt2 policy and modify shard and slicer to support (#3883)

FoolPlayer
authored and
FrankLeeeee
committed