Skip to content

[shardformer] opt support flash attention#4163

Merged
FrankLeeeee merged 6 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:feature/flash-attention-shardformer
Jul 6, 2023
Merged

[shardformer] opt support flash attention#4163
FrankLeeeee merged 6 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:feature/flash-attention-shardformer

Commits

Commits on Jul 5, 2023