Skip to content

[shardformer] bert support flash attention.#4206

Merged
FrankLeeeee merged 9 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-bert
Jul 11, 2023
Merged

[shardformer] bert support flash attention.#4206
FrankLeeeee merged 9 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-bert

[shardformer] bert support flash attention

ecced2a
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs