Skip to content

[shardformer] llama support flash attention#4185

Merged
FrankLeeeee merged 10 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-llama
Jul 6, 2023
Merged

[shardformer] llama support flash attention#4185
FrankLeeeee merged 10 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-llama

[shardformer] Move the import statement for xformer outside the forwa…

e455479
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs