Skip to content

[shardformer] bloom support flash attention#4188

Merged
FrankLeeeee merged 13 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-bloom
Jul 7, 2023
Merged

[shardformer] bloom support flash attention#4188
FrankLeeeee merged 13 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-bloom

Commits

Commits on Jul 4, 2023

Commits on Jul 5, 2023

Commits on Jul 6, 2023

Commits on Jul 7, 2023