Skip to content

[shardformer] update shardformer to use flash attention 2#4392

Merged
ver217 merged 2 commits into
hpcaitech:feature/pipelinefrom
flybird11111:flash-attention-2
Aug 9, 2023
Merged

[shardformer] update shardformer to use flash attention 2#4392
ver217 merged 2 commits into
hpcaitech:feature/pipelinefrom
flybird11111:flash-attention-2

[shardformer] update shardformer to use flash attention 2

b7df1f6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs