Skip to content

[shardformer] support 'paddedcausal' type of attention mask in Coloattention. - #4215

Merged
kurisusnowdeng merged 13 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:coloattention
Jul 14, 2023
Merged

[shardformer] support 'paddedcausal' type of attention mask in Coloattention.#4215
kurisusnowdeng merged 13 commits into
hpcaitech:feature/flash-attention-shardformerfrom
flybird11111:coloattention

Commits

Commits on Jul 4, 2023

Commits on Jul 5, 2023

Commits on Jul 6, 2023

Commits on Jul 11, 2023

Commits on Jul 12, 2023

Commits on Jul 13, 2023