Skip to content

[shardformer] update modeling to fit colo attention#5465

Merged
FrankLeeeee merged 14 commits into
hpcaitech:feature/colo-attentionfrom
ver217:feature/colo-attn-modeling
Mar 26, 2024
Merged

[shardformer] update modeling to fit colo attention#5465
FrankLeeeee merged 14 commits into
hpcaitech:feature/colo-attentionfrom
ver217:feature/colo-attn-modeling

Commits

Commits on Mar 15, 2024

Commits on Mar 18, 2024

Commits on Mar 22, 2024

Commits on Mar 25, 2024