[shardformer] shardformer support jit fused operator.#4236

Merged

flybird11111 merged 22 commits into

hpcaitech:feature/flash-attention-shardformerfrom

flybird11111:jit-operator

Jul 20, 2023

Commits on Jul 5, 2023

Commits on Jul 6, 2023

Commits on Jul 13, 2023

Merge branch 'hpcaitech:feature/flash-attention-shardformer' into feature/flash-attention-shardformer
flybird11111
authored

Commits on Jul 14, 2023

Commits on Jul 19, 2023

[shardformer] add type hint to 'self' param of forward
flybird11111
committed