[shardformer] merge blip2/chatglm #4321

flybird11111 merged 20 commits into

hpcaitech:feature/flash-attention-shardformerhpcaitech/ColossalAI:feature/flash-attention-shardformerfrom

flybird11111:feature/flash-attention-shardformerflybird11111/ColossalAI:feature/flash-attention-shardformerCopy head branch name to clipboard