[shardformer]support gradients accumulation fusion#5199

flybird11111 merged 1 commit into

hpcaitech:mainhpcaitech/ColossalAI:mainfrom

flybird11111:grad_accflybird11111/ColossalAI:grad_accCopy head branch name to clipboard