[zero] add inference mode and its unit test#2418

feifeibear merged 1 commit into

hpcaitech:mainhpcaitech/ColossalAI:mainfrom

1SAA:my_dev1SAA/ColossalAI:my_devCopy head branch name to clipboard