Overview
Current cuda and cpu placement policy cannot set the fraction of sharded params/offloaded params. Moreover, it cannot set optimizer offload and parameter offload independently.
Thus, we can add a static placement policy, through which users can set the fraction of sharded params, offloaded optimizer states and offloaded params.
Overview
Current cuda and cpu placement policy cannot set the fraction of sharded params/offloaded params. Moreover, it cannot set optimizer offload and parameter offload independently.
Thus, we can add a static placement policy, through which users can set the fraction of sharded params, offloaded optimizer states and offloaded params.