diff --git a/docs/_pages/config-json.md b/docs/_pages/config-json.md index 423dc5f85d23..0d049b57c6a2 100755 --- a/docs/_pages/config-json.md +++ b/docs/_pages/config-json.md @@ -373,7 +373,7 @@ Enabling and configuring ZeRO memory optimizations | Description | Default | | --------------------------------------------------------------------------------------------------------- | ------- | -| Enable ZeRO memory optimization wrapper for FP16 Training. Currently compatible only with Adam optimizer. | `false` | +| Enable ZeRO memory optimizations, compatible with FP16/BF16/FP32 and the Adam optimizer. | `false` | **stage**: [integer]