You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|`--max-shard-size SIZE`| Maximum shard size for safetensors external data (e.g. `5GB`). Only used with `--external-data safetensors`. |
238
237
|`--trust-remote-code`| Trust remote code when loading the HuggingFace model config. |
239
238
|`--component NAME`| Build only one component from a diffusers pipeline (e.g. `--component vae_decoder`). |
240
-
|`--text-only`|**Deprecated** alias for `--features text-only`. Export the text backbone of a multimodal checkpoint as a standalone decoder-only LLM. Strips vision/audio routing so the decoder uses `GroupQueryAttention` on GQA-capable EPs (build with `--ep cuda`/`dml`). Currently supported for `gemma4_unified` (`google/gemma-4-12B`). Not compatible with `--config` or `--component`. |
239
+
|`--kv-cache-scale-file PATH`| Optional JSON file of calibrated per-layer FP8 KV-cache scales (onnxruntime-genai format). Only used with the `fp8-kv-cache` feature; without it all layers use a unit scale of 1.0. |
241
240
|`--kv-cache-scale-file PATH`| Optional JSON file of calibrated per-layer FP8 KV-cache scales (onnxruntime-genai format). Only used with the `fp8-kv-cache` feature; without it all layers use a unit scale of 1.0. |
0 commit comments