Skip to content

Commit a11f03f

Browse files
committed
add cuda 11.8 notice for sherpa onnx asr cuda
1 parent f697717 commit a11f03f

File tree

2 files changed

+15
-2
lines changed
  • docs/user-guide/backend
  • i18n/en/docusaurus-plugin-content-docs/current/user-guide/backend

2 files changed

+15
-2
lines changed

docs/user-guide/backend/asr.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,8 +26,15 @@ import TabItem from '@theme/TabItem';
2626
:::
2727

2828
### CUDA 推理
29+
2930
`sherpa-onnx` 支持 CPU 和 CUDA 推理。虽然预设的 `SenseVoiceSmall` 模型在 CPU 上已经表现不错,但如果您有 NVIDIA GPU,可以通过以下步骤启用 CUDA 推理来获得更好的性能:
3031

32+
[官方文档](https://k2-fsa.github.io/sherpa/onnx/python/install.html#method-2-from-pre-compiled-wheels-cpu-cuda)
33+
34+
:::warning
35+
注意: sherpa onnx 似乎只支持 CUDA 11.8,但我没有证据。请参考[官方文档](https://k2-fsa.github.io/sherpa/onnx/python/install.html#method-2-from-pre-compiled-wheels-cpu-cuda),安装 CUDA 11.8 以及获取更多信息。
36+
:::
37+
3138
1. 首先卸载 CPU 版本的依赖:
3239
```sh
3340
uv remove sherpa-onnx onnxruntime

i18n/en/docusaurus-plugin-content-docs/current/user-guide/backend/asr.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,17 +27,23 @@ Starting from version `v1.0.0`, this project uses `sherpa-onnx` to run the `Sens
2727
### CUDA Inference
2828
`sherpa-onnx` supports both CPU and CUDA inference. Although the default `SenseVoiceSmall` model performs well on CPU, if you have an NVIDIA GPU, you can enable CUDA inference for better performance by following these steps:
2929

30+
[Official doc on CUDA](https://k2-fsa.github.io/sherpa/onnx/python/install.html#method-2-from-pre-compiled-wheels-cpu-cuda)
31+
32+
:::warning
33+
Warning: We suspect that sherpa onnx only support CUDA 11.8, but I'm not sure. Please refer to the [official documentation](https://k2-fsa.github.io/sherpa/onnx/python/install.html#method-2-from-pre-compiled-wheels-cpu-cuda) for CUDA 11.8 installation and more details.
34+
:::
35+
3036
1. First, uninstall the CPU version dependencies:
3137
```sh
3238
uv remove sherpa-onnx onnxruntime
3339
```
3440

35-
2. Install the CUDA version of `sherpa-onnx` and `onnxruntime-gpu` dependencies:
41+
1. Install the CUDA version of `sherpa-onnx` and `onnxruntime-gpu` dependencies:
3642
```sh
3743
uv add onnxruntime-gpu sherpa-onnx==1.10.39+cuda -f https://k2-fsa.github.io/sherpa/onnx/cuda.html
3844
```
3945

40-
3. Modify the configuration file:
46+
1. Modify the configuration file:
4147
In `conf.yaml`, find the `sherpa_onnx_asr` section and set `provider` to `cuda`
4248

4349
### Using Other sherpa-onnx Models

0 commit comments

Comments
 (0)