Skip to content

Error when input file is longer than 5min #55

Description

@Disonantemus

Transcription with parakeet is working ok with small files, but with files a longer than 5min it gives the following error: ErrorOutOfDeviceMemory.

I'm using the vulkan version.

Steps to reproduce

I have a 2hr+ recording that want to transcribe, gives error and did try with 10min, like this:

$ ffmpeg -t 00:10:00 -i in.wav -c copy p1.wav

$ ffprobe p1.wav
Input #0, wav, from 'p1.wav':
  Metadata:
    encoder         : Lavf62.12.102
  Duration: 00:10:00.00, bitrate: 705 kb/s
  Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, 1 channels, s16, 705 kb/s

$ parakeet-cli transcribe --model $HOME/00_M/tdt-0.6b-v3-q4_k.gguf --input p1.wav --json > out.json
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = NVIDIA GeForce GTX 1660 SUPER (NVIDIA) | uma: 0 | fp16: 1 | bf16: 0 | warp size: 32 | shared memory: 49152 | int dot: 1 | matrix cores: none
[parakeet] pk::Backend using device: Vulkan0
ggml_vulkan: Device memory allocation of size 900240064 failed.
ggml_vulkan: vk::Device::allocateMemory: ErrorOutOfDeviceMemory
ggml_gallocr_reserve_n_impl: failed to allocate Vulkan0 buffer of size 16698365856
[parakeet] Backend::compute: ggml_gallocr_alloc_graph failed
Segmentation fault         (core dumped) parakeet-cli transcribe --model $HOME/00_M/tdt-0.6b-v3-q4_k.gguf --input p1.wav --json > out.json
  • I also did try the pipe example with ffmpeg, gives same error.
  • If I do the same, but with 5min, works.
  • I can do the the full 2hr+ audio with Whisper without any problem, but I'm trying parakeet now, because is faster.
  • I can chop the audio in many 5 min files, but is more like a workaround than a solution, also gives problems to join subtitles.
  • I did use frequently llama.cpp and sometimes sd.cpp, if it counts as experience.
  • My system is updated.

System

distro: Arch Linux x86_64
kernel: 6.18.25-1-lts
cpu: Intel i7-4790 (8) @ 3.600GHz
ram: 32 GB
gpu: NVIDIA GeForce GTX 1660 SUPER (6GB VRAM)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions