Skip to content

DeepseekV4: fix seq_rm#25588

Open
am17an wants to merge 1 commit into
ggml-org:masterfrom
am17an:dsv4-fix-seq-rm
Open

DeepseekV4: fix seq_rm#25588
am17an wants to merge 1 commit into
ggml-org:masterfrom
am17an:dsv4-fix-seq-rm

Conversation

@am17an

@am17an am17an commented Jul 12, 2026

Copy link
Copy Markdown
Contributor

Overview

Fixes #25566. This PR adds clears the compressed caches till the checkpoint as well after a server checkpoint restore.

Additional information

Requirements

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Misc. bug: server - deepseek4 slot KV never reclaimed on release; fails with "Context size has been exceeded" when cumulative prompts exceed n_ctx

1 participant