Skip to content

server: add SSE ping interval#24013

Merged
ngxson merged 1 commit into
ggml-org:masterfrom
ngxson:xsn/server_sse_ping
Jun 2, 2026
Merged

server: add SSE ping interval#24013
ngxson merged 1 commit into
ggml-org:masterfrom
ngxson:xsn/server_sse_ping

Conversation

@ngxson

@ngxson ngxson commented Jun 2, 2026

Copy link
Copy Markdown
Collaborator

Overview

Supersede #23994

Refer to my investigation earendil-works/pi#5089 (comment) for more info

Add SSE ping (otherwise known as keepalive or comment)

Tested with:

Also remove the client-side message from #23842 , because this will (hopefully) make most clients happy now.

Requirements

@ngxson ngxson requested review from a team as code owners June 2, 2026 08:29

@aldehir aldehir left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to work!

:

:

:

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"role":"assistant","content":null}}],"created":1780390177,"id":"chatcmpl-uI7JNfldkYifvjYLehw5OnRid3v0JxBC","model":"Qwen3.6-27B-Q4_0.gguf","system_fingerprint":"b9465-23e6dab86","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"Here"}}],"created":1780390177,"id":"chatcmpl-uI7JNfldkYifvjYLehw5OnRid3v0JxBC","model":"Qwen3.6-27B-Q4_0.gguf","system_fingerprint":"b9465-23e6dab86","object":"chat.completion.chunk"}

@ngxson ngxson merged commit 60130d1 into ggml-org:master Jun 2, 2026
24 of 25 checks passed
zbrad pushed a commit to zbrad/llama.cpp that referenced this pull request Jul 3, 2026
adrianhoehne pushed a commit to adrianhoehne/llama.cpp that referenced this pull request Jul 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants