feat(vllm): progressive streaming via parser.extract_tool_calls_streaming (follow-up to #10346)#10351

Merged

mudler merged 6 commits into

mudler:masterfrom

pos-ei-don:wip/streaming-tool-parser-follow-up

Jun 21, 2026

Commits on Jun 19, 2026

fix(vllm): don't stream raw tool-call markup as content when a tool parser is active
pos-ei-don
committed
test(vllm): add expectedFailure test for progressive streaming with tool parser (Case 3, #582)
pos-ei-don
committed
test(vllm): add Cases 4+5 — marker split across chunks + false-positive prefix (TDD, Option B state machine, #582)
pos-ei-don
committed
feat(vllm): progressive streaming via parser.extract_tool_calls_streaming

Philipp Wacker
authored and
pos-ei-don
committed
docs(vllm): add server-side TTFT benchmark for the streaming tool-parser path

Philipp Wacker
authored and
pos-ei-don
committed
examples/vllm-bench: add long-text scenario (8 paragraphs, 1500 tokens)

Philipp Wacker
authored and
pos-ei-don
committed