Search results

refactor: standardize route_request signature across all routers

Status: Open.

#1022 In vllm-project/production-stack;

· shernshiou opened on Jul 28, 2026

KvawareRouter blocks the event loop per request (sync tokenizer fetch + /tokenize POST + controller lookup) — health probes starve, router CrashLoops under load

Status: Open.

#1016 In vllm-project/production-stack;

· HipHoff opened on Jul 26, 2026

bug: router keeps a ghost endpoint after a worker pod is evicted, causing request timeouts

bugSomething isn't workingSomething isn't working

Status: Open.

#1008 In vllm-project/production-stack;

· jiawen7777 opened on Jul 23, 2026

Router returns fatal 404 (not retryable 503) for a scaled-to-zero model when the router pod started while the pool was at 0 replicas

Status: Open.

#1003 In vllm-project/production-stack;

· HipHoff opened on Jul 21, 2026

bug: ray command not found following parallel pipeline tutorial

bugSomething isn't workingSomething isn't working

Status: Open.

#995 In vllm-project/production-stack;

· brunnels opened on Jul 12, 2026

bug: The VLLMRuntime controller fails on every reconciliation when running on a cluster that does not have KEDA installed

bugSomething isn't workingSomething isn't working

Status: Open.

#981 In vllm-project/production-stack;

· J0HN50N133 opened on Jun 22, 2026

feature: add Uvicorn logging parameters to vllm_router

feature requestNew feature or requestNew feature or request

Status: Open.

#967 In vllm-project/production-stack;

· quachc opened on Jun 3, 2026

feature: add first-class multi-node multiprocessing deployment support

Status: Open.

#930 In vllm-project/production-stack;

· observerw opened on Apr 26, 2026

feature: Implement Anthropic external provider (Phase 2)

feature requestNew feature or requestNew feature or request

Status: Open.

#928 In vllm-project/production-stack;

· shernshiou opened on Apr 22, 2026

bug: LMCache cacheserver OOMKilled

bugSomething isn't workingSomething isn't working

Status: Open.

#923 In vllm-project/production-stack;

· suleimanelkhoury opened on Apr 17, 2026

feature: per-alias reasoning_effort for backward-compatible model migration

Status: Open.

#911 In vllm-project/production-stack;

· Killusions opened on Apr 10, 2026

feature: crd ressources : split request and limit ressources

feature requestNew feature or requestNew feature or request

Status: Open.

#901 In vllm-project/production-stack;

· dotmobo opened on Mar 29, 2026