Skip to content

docs(bench): refresh inference performance matrix#28

Merged
bsbodden merged 1 commit into
mainfrom
docs/refresh-20260718-inference-matrix
Jul 18, 2026
Merged

docs(bench): refresh inference performance matrix#28
bsbodden merged 1 commit into
mainfrom
docs/refresh-20260718-inference-matrix

Conversation

@bsbodden

Copy link
Copy Markdown
Member

Summary

  • refresh the controlled Qwen3, SmolLM2, and MiniCPM5 cross-engine matrix
  • separate measured Java progress from Ollama run variance
  • record current prefill, TTFT, decode, memory, and output-parity results

Validation

  • ./gradlew check
  • git diff --check
  • clean controlled VPS run: 8 vCPU AMD EPYC Milan, two warmups, ten trials, identical GGUF bytes

@bsbodden
bsbodden merged commit 3869ab6 into main Jul 18, 2026
3 checks passed
@bsbodden
bsbodden deleted the docs/refresh-20260718-inference-matrix branch July 18, 2026 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant