Skip to content

feat(purejava): add deterministic execution planning#29

Merged
bsbodden merged 4 commits into
mainfrom
feat/purejava-execution-plans
Jul 18, 2026
Merged

feat(purejava): add deterministic execution planning#29
bsbodden merged 4 commits into
mainfrom
feat/purejava-execution-plans

Conversation

@bsbodden

Copy link
Copy Markdown
Member

Summary

  • expose backend-neutral execution diagnostics and stable optimization decisions
  • build one pure-Java plan from actual GGUF layer topology, JVM identity, and structured Vectors capabilities
  • route grouped projections and batched prefill through the immutable load-time plan
  • reject malformed overrides, contradictory plans, and plans for different weights
  • expose diagnostics through LangChain4J and ModelJars profiles through Spring Boot
  • document the controlled HotSpot/Graal full-model matrix

Controlled result

Best measured per-model JVM selection raises summed decode from 21.7% to 30.9% of llama.cpp and from 47.1% to 67.1% of Ollama. All compiler-paired output hashes matched.

Tests

  • ./gradlew :models-api:test :models-backend-purejava:unitTest
  • ./gradlew :models-langchain4j:test :models-spring-boot-starter:test
  • ./gradlew check

@bsbodden
bsbodden merged commit 6f8788c into main Jul 18, 2026
12 checks passed
@bsbodden
bsbodden deleted the feat/purejava-execution-plans branch July 18, 2026 19:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant