Skip to content

feat(bench): report decode GC pressure#27

Merged
bsbodden merged 1 commit into
mainfrom
perf/decode-gc-telemetry
Jul 18, 2026
Merged

feat(bench): report decode GC pressure#27
bsbodden merged 1 commit into
mainfrom
perf/decode-gc-telemetry

Conversation

@bsbodden

Copy link
Copy Markdown
Member

Summary\n- report GC collection and pause deltas for the measured decode window\n- make the GC metric source injectable so ordering and deltas are deterministic in tests\n- include allocation pressure in the standard decode-profile output\n\n## Verification\n- > Task :models-api:compileJava UP-TO-DATE

Task :vectors:vectors-core:compileJava UP-TO-DATE
Task :model-jars:modeljars-core:compileJava UP-TO-DATE
Task :model-jars:modeljars-core:processResources NO-SOURCE
Task :models-api:processResources NO-SOURCE
Task :model-jars:modeljars-core:classes UP-TO-DATE
Task :vectors:vectors-core:processResources UP-TO-DATE
Task :vectors:vectors-core:classes UP-TO-DATE
Task :models-api:classes UP-TO-DATE
Task :model-jars:modeljars-core:jar UP-TO-DATE
Task :vectors:vectors-core:jar UP-TO-DATE
Task :models-api:jar UP-TO-DATE
Task :models-backend-purejava:compileJava UP-TO-DATE
Task :models-backend-purejava:processResources NO-SOURCE
Task :models-backend-purejava:classes UP-TO-DATE
Task :models-backend-purejava:jar UP-TO-DATE
Task :models-runtime:compileJava UP-TO-DATE
Task :models-bench:compileJava UP-TO-DATE
Task :models-bench:processResources NO-SOURCE
Task :models-bench:classes UP-TO-DATE
Task :models-bench:compileTestJava UP-TO-DATE
Task :models-bench:processTestResources NO-SOURCE
Task :models-bench:testClasses UP-TO-DATE
Task :models-runtime:processResources NO-SOURCE
Task :models-runtime:classes UP-TO-DATE
Task :models-runtime:jar UP-TO-DATE
Task :models-bench:test

BUILD SUCCESSFUL in 3s
14 actionable tasks: 1 executed, 13 up-to-date
Consider enabling configuration cache to speed up this build: https://docs.gradle.org/9.4.1/userguide/configuration_cache_enabling.html\n- > Task :model-jars:modeljars-core:compileJava UP-TO-DATE

Task :models-api:compileJava UP-TO-DATE
Task :vectors:vectors-core:compileJava UP-TO-DATE
Task :model-jars:modeljars-core:processResources NO-SOURCE
Task :model-jars:modeljars-core:classes UP-TO-DATE
Task :vectors:vectors-core:processResources UP-TO-DATE
Task :models-runtime:compileJava UP-TO-DATE
Task :vectors:vectors-core:classes UP-TO-DATE
Task :model-jars:modeljars-core:jar UP-TO-DATE
Task :models-backend-purejava:compileJava UP-TO-DATE
Task :vectors:vectors-core:jar UP-TO-DATE
Task :models-bench:compileJava UP-TO-DATE
Task :models-bench:processResources NO-SOURCE
Task :models-bench:classes UP-TO-DATE
Task :models-bench:compileTestJava UP-TO-DATE
Task :models-bench:processTestResources NO-SOURCE
Task :models-bench:testClasses UP-TO-DATE
Task :models-bench:compileJmhJava UP-TO-DATE
Task :models-bench:processJmhResources NO-SOURCE
Task :models-bench:jmhClasses UP-TO-DATE
Task :models-bench:spotbugsJmh UP-TO-DATE
Task :models-bench:spotbugsMain UP-TO-DATE
Task :models-bench:spotbugsTest SKIPPED
Task :spotlessInternalRegisterDependencies UP-TO-DATE
Task :models-bench:spotlessJava
Task :models-bench:spotlessJavaCheck
Task :models-bench:spotlessCheck
Task :models-api:processResources NO-SOURCE
Task :models-api:classes UP-TO-DATE
Task :models-api:jar UP-TO-DATE
Task :models-backend-purejava:processResources NO-SOURCE
Task :models-backend-purejava:classes UP-TO-DATE
Task :models-backend-purejava:jar UP-TO-DATE
Task :models-runtime:processResources NO-SOURCE
Task :models-runtime:classes UP-TO-DATE
Task :models-runtime:jar UP-TO-DATE
Task :models-bench:test
Task :models-bench:check

BUILD SUCCESSFUL in 4s
20 actionable tasks: 3 executed, 17 up-to-date
Consider enabling configuration cache to speed up this build: https://docs.gradle.org/9.4.1/userguide/configuration_cache_enabling.html\n- > Task :model-jars:modeljars-core:compileJava UP-TO-DATE

Task :models-api:compileJava UP-TO-DATE
Task :vectors:vectors-core:compileJava UP-TO-DATE
Task :models-api:processResources NO-SOURCE
Task :model-jars:modeljars-core:processResources NO-SOURCE
Task :model-jars:modeljars-core:classes UP-TO-DATE
Task :models-api:classes UP-TO-DATE
Task :vectors:vectors-core:processResources UP-TO-DATE
Task :vectors:vectors-core:classes UP-TO-DATE
Task :models-api:jar UP-TO-DATE
Task :vectors:vectors-core:jar UP-TO-DATE
Task :model-jars:modeljars-core:jar UP-TO-DATE
Task :models-backend-purejava:compileJava UP-TO-DATE
Task :models-backend-purejava:processResources NO-SOURCE
Task :models-backend-purejava:classes UP-TO-DATE
Task :models-backend-purejava:jar UP-TO-DATE
Task :models-runtime:compileJava UP-TO-DATE
Task :models-bench:compileJava UP-TO-DATE
Task :models-bench:processResources NO-SOURCE
Task :models-bench:classes UP-TO-DATE
Task :models-bench:jar UP-TO-DATE
Task :models-runtime:processResources NO-SOURCE
Task :models-runtime:classes UP-TO-DATE
Task :models-runtime:jar UP-TO-DATE
Task :models-bench:startScripts UP-TO-DATE
Task :models-bench:installDist UP-TO-DATE

BUILD SUCCESSFUL in 2s
15 actionable tasks: 15 up-to-date
Consider enabling configuration cache to speed up this build: https://docs.gradle.org/9.4.1/userguide/configuration_cache_enabling.html\n- MiniCPM5 smoke: 7.76 tok/s, zero measured-window collections, zero measured GC pause\n\nThis telemetry is the full-graph acceptance gate used by integrallis/vectors#20, which removes escaped Vector allocation from Q4_K/Q6_K decode.

@bsbodden
bsbodden merged commit a1f0919 into main Jul 18, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant