Skip to content

Experiment Subgroup 8 for older gpus #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
rillomas wants to merge 90 commits into
base: master
Choose a base branch
from
Draft

Experiment Subgroup 8 for older gpus #14

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
77f033b
Adding default sub group size for Intel GPU
rillomas Nov 18, 2025
0edb835
Changing block size to match non-default subgroup size for Intel
rillomas Nov 18, 2025
1f18959
Fix validation error for coopmat environment
rillomas Nov 18, 2025
56bf4bd
Experimenting with subgroup requirements
rillomas Nov 19, 2025
29a1da9
Changed to specify explicit subgroup size
rillomas Nov 19, 2025
7c3e2df
Merge branch 'ggml-org:master' into set-default-subgroup-for-intel
rillomas Nov 20, 2025
76613be
Changed so we only force subgroup size on Intel
rillomas Nov 20, 2025
88025bd
Merge branch 'ggml-org:master' into set-default-subgroup-for-intel
rillomas Nov 25, 2025
4a796af
Merge branch 'master' into set-default-subgroup-for-intel
rillomas Nov 26, 2025
710f848
experimenting subgroup change for specific kernels only
rillomas Nov 26, 2025
36b976f
WIP to update subgroup size per kernel
rillomas Dec 4, 2025
565557c
Merge branch 'ggml-org:master' into set-default-subgroup-for-intel
rillomas Dec 4, 2025
09e2100
Merge branch 'master' into set-default-subgroup-for-intel
rillomas Jan 13, 2026
60893ad
fixed compile error
rillomas Jan 13, 2026
7d2d14f
experimenting specialization constant override
rillomas Jan 14, 2026
844c2e9
experimenting specialization constant override
rillomas Jan 14, 2026
edccd26
refactored matrix dimension
rillomas Jan 14, 2026
669de9a
refactored parameter override
rillomas Jan 19, 2026
2a31eb1
check if valid subgroup size is given
rillomas Jan 19, 2026
8783ed4
adding specialization constant replacement
rillomas Jan 19, 2026
f23e4b9
Revert "refactored matrix dimension"
rillomas Jan 19, 2026
377b006
revert dynamic gpu_pipeline_configs init
rillomas Jan 19, 2026
2460f54
experimenting blanket subgroup size change
rillomas Jan 20, 2026
7e05215
Fixed mismatch in MULMAT when subgroup is 16
rillomas Jan 20, 2026
fe8a3db
Only apply subgroup size change to M size kernels
rillomas Jan 20, 2026
ed1c99f
Merge branch 'master' into set-default-subgroup-for-intel
rillomas Feb 3, 2026
3fda042
Merge branch 'master' into set-default-subgroup-for-intel
rillomas Apr 9, 2026
6d50198
Fix compile error
rillomas Apr 9, 2026
b5249e9
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas Apr 13, 2026
04b7af9
workaround unit test failure for TOP_K
rillomas Apr 13, 2026
711205c
Fixed mulmat mismatch
rillomas Apr 14, 2026
e0f66bd
Add variable to set default subgroup size
rillomas Apr 14, 2026
5e41000
remove unused code
rillomas Apr 14, 2026
3992907
Refactored topk kernel selection
rillomas Apr 16, 2026
9319562
minor fix
rillomas Apr 16, 2026
58efaf9
adding override settings for some pipelines
rillomas Apr 16, 2026
3e04c51
removed unused parameter
rillomas Apr 16, 2026
987723b
removed unused header
rillomas Apr 16, 2026
b4a725e
added most of the pipelines with good gains
rillomas Apr 17, 2026
179d13c
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas Apr 28, 2026
fade555
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas May 11, 2026
8b38960
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas May 11, 2026
26edcc0
experimenting subgroup 8 support
rillomas May 12, 2026
d8abf2b
experimenting subgroup 8 support
rillomas May 12, 2026
f2b707c
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas May 13, 2026
8633379
fix compile error
rillomas May 13, 2026
201e69b
fix validation error
rillomas May 26, 2026
a44fc6c
Merge branch 'set-default-subgroup-for-intel' into subgroup-8-for-old…
rillomas May 26, 2026
9f79b58
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas May 26, 2026
ac70a70
Merge branch 'set-default-subgroup-for-intel' into subgroup-8-for-old…
rillomas May 26, 2026
2df11d7
Experimenting fix for MUL_MAT_ID mismatch
rillomas May 26, 2026
ea5fb38
applying changes to some mul_mat_id variants
rillomas Jun 1, 2026
255eb10
Experimenting mul_mat_vec specific configs
rillomas Jun 1, 2026
4b4f1d5
Remove unneeded conversion function
rillomas Jun 2, 2026
fe05293
rename
rillomas Jun 2, 2026
f2cf16d
Adjusting for MUL_MAT_ID kernels
rillomas Jun 2, 2026
9a255ef
Stop forcing subgroup size when 0 is specified
rillomas Jun 3, 2026
f278de9
Prefer to use subgroup 16 when no override is given
rillomas Jun 3, 2026
e8eeb03
reverted unneeded change
rillomas Jun 3, 2026
37b9637
reverted subgroup16 flags
rillomas Jun 4, 2026
dc56855
Fixed kernel selection
rillomas Jun 5, 2026
54e6ed1
Fixed perf issue
rillomas Jun 5, 2026
b5b1ea9
Experimenting subgroup/base kernel selection per variant
rillomas Jun 8, 2026
4f01c37
MMQ_ID can now select between subgroup or generic based on subgroup o…
rillomas Jun 10, 2026
44d20c1
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas Jun 17, 2026
591272a
Stop forcing subgroup size when 0 is specified
rillomas Jun 3, 2026
d5fcd17
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas Jun 19, 2026
c2ec028
Removed unused pipeline
rillomas Jun 19, 2026
bc3b725
Override required subgroup size under specific conditions to fix mism…
rillomas Jun 19, 2026
b247c2c
Added more pipelines to run in subgroup 16 and fixed comment
rillomas Jun 19, 2026
9313934
Divided settings for iGPU and dGPU
rillomas Jun 22, 2026
2257531
Abstracted subgroup update function per GPU device
rillomas Jun 22, 2026
8f5040b
Simplify by using function pointers
rillomas Jun 22, 2026
a1c0b28
Merge remote-tracking branch 'origin/master' into set-default-subgrou…
rillomas Jun 29, 2026
2aa1ee0
Fix compile error
rillomas Jun 29, 2026
e74cae2
Fixed specialization constant size mismatch
rillomas Jun 29, 2026
7e9435d
added microbenchmark for _s and _m pipelines
rillomas Jun 29, 2026
831e571
apply to all aligned_s and aligned_m pipelines
rillomas Jun 29, 2026
c8b2dfb
Revert "Divided settings for iGPU and dGPU"
rillomas Jun 30, 2026
8d7389b
Reverted Xe2 naming
rillomas Jul 2, 2026
0b2ccae
Removed GGML_VK_INTEL_DEFAULT_SUBGROUP_SIZE related code
rillomas Jul 2, 2026
669ee08
Revert "Refactored topk kernel selection"
rillomas Jul 2, 2026
4597e5d
Revert "workaround unit test failure for TOP_K"
rillomas Jul 2, 2026
b701c53
Removed unused code
rillomas Jul 2, 2026
8521bbb
Reverted to use device given default subgroup size
rillomas Jul 2, 2026
de148dc
Removed unused code
rillomas Jul 2, 2026
0f38f24
Intent to fix AMD subgroup update logic to match original
rillomas Jul 2, 2026
3188d90
Fix mismatch when coopmat is disabled
rillomas Jul 6, 2026
5954951
Merge branch 'set-default-subgroup-for-intel' into subgroup-8-for-old…
rillomas Jul 7, 2026
9958c83
Fixing compile error
rillomas Jul 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading