Skip to content
This repository was archived by the owner on Feb 24, 2026. It is now read-only.

[Dev] Implement TileLang NF Format Dequantize#273

Merged
LeiWang1999 merged 36 commits into
microsoft:mainfrom
LeiWang1999:change_default_backend
Dec 18, 2024
Merged

[Dev] Implement TileLang NF Format Dequantize#273
LeiWang1999 merged 36 commits into
microsoft:mainfrom
LeiWang1999:change_default_backend

Conversation

@LeiWang1999
Copy link
Copy Markdown
Contributor

I think we should still enable the NF format to achieve optimal performance when utilizing fp16xnf4 matrix multiplication, especially with atomicAdd enabled.”

@LeiWang1999 LeiWang1999 merged commit 8322ec5 into microsoft:main Dec 18, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant