Name		Name	Last commit message	Last commit date
Latest commit History 45 Commits
LICENSE		LICENSE
LICENSE.fly		LICENSE.fly
LICENSE.mamba		LICENSE.mamba
README.md		README.md
blockdiag_linear.py		blockdiag_linear.py
blockdiag_multiply.py		blockdiag_multiply.py
cuscan.cuh		cuscan.cuh
cuscan.py		cuscan.py
devicequery.py		devicequery.py
mamba_simple.py		mamba_simple.py
mixer_seq_simple.py		mixer_seq_simple.py
model.py		model.py
nanokitchen.py		nanokitchen.py
numbascan.py		numbascan.py
pyproject.toml		pyproject.toml
scan1.png		scan1.png
structured_linear.py		structured_linear.py
throughput.py		throughput.py
triscan.py		triscan.py
warpscan.py		warpscan.py
warpscan1.cu		warpscan1.cu
warpscan1.py		warpscan1.py

Repository files navigation

Scans

See also: Chunked Scan
Tweets https://twitter.com/darkproger/status/1741453063980830878
CUDA mode group has an aggregator of more scan implementations: https://github.com/cuda-mode/resource-stream
block scan algorithms in cub

About

Parallel Associative Scan for Language Models

ISC and 2 other licenses found

Licenses found

Report repository

Releases

No releases published

Packages

Contributors

Languages