Skip to content

Demo usage of Flash Attention#778

Closed
ggerganov wants to merge 1 commit into
masterfrom
flash-attn
Closed

Demo usage of Flash Attention#778
ggerganov wants to merge 1 commit into
masterfrom
flash-attn

llama : add flash attention (demo)

36ddd12
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs