Skip to content

S1-28: GLU_BACK — a VJP for every GLU variant#22

Open
dillon-blake wants to merge 3 commits into
ticket/S1-26-out-prod-idfrom
ticket/S1-28-glu-backward
Open

S1-28: GLU_BACK — a VJP for every GLU variant#22
dillon-blake wants to merge 3 commits into
ticket/S1-26-out-prod-idfrom
ticket/S1-28-glu-backward

S1-28: two more ggml bugs that made every MoE model untrainable

8857bc8
Select commit
Loading
Failed to load commit list.

There are no checks for this commit