feat: Bf16 KV cache for hybrid GDN models (#27)#56

pekkah merged 1 commit into

masterpekkah/SharpInference:masterfrom

feat/bf16-kv-hybrid-gdnpekkah/SharpInference:feat/bf16-kv-hybrid-gdnCopy head branch name to clipboard