Skip to content

Add MTP speculative decoding via MTPCandidateGenerator#45618

Closed
ArthurZucker wants to merge 2 commits into
mainfrom
mtp-inference
Closed

Add MTP speculative decoding via MTPCandidateGenerator#45618
ArthurZucker wants to merge 2 commits into
mainfrom
mtp-inference