Cache: new Cache format in decoder-only models#31421

zucchini-nlp merged 44 commits into

huggingface:mainhuggingface/transformers:mainfrom

zucchini-nlp:dynamic_cache_decoder_onlyzucchini-nlp/transformers:dynamic_cache_decoder_onlyCopy head branch name to clipboard