Cache: standardize cache interface#29005

Closed

gante wants to merge 30 commits into

huggingface:mainfrom

gante:standardize_cache_api

Commits on Feb 15, 2024

wow I was scared!

ArthurZucker
authored and
gante
committed
fix everything

ArthurZucker
authored and
gante
committed
nits

ArthurZucker
authored and
gante
committed
make it BC?

ArthurZucker
authored and
gante
committed
nits

ArthurZucker
authored and
gante
committed
is_tracing should still be used to pass tracing tests

ArthurZucker
authored and
gante
committed
nits

ArthurZucker
authored and
gante
committed
some nits to make sure genration works with static cache uncompiled

ArthurZucker
authored and
gante
committed
fix FA2 for both static and dynamic in a better way?

ArthurZucker
authored and
gante
committed
fix sequential beam searcg

ArthurZucker
authored and
gante
committed
style

ArthurZucker
authored and
gante
committed
use `keys_to_ignore`

ArthurZucker
authored and
gante
committed
nit

ArthurZucker
authored and
gante
committed
correct dtype inference when init

ArthurZucker
authored and
gante
committed
:( the fix for FA2 is still not optimal to investigate!

ArthurZucker
authored and
gante
committed
styling

ArthurZucker
authored and
gante
committed
nits

ArthurZucker
authored and
gante
committed
nit

ArthurZucker
authored and
gante
committed
this might work better

ArthurZucker
authored and
gante
committed
add comment

ArthurZucker
authored and
gante
committed
Update src/transformers/models/llama/modeling_llama.py

ArthurZucker
authored and
gante
committed
tmp commit
gante
committed
wip
gante
committed
tmp commit
gante
committed
tmp
gante
committed
merge errors
gante
committed
reduce diff
gante
committed
smaller llama diff
gante
committed
make fixup
gante
committed
nearly all tests passing
gante
committed