Add tokenizer_kwargs argument to the text generation pipeline#40364

gante merged 7 commits into

huggingface:mainhuggingface/transformers:mainfrom

Joshua-Chin:text-generation-pipeline-tokenizer-kwargsJoshua-Chin/transformers:text-generation-pipeline-tokenizer-kwargsCopy head branch name to clipboard