Make graph_max_nodes vary by ubatch size for models where chunking mi…#7

danielhanchen merged 1 commit into

unslothai:masterunslothai/llama.cpp:masterfrom

pwilkin:graph_max_nodespwilkin/llama.cpp:graph_max_nodesCopy head branch name to clipboard