Implement stochastic speculative sampling#5625

ggerganov merged 17 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

mscheong01:stochastic-speculative-decodingmscheong01/llama.cpp:stochastic-speculative-decodingCopy head branch name to clipboard