char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Georgi Gerganovrepo : update links to new url (#11886)68ff663a0

char/aliceai-t5-moe
brancheschar/aliceai-t5-moeall refs →
282 B9 linesraw

llama.cpp/examples/speculative

Demonstration of speculative decoding and tree-based speculative decoding techniques

More info:

  • https://github.com/ggml-org/llama.cpp/pull/2926
  • https://github.com/ggml-org/llama.cpp/pull/3624
  • https://github.com/ggml-org/llama.cpp/pull/5625
1# llama.cpp/examples/speculative
2
3Demonstration of speculative decoding and tree-based speculative decoding techniques
4
5More info:
6
7- https://github.com/ggml-org/llama.cpp/pull/2926
8- https://github.com/ggml-org/llama.cpp/pull/3624
9- https://github.com/ggml-org/llama.cpp/pull/5625