hey! this is a static git repo viewer. commit diffs, file history, older commits and other revisions won't load without javascript.

you are still able to view source files on branch/tag tips, but the experience is degraded.

char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Johannes Gäßlerllama: end-to-end tests (#19802)a976ff0812026-03-08

renderedcode

Results

The llama-results tool can be used to --check the outputs of a model vs. a previous commit to detect whether they have changed. Example usage:

llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed."  # writes results to file
llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." --check  # compares results vs file

The metric by which the results are compared is the normalized mean squared error (NMSE) with a tolerance of $10^{-6}$.

1# Results
2
3The `llama-results` tool can be used to `--check` the outputs of a model vs. a previous commit to detect whether they have changed.
4Example usage:
5
6``` sh
7llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed."  # writes results to file
8llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." --check  # compares results vs file
9```
10
11The metric by which the results are compared is the normalized mean squared error (NMSE) with a tolerance of $10^{-6}$.