char-fork/llama.cpp
git clone https://git.t4t.associates/char-fork/llama.cpp
885c5bbe8
char/aliceai-t5-moe
cmake-test
This is just for manually testing/developing of a llama.cpp installation to enable troubleshooting issues and exploration. The idea is that this can be used after making changes to llama.cpp installation cmake configuration and then verify it locally.
Usage
The following will configure, build, and install llama.cpp
Configuring/build/install:
./build-install.sh
The above command will create a directory named install in the current directory
which will have the follwing files in its lib directory:
(venv )$ ls install/lib/cmake libggml.so libllama-common.so.0 libllama.so.0.1.0 llama.cpplibggml-base.so libggml.so.0 libllama-common.so.0.1.0 libmtmd.so pkgconfiglibggml-base.so.0 libggml.so.0.19.0 libllama.so libmtmd.so.0libggml-base.so.0.19.0 libllama-common.so libllama.so.0 libmtmd.so.0.1.0
Build/run this project using the installation created above:
(venv )$ ./build.sh -- Configuring done (0.0s )-- Generating done (0.0s )-- Build files have been written to: /path/to/llama.cpp/examples/test-cmake/build [100 %]Built target test-cmake [test-cmake] Using llama.cpp version 0.1.0-dev-b10335 [test-cmake] Initializing backend... load_backend: loaded CPU backend from /path/to/llama.cpp/examples/test-cmake/install/lib/llama.cpp/libggml-cpu-alderlake.so [test-cmake] Backend initialized.
1## cmake-test 2 3This is just for manually testing/developing of a llama.cpp installation to 4enable troubleshooting issues and exploration. The idea is that this can be used 5after making changes to llama.cpp installation cmake configuration and then 6verify it locally. 7 8### Usage 9The following will configure, build, and install llama.cpp 10 11Configuring/build/install: 12``` console 13./build-install.sh 14``` 15The above command will create a directory named `install` in the current directory 16which will have the follwing files in its lib directory: 17``` console 18(venv) $ ls install/lib/ 19cmake libggml.so libllama-common.so.0 libllama.so.0.1.0 llama.cpp 20libggml-base.so libggml.so.0 libllama-common.so.0.1.0 libmtmd.so pkgconfig 21libggml-base.so.0 libggml.so.0.19.0 libllama.so libmtmd.so.0 22libggml-base.so.0.19.0 libllama-common.so libllama.so.0 libmtmd.so.0.1.0 23``` 24 25Build/run this project using the installation created above: 26``` console 27(venv) $ ./build.sh 28-- Configuring done (0.0s) 29-- Generating done (0.0s) 30-- Build files have been written to: /path/to/llama.cpp/examples/test-cmake/build 31[100%] Built target test-cmake 32[test-cmake] Using llama.cpp version 0.1.0-dev-b10335 33[test-cmake] Initializing backend... 34load_backend: loaded CPU backend from /path/to/llama.cpp/examples/test-cmake/install/lib/llama.cpp/libggml-cpu-alderlake.so 35[test-cmake] Backend initialized. 36```