char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Jim Wutests : replace personal home directory paths with generic placeholders (#27043)885c5bbe8

char/aliceai-t5-moe
1.4 KiB36 linesraw

cmake-test

This is just for manually testing/developing of a llama.cpp installation to enable troubleshooting issues and exploration. The idea is that this can be used after making changes to llama.cpp installation cmake configuration and then verify it locally.

Usage

The following will configure, build, and install llama.cpp

Configuring/build/install:

./build-install.sh

The above command will create a directory named install in the current directory which will have the follwing files in its lib directory:

(venv) $ ls install/lib/
cmake                   libggml.so          libllama-common.so.0      libllama.so.0.1.0  llama.cpp
libggml-base.so         libggml.so.0        libllama-common.so.0.1.0  libmtmd.so         pkgconfig
libggml-base.so.0       libggml.so.0.19.0   libllama.so               libmtmd.so.0
libggml-base.so.0.19.0  libllama-common.so  libllama.so.0             libmtmd.so.0.1.0

Build/run this project using the installation created above:

(venv) $ ./build.sh
-- Configuring done (0.0s)
-- Generating done (0.0s)
-- Build files have been written to: /path/to/llama.cpp/examples/test-cmake/build
[100%] Built target test-cmake
[test-cmake] Using llama.cpp version 0.1.0-dev-b10335
[test-cmake] Initializing backend...
load_backend: loaded CPU backend from /path/to/llama.cpp/examples/test-cmake/install/lib/llama.cpp/libggml-cpu-alderlake.so
[test-cmake] Backend initialized.
1## cmake-test
2
3This is just for manually testing/developing of a llama.cpp installation to
4enable troubleshooting issues and exploration. The idea is that this can be used
5after making changes to llama.cpp installation cmake configuration and then
6verify it locally.
7
8### Usage
9The following will configure, build, and install llama.cpp
10
11Configuring/build/install:
12```console
13./build-install.sh
14```
15The above command will create a directory named `install` in the current directory
16which will have the follwing files in its lib directory:
17```console
18(venv) $ ls install/lib/
19cmake                   libggml.so          libllama-common.so.0      libllama.so.0.1.0  llama.cpp
20libggml-base.so         libggml.so.0        libllama-common.so.0.1.0  libmtmd.so         pkgconfig
21libggml-base.so.0       libggml.so.0.19.0   libllama.so               libmtmd.so.0
22libggml-base.so.0.19.0  libllama-common.so  libllama.so.0             libmtmd.so.0.1.0
23```
24
25Build/run this project using the installation created above:
26```console
27(venv) $ ./build.sh
28-- Configuring done (0.0s)
29-- Generating done (0.0s)
30-- Build files have been written to: /path/to/llama.cpp/examples/test-cmake/build
31[100%] Built target test-cmake
32[test-cmake] Using llama.cpp version 0.1.0-dev-b10335
33[test-cmake] Initializing backend...
34load_backend: loaded CPU backend from /path/to/llama.cpp/examples/test-cmake/install/lib/llama.cpp/libggml-cpu-alderlake.so
35[test-cmake] Backend initialized.
36```