char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Neo Zhangsycl : Enhance to get the free memory of Intel GPU (#27968)a32af33de

char/aliceai-t5-moe
brancheschar/aliceai-t5-moeall refs →
354 B16 linesraw
1#ifndef GGML_SYCL_MEM_HPP
2#define GGML_SYCL_MEM_HPP
3
4#include <sycl/sycl.hpp>
5
6enum MemoryAPIType {
7    MEMORY_API_TYPE_LEVEL_ZERO = 0,
8    MEMORY_API_TYPE_SYCL = 1,
9};
10
11const char* mem_api_int2str(int mem_api);
12
13bool get_memory_size(sycl::device dev, size_t & free_bytes, size_t & total_bytes,
14    MemoryAPIType api_type);
15
16#endif  // GGML_SYCL_MEM_HPP