char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Johannes Gäßlerggml/examples: add backend support for numerical optimization (ggml/949)424c5d00a

char/aliceai-t5-moe
251 B7 linesraw
1#include "common.cuh"
2
3#define CUDA_CROSS_ENTROPY_LOSS_BLOCK_SIZE 256
4
5void ggml_cuda_cross_entropy_loss(ggml_backend_cuda_context & ctx, ggml_tensor * dst);
6
7void ggml_cuda_cross_entropy_loss_back(ggml_backend_cuda_context & ctx, ggml_tensor * dst);