hey! this is a static git repo viewer. commit diffs, file history, older commits and other revisions won't load without javascript.

you are still able to view source files on branch/tag tips, but the experience is degraded.

char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Todor Boinovskiops: add Hexagon to ops.md and update main README.md (#28263)e107984bc2026-09-03

renderedcode

GGML Operations

List of GGML operations and backend support status.

How to add a backend to this table:

Run test-backend-ops support --output csv with your backend name and redirect output to a csv file in docs/ops/ (e.g., docs/ops/CUDA.csv)
Regenerate /docs/ops.md via ./scripts/create_ops_docs.py

Legend:

✅ Fully supported by this backend
🟡 Partially supported by this backend
❌ Not supported by this backend

Operation	BLAS	CANN	CPU	CUDA	ET	HTP	MTL	OpenCL	SYCL	Vulkan	WebGPU	ZenDNN	zDNN
ABS	❌	✅	✅	🟡	🟡	🟡	✅	❌	✅	✅	✅	❌	❌
ACC	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
ADD	❌	✅	✅	✅	🟡	🟡	🟡	✅	✅	✅	✅	❌	❌
ADD1	❌	✅	✅	✅	❌	❌	❌	❌	❌	❌	❌	❌	❌
ADD_ID	❌	❌	✅	✅	❌	✅	✅	✅	✅	✅	✅	❌	❌
ARANGE	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
ARGMAX	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	✅	❌	❌
ARGSORT	❌	✅	✅	✅	❌	🟡	✅	🟡	✅	✅	✅	❌	❌
CEIL	❌	❌	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
CLAMP	❌	✅	✅	✅	🟡	🟡	✅	🟡	✅	✅	✅	❌	❌
COL2IM_1D	❌	❌	❌	❌	❌	❌	❌	❌	✅	✅	❌	❌	❌
CONCAT	❌	✅	✅	🟡	🟡	🟡	✅	🟡	✅	✅	🟡	❌	❌
CONT	❌	🟡	✅	✅	🟡	🟡	✅	🟡	✅	✅	🟡	❌	❌
CONV_2D	❌	❌	✅	✅	❌	❌	✅	✅	✅	🟡	✅	❌	❌
CONV_2D_DW	❌	❌	✅	✅	❌	❌	❌	❌	✅	✅	✅	❌	❌
CONV_3D	❌	❌	✅	❌	❌	❌	✅	❌	✅	✅	❌	❌	❌
CONV_TRANSPOSE_1D	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
CONV_TRANSPOSE_2D	❌	❌	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
COS	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	✅	❌	❌
COUNT_EQUAL	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
CPY	❌	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	❌	❌
CROSS_ENTROPY_LOSS	❌	✅	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
CROSS_ENTROPY_LOSS_BACK	❌	❌	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
CUMSUM	❌	❌	✅	✅	✅	✅	✅	❌	✅	✅	✅	❌	❌
DIAG	❌	❌	✅	✅	🟡	✅	✅	❌	✅	✅	✅	❌	❌
DIAG_MASK_INF	❌	✅	✅	✅	❌	❌	❌	🟡	✅	✅	❌	❌	❌
DIV	❌	✅	✅	✅	❌	🟡	🟡	✅	✅	✅	✅	❌	❌
DSV4_HC_COMB	❌	❌	❌	❌	❌	❌	❌	❌	✅	❌	❌	❌	❌
DSV4_HC_POST	❌	❌	❌	❌	❌	❌	❌	❌	✅	❌	❌	❌	❌
DSV4_HC_PRE	❌	❌	❌	❌	❌	❌	❌	❌	✅	❌	❌	❌	❌
DUP	❌	✅	✅	🟡	❌	❌	🟡	🟡	✅	✅	❌	❌	❌
ELU	❌	✅	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
EXP	❌	✅	✅	🟡	🟡	🟡	✅	❌	✅	✅	✅	❌	❌
EXPM1	❌	❌	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
FILL	❌	❌	✅	✅	🟡	✅	✅	❌	✅	✅	✅	❌	❌
FLASH_ATTN_EXT	❌	🟡	✅	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	❌	❌
FLOOR	❌	❌	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
GATED_DELTA_NET	❌	❌	✅	❌	✅	✅	🟡	❌	✅	✅	✅	❌	❌
GATED_LINEAR_ATTN	❌	✅	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
GEGLU	❌	✅	✅	✅	🟡	🟡	🟡	✅	✅	✅	✅	❌	❌
GEGLU_ERF	❌	✅	✅	✅	🟡	❌	🟡	✅	✅	✅	✅	❌	❌
GEGLU_QUICK	❌	✅	✅	✅	🟡	❌	🟡	✅	✅	✅	✅	❌	❌
GELU	❌	✅	✅	🟡	🟡	🟡	✅	🟡	✅	✅	✅	❌	❌
GELU_ERF	❌	✅	✅	🟡	🟡	❌	✅	🟡	✅	✅	✅	❌	❌
GELU_QUICK	❌	✅	✅	🟡	🟡	🟡	✅	🟡	✅	✅	✅	❌	❌
GET_ROWS	❌	🟡	✅	🟡	🟡	🟡	🟡	🟡	🟡	✅	🟡	❌	❌
GET_ROWS_BACK	❌	❌	🟡	🟡	❌	❌	❌	❌	❌	🟡	❌	❌	❌
GROUP_NORM	❌	✅	✅	✅	✅	❌	✅	✅	✅	✅	❌	❌	❌
HARDSIGMOID	❌	✅	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
HARDSWISH	❌	✅	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
IM2COL	❌	✅	✅	✅	✅	🟡	✅	✅	✅	✅	✅	❌	❌
IM2COL_3D	❌	❌	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
L2_NORM	❌	✅	✅	✅	🟡	🟡	✅	❌	✅	✅	🟡	❌	❌
LEAKY_RELU	❌	✅	✅	✅	❌	❌	🟡	❌	✅	✅	❌	❌	❌
LIGHTNING_INDEXER	❌	❌	❌	❌	❌	❌	❌	❌	✅	❌	❌	❌	❌
LOG	❌	✅	✅	✅	❌	🟡	✅	❌	✅	✅	✅	❌	❌
MEAN	❌	✅	✅	✅	✅	❌	✅	✅	✅	✅	❌	❌	❌
MUL	❌	✅	✅	✅	🟡	🟡	🟡	✅	✅	✅	✅	❌	❌
MUL_MAT	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡	🟡
MUL_MAT_HADAMARD	❌	❌	❌	❌	✅	✅	❌	❌	✅	✅	✅	❌	❌
MUL_MAT_ID	❌	🟡	✅	✅	🟡	🟡	🟡	🟡	✅	✅	🟡	🟡	❌
NEG	❌	✅	✅	🟡	🟡	🟡	✅	❌	✅	✅	✅	❌	❌
NORM	❌	✅	✅	✅	🟡	🟡	✅	✅	✅	✅	🟡	❌	❌
OPT_STEP_ADAMW	❌	❌	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
OPT_STEP_SGD	❌	❌	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
OUT_PROD	🟡	🟡	🟡	🟡	❌	❌	❌	❌	🟡	🟡	❌	❌	🟡
PAD	❌	🟡	✅	🟡	❌	✅	🟡	🟡	🟡	✅	✅	❌	❌
PAD_REFLECT_1D	❌	✅	✅	✅	❌	❌	✅	❌	✅	❌	❌	❌	❌
POOL_1D	❌	❌	✅	❌	❌	❌	✅	❌	✅	✅	❌	❌	❌
POOL_2D	❌	🟡	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
REGLU	❌	✅	✅	✅	🟡	❌	🟡	✅	✅	✅	✅	❌	❌
RELU	❌	✅	✅	🟡	🟡	❌	✅	🟡	✅	✅	✅	❌	❌
REPEAT	❌	✅	✅	🟡	🟡	🟡	✅	🟡	✅	✅	🟡	❌	❌
REPEAT_BACK	❌	❌	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
RMS_NORM	❌	✅	✅	✅	🟡	✅	✅	✅	✅	✅	✅	❌	❌
RMS_NORM_BACK	❌	❌	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
ROLL	❌	❌	✅	✅	❌	❌	✅	❌	✅	✅	❌	❌	❌
ROPE	❌	✅	✅	✅	🟡	🟡	✅	✅	✅	✅	✅	❌	❌
ROPE_BACK	❌	❌	✅	✅	❌	❌	❌	❌	✅	✅	❌	❌	❌
ROUND	❌	❌	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
RWKV_WKV6	❌	❌	✅	✅	✅	❌	✅	❌	✅	✅	❌	❌	❌
RWKV_WKV7	❌	❌	✅	✅	✅	❌	✅	❌	✅	✅	❌	❌	❌
SCALE	❌	🟡	✅	✅	✅	✅	✅	✅	✅	✅	✅	❌	❌
SET	❌	❌	✅	✅	❌	❌	✅	❌	🟡	✅	✅	❌	❌
SET_ROWS	❌	🟡	🟡	🟡	🟡	🟡	🟡	🟡	✅	🟡	🟡	❌	❌
SGN	❌	✅	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
SIGMOID	❌	✅	✅	🟡	🟡	🟡	✅	🟡	✅	✅	✅	❌	❌
SILU	❌	✅	✅	🟡	🟡	🟡	✅	🟡	✅	✅	✅	❌	❌
SILU_BACK	❌	❌	✅	✅	❌	❌	❌	❌	❌	✅	❌	❌	❌
SIN	❌	✅	✅	✅	❌	❌	✅	❌	✅	✅	✅	❌	❌
SOFTPLUS	❌	❌	✅	🟡	🟡	🟡	✅	❌	✅	✅	✅	❌	❌
SOFT_MAX	❌	🟡	✅	✅	🟡	🟡	✅	✅	✅	✅	✅	❌	❌
SOFT_MAX_BACK	❌	❌	🟡	🟡	❌	❌	❌	❌	🟡	✅	❌	❌	❌
SOLVE_TRI	❌	❌	✅	🟡	🟡	✅	✅	❌	🟡	✅	✅	❌	❌
SQR	❌	✅	✅	✅	🟡	🟡	✅	✅	✅	✅	✅	❌	❌
SQRT	❌	✅	✅	✅	❌	🟡	✅	✅	✅	✅	✅	❌	❌
SSM_CONV	❌	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	❌	❌
SSM_SCAN	❌	❌	✅	✅	✅	❌	✅	❌	🟡	🟡	✅	❌	❌
STEP	❌	✅	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
SUB	❌	✅	✅	✅	🟡	🟡	🟡	✅	✅	✅	✅	❌	❌
SUM	❌	🟡	✅	🟡	❌	❌	🟡	❌	🟡	🟡	🟡	❌	❌
SUM_ROWS	❌	✅	✅	🟡	❌	🟡	✅	🟡	🟡	✅	✅	❌	❌
SWIGLU	❌	✅	✅	✅	🟡	🟡	🟡	✅	✅	✅	✅	❌	❌
SWIGLU_CLAMP	❌	❌	❌	❌	❌	🟡	❌	❌	❌	❌	❌	❌	❌
SWIGLU_OAI	❌	❌	✅	✅	✅	✅	✅	✅	✅	✅	✅	❌	❌
TANH	❌	✅	✅	🟡	🟡	🟡	✅	✅	✅	✅	✅	❌	❌
TIMESTEP_EMBEDDING	❌	✅	✅	✅	❌	❌	✅	✅	✅	✅	❌	❌	❌
TOP_K	❌	❌	✅	❌	❌	❌	✅	❌	🟡	🟡	✅	❌	❌
TRI	❌	❌	✅	✅	✅	✅	✅	❌	✅	✅	✅	❌	❌
TRUNC	❌	❌	✅	🟡	🟡	❌	✅	❌	✅	✅	✅	❌	❌
UPSCALE	❌	🟡	✅	✅	❌	❌	✅	🟡	✅	✅	✅	❌	❌
XIELU	❌	❌	✅	❌	❌	❌	✅	❌	✅	✅	✅	❌	❌

1# GGML Operations
2
3List of GGML operations and backend support status.
4
5## How to add a backend to this table:
6
71. Run `test-backend-ops support --output csv` with your backend name and redirect output to a csv file in `docs/ops/` (e.g., `docs/ops/CUDA.csv`)
82. Regenerate `/docs/ops.md` via `./scripts/create_ops_docs.py`
9
10Legend:
11- ✅ Fully supported by this backend
12- 🟡 Partially supported by this backend
13- ❌ Not supported by this backend
14
15| Operation | BLAS | CANN | CPU | CUDA | ET | HTP | MTL | OpenCL | SYCL | Vulkan | WebGPU | ZenDNN | zDNN |
16|-----------|------|------|------|------|------|------|------|------|------|------|------|------|------|
17|                              ABS | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
18|                              ACC | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
19|                              ADD | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
20|                             ADD1 | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ |
21|                           ADD_ID | ❌ | ❌ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
22|                           ARANGE | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
23|                           ARGMAX | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
24|                          ARGSORT | ❌ | ✅ | ✅ | ✅ | ❌ | 🟡 | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
25|                             CEIL | ❌ | ❌ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
26|                            CLAMP | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
27|                        COL2IM_1D | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
28|                           CONCAT | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | 🟡 | ❌ | ❌ |
29|                             CONT | ❌ | 🟡 | ✅ | ✅ | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | 🟡 | ❌ | ❌ |
30|                          CONV_2D | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | 🟡 | ✅ | ❌ | ❌ |
31|                       CONV_2D_DW | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
32|                          CONV_3D | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
33|                CONV_TRANSPOSE_1D | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
34|                CONV_TRANSPOSE_2D | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
35|                              COS | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
36|                      COUNT_EQUAL | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
37|                              CPY | ❌ | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | ❌ | ❌ |
38|               CROSS_ENTROPY_LOSS | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
39|          CROSS_ENTROPY_LOSS_BACK | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
40|                           CUMSUM | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
41|                             DIAG | ❌ | ❌ | ✅ | ✅ | 🟡 | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
42|                    DIAG_MASK_INF | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | 🟡 | ✅ | ✅ | ❌ | ❌ | ❌ |
43|                              DIV | ❌ | ✅ | ✅ | ✅ | ❌ | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
44|                     DSV4_HC_COMB | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ |
45|                     DSV4_HC_POST | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ |
46|                      DSV4_HC_PRE | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ |
47|                              DUP | ❌ | ✅ | ✅ | 🟡 | ❌ | ❌ | 🟡 | 🟡 | ✅ | ✅ | ❌ | ❌ | ❌ |
48|                              ELU | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
49|                              EXP | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
50|                            EXPM1 | ❌ | ❌ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
51|                             FILL | ❌ | ❌ | ✅ | ✅ | 🟡 | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
52|                   FLASH_ATTN_EXT | ❌ | 🟡 | ✅ | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | ❌ | ❌ |
53|                            FLOOR | ❌ | ❌ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
54|                  GATED_DELTA_NET | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | 🟡 | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
55|                GATED_LINEAR_ATTN | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
56|                            GEGLU | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
57|                        GEGLU_ERF | ❌ | ✅ | ✅ | ✅ | 🟡 | ❌ | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
58|                      GEGLU_QUICK | ❌ | ✅ | ✅ | ✅ | 🟡 | ❌ | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
59|                             GELU | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
60|                         GELU_ERF | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
61|                       GELU_QUICK | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
62|                         GET_ROWS | ❌ | 🟡 | ✅ | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ❌ | ❌ |
63|                    GET_ROWS_BACK | ❌ | ❌ | 🟡 | 🟡 | ❌ | ❌ | ❌ | ❌ | ❌ | 🟡 | ❌ | ❌ | ❌ |
64|                       GROUP_NORM | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ |
65|                      HARDSIGMOID | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
66|                        HARDSWISH | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
67|                           IM2COL | ❌ | ✅ | ✅ | ✅ | ✅ | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
68|                        IM2COL_3D | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
69|                          L2_NORM | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | ✅ | ❌ | ✅ | ✅ | 🟡 | ❌ | ❌ |
70|                       LEAKY_RELU | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | 🟡 | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
71|                LIGHTNING_INDEXER | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ |
72|                              LOG | ❌ | ✅ | ✅ | ✅ | ❌ | 🟡 | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
73|                             MEAN | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ |
74|                              MUL | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
75|                          MUL_MAT | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 |
76|                 MUL_MAT_HADAMARD | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
77|                       MUL_MAT_ID | ❌ | 🟡 | ✅ | ✅ | 🟡 | 🟡 | 🟡 | 🟡 | ✅ | ✅ | 🟡 | 🟡 | ❌ |
78|                              NEG | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
79|                             NORM | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | 🟡 | ❌ | ❌ |
80|                   OPT_STEP_ADAMW | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
81|                     OPT_STEP_SGD | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
82|                         OUT_PROD | 🟡 | 🟡 | 🟡 | 🟡 | ❌ | ❌ | ❌ | ❌ | 🟡 | 🟡 | ❌ | ❌ | 🟡 |
83|                              PAD | ❌ | 🟡 | ✅ | 🟡 | ❌ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ❌ | ❌ |
84|                   PAD_REFLECT_1D | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ |
85|                          POOL_1D | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
86|                          POOL_2D | ❌ | 🟡 | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
87|                            REGLU | ❌ | ✅ | ✅ | ✅ | 🟡 | ❌ | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
88|                             RELU | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
89|                           REPEAT | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | 🟡 | ❌ | ❌ |
90|                      REPEAT_BACK | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
91|                         RMS_NORM | ❌ | ✅ | ✅ | ✅ | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
92|                    RMS_NORM_BACK | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
93|                             ROLL | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
94|                             ROPE | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
95|                        ROPE_BACK | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
96|                            ROUND | ❌ | ❌ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
97|                        RWKV_WKV6 | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
98|                        RWKV_WKV7 | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ |
99|                            SCALE | ❌ | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
100|                              SET | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | 🟡 | ✅ | ✅ | ❌ | ❌ |
101|                         SET_ROWS | ❌ | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | 🟡 | ❌ | ❌ |
102|                              SGN | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
103|                          SIGMOID | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
104|                             SILU | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
105|                        SILU_BACK | ❌ | ❌ | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ |
106|                              SIN | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
107|                         SOFTPLUS | ❌ | ❌ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
108|                         SOFT_MAX | ❌ | 🟡 | ✅ | ✅ | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
109|                    SOFT_MAX_BACK | ❌ | ❌ | 🟡 | 🟡 | ❌ | ❌ | ❌ | ❌ | 🟡 | ✅ | ❌ | ❌ | ❌ |
110|                        SOLVE_TRI | ❌ | ❌ | ✅ | 🟡 | 🟡 | ✅ | ✅ | ❌ | 🟡 | ✅ | ✅ | ❌ | ❌ |
111|                              SQR | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
112|                             SQRT | ❌ | ✅ | ✅ | ✅ | ❌ | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
113|                         SSM_CONV | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
114|                         SSM_SCAN | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | 🟡 | 🟡 | ✅ | ❌ | ❌ |
115|                             STEP | ❌ | ✅ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
116|                              SUB | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
117|                              SUM | ❌ | 🟡 | ✅ | 🟡 | ❌ | ❌ | 🟡 | ❌ | 🟡 | 🟡 | 🟡 | ❌ | ❌ |
118|                         SUM_ROWS | ❌ | ✅ | ✅ | 🟡 | ❌ | 🟡 | ✅ | 🟡 | 🟡 | ✅ | ✅ | ❌ | ❌ |
119|                           SWIGLU | ❌ | ✅ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
120|                     SWIGLU_CLAMP | ❌ | ❌ | ❌ | ❌ | ❌ | 🟡 | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ |
121|                       SWIGLU_OAI | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
122|                             TANH | ❌ | ✅ | ✅ | 🟡 | 🟡 | 🟡 | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ |
123|               TIMESTEP_EMBEDDING | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ |
124|                            TOP_K | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ✅ | ❌ | 🟡 | 🟡 | ✅ | ❌ | ❌ |
125|                              TRI | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
126|                            TRUNC | ❌ | ❌ | ✅ | 🟡 | 🟡 | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |
127|                          UPSCALE | ❌ | 🟡 | ✅ | ✅ | ❌ | ❌ | ✅ | 🟡 | ✅ | ✅ | ✅ | ❌ | ❌ |
128|                            XIELU | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | ❌ |