Josh Yan 0e1ec461f9 import 8 months ago
..
ext_server 90ca84172c Fix embeddings memory corruption (#6467) 8 months ago
generate 0b03b9c32f llm: Align cmake define for cuda no peer copy (#6455) 8 months ago
llama.cpp @ 1e6f6554aa e04c7012c2 update llama.cpp submodule to `1e6f6554` (#6208) 8 months ago
patches 90ca84172c Fix embeddings memory corruption (#6467) 8 months ago
filetype.go d6f692ad1a Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322) 11 months ago
ggla.go 6b252918fb update convert test to check result data 9 months ago
ggml.go 0c819e167b convert safetensor adapters into GGUF (#6327) 8 months ago
ggml_test.go cb42e607c5 llm: speed up gguf decoding by a lot (#5246) 10 months ago
gguf.go 0e1ec461f9 import 8 months ago
llm.go b732beba6a lint 9 months ago
llm_darwin_amd64.go e12fff8810 Enable windows error dialog for subprocess startup 9 months ago
llm_darwin_arm64.go e12fff8810 Enable windows error dialog for subprocess startup 9 months ago
llm_linux.go e12fff8810 Enable windows error dialog for subprocess startup 9 months ago
llm_windows.go e12fff8810 Enable windows error dialog for subprocess startup 9 months ago
memory.go 8e0641a9bf handle asymmetric embedding KVs 10 months ago
memory_test.go 01b20fe6f1 lint 8 months ago
payload.go d470ebe78b Add Jetson cuda variants for arm 8 months ago
server.go 397cae7962 llm: fix typo in comment (#6530) 8 months ago
status.go 04210aa6dd Catch one more error log 8 months ago