Roy Han 23d5beeb9c input 9 months ago
..
ext_server 23d5beeb9c input 9 months ago
generate 4607c70641 llm: add `-DBUILD_SHARED_LIBS=off` to common cpu cmake flags (#5520) 9 months ago
llama.cpp @ a8db2a9ce6 571dc61955 Update llama.cpp submodule to `a8db2a9c` (#5530) 9 months ago
patches 571dc61955 Update llama.cpp submodule to `a8db2a9c` (#5530) 9 months ago
filetype.go d6f692ad1a Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322) 11 months ago
ggla.go cb42e607c5 llm: speed up gguf decoding by a lot (#5246) 10 months ago
ggml.go de2163dafd gemma2 graph 10 months ago
ggml_test.go cb42e607c5 llm: speed up gguf decoding by a lot (#5246) 10 months ago
gguf.go cb42e607c5 llm: speed up gguf decoding by a lot (#5246) 10 months ago
llm.go b51e3b63ac Statically link c++ and thread lib 9 months ago
llm_darwin_amd64.go 58d95cc9bd Switch back to subprocessing for llama.cpp 1 year ago
llm_darwin_arm64.go 58d95cc9bd Switch back to subprocessing for llama.cpp 1 year ago
llm_linux.go 58d95cc9bd Switch back to subprocessing for llama.cpp 1 year ago
llm_windows.go 058f6cd2cc Move nested payloads to installer and zip file on windows 1 year ago
memory.go 8e0641a9bf handle asymmetric embedding KVs 10 months ago
memory_test.go cb42e607c5 llm: speed up gguf decoding by a lot (#5246) 10 months ago
payload.go 0e982bc1f4 Fix corner cases on tmp cleaner on mac 10 months ago
server.go eb7cc2d1ce image embeddings 9 months ago
status.go 4d71c559b2 fix error detection by limiting model loading error parsing (#5472) 10 months ago