| .. |
|
ext_server
|
e04c7012c2
update llama.cpp submodule to `1e6f6554` (#6208)
|
8 months ago |
|
generate
|
283948c83b
Adjust windows ROCm discovery
|
9 months ago |
|
llama.cpp @ 1e6f6554aa
|
e04c7012c2
update llama.cpp submodule to `1e6f6554` (#6208)
|
8 months ago |
|
patches
|
e04c7012c2
update llama.cpp submodule to `1e6f6554` (#6208)
|
8 months ago |
|
filetype.go
|
d6f692ad1a
Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)
|
11 months ago |
|
ggla.go
|
6b252918fb
update convert test to check result data
|
9 months ago |
|
ggml.go
|
6b252918fb
update convert test to check result data
|
9 months ago |
|
ggml_test.go
|
cb42e607c5
llm: speed up gguf decoding by a lot (#5246)
|
10 months ago |
|
gguf.go
|
df993fa37b
comments
|
9 months ago |
|
llm.go
|
b732beba6a
lint
|
9 months ago |
|
llm_darwin_amd64.go
|
e12fff8810
Enable windows error dialog for subprocess startup
|
9 months ago |
|
llm_darwin_arm64.go
|
e12fff8810
Enable windows error dialog for subprocess startup
|
9 months ago |
|
llm_linux.go
|
e12fff8810
Enable windows error dialog for subprocess startup
|
9 months ago |
|
llm_windows.go
|
e12fff8810
Enable windows error dialog for subprocess startup
|
9 months ago |
|
memory.go
|
69207b4987
fix memory
|
8 months ago |
|
memory_test.go
|
69207b4987
fix memory
|
8 months ago |
|
payload.go
|
0e982bc1f4
Fix corner cases on tmp cleaner on mac
|
10 months ago |
|
server.go
|
f457d63400
Implement linux NUMA detection
|
8 months ago |
|
status.go
|
4d71c559b2
fix error detection by limiting model loading error parsing (#5472)
|
10 months ago |
Michael Yang
69207b4987
fix memory