 Jeffrey Morgan
|
5b4837f881
remove unused filetype check
|
hai 1 ano |
 Daniel Hiltgen
|
7555ea44f8
Revamp the dynamic library shim
|
hai 1 ano |
|
Daniel Hiltgen
|
3269535a4c
Refine handling of shim presence
|
hai 1 ano |
|
Daniel Hiltgen
|
35934b2e05
Adapted rocm support to cgo based llama.cpp
|
hai 1 ano |
|
Daniel Hiltgen
|
d4cd695759
Add cgo implementation for llama.cpp
|
hai 1 ano |
 Bruce MacDonald
|
811b1f03c8
deprecate ggml
|
hai 1 ano |
 Michael Yang
|
b9495ea162
load projectors
|
hai 1 ano |
|
Bruce MacDonald
|
195e3d9dbd
chat api endpoint (#1392)
|
hai 1 ano |
|
Jeffrey Morgan
|
00d06619a1
Revert "chat api (#991)" while context variable is fixed
|
hai 1 ano |
|
Bruce MacDonald
|
7a0899d62d
chat api (#991)
|
hai 1 ano |
|
Michael Yang
|
19b7a4d715
recent llama.cpp update added kernels for fp32, q5_0, and q5_1
|
hai 1 ano |
|
Jeffrey Morgan
|
5cba29b9d6
JSON mode: add `"format" as an api parameter (#1051)
|
hai 1 ano |
|
Jeffrey Morgan
|
2e53704685
default rope params to 0 for new models (#968)
|
hai 1 ano |
|
Jeffrey Morgan
|
7ed5a39bc7
simpler check for model loading compatibility errors
|
hai 1 ano |
|
Jeffrey Morgan
|
a7dad24d92
add error for `falcon` and `starcoder` vocab compatibility (#844)
|
hai 1 ano |
|
Michael Yang
|
36fe2deebf
only check system memory on macos
|
hai 1 ano |
|
Michael Yang
|
4a8931f634
check total (system + video) memory
|
hai 1 ano |
|
Michael Yang
|
bd6e38fb1a
refactor memory check
|
hai 1 ano |
|
Michael Yang
|
92189a5855
fix memory check
|
hai 1 ano |
|
Michael Yang
|
b599946b74
add format bytes
|
hai 1 ano |
|
Bruce MacDonald
|
d06bc0cb6e
enable q8, q5, 5_1, and f32 for linux gpu (#699)
|
hai 1 ano |
|
Bruce MacDonald
|
86279f4ae3
unbound max num gpu layers (#591)
|
hai 1 ano |
|
Bruce MacDonald
|
4cba75efc5
remove tmp directories created by previous servers (#559)
|
hai 1 ano |
|
Michael Yang
|
7dee25a07f
fix falcon decode
|
hai 1 ano |
|
Bruce MacDonald
|
09dd2aeff9
GGUF support (#441)
|
hai 1 ano |
|
Bruce MacDonald
|
42998d797d
subprocess llama.cpp server (#401)
|
hai 1 ano |
|
Michael Yang
|
b25dd1795d
allow F16 to use metal
|
hai 1 ano |
|
Michael Yang
|
304f2b6c96
add 34b to mem check
|
hai 1 ano |
|
Michael Yang
|
a894cc792d
model and file type as strings
|
hai 1 ano |
|
Michael Yang
|
e26085b921
close open files
|
hai 1 ano |
