 Daniel Hiltgen
|
7555ea44f8
Revamp the dynamic library shim
|
il y a 1 an |
|
Daniel Hiltgen
|
54dbfa4c4a
Carry ggml-metal.metal as payload
|
il y a 1 an |
|
Daniel Hiltgen
|
35934b2e05
Adapted rocm support to cgo based llama.cpp
|
il y a 1 an |
|
Daniel Hiltgen
|
d4cd695759
Add cgo implementation for llama.cpp
|
il y a 1 an |
 Bruce MacDonald
|
811b1f03c8
deprecate ggml
|
il y a 1 an |
|
Bruce MacDonald
|
6ee8c80199
restore model load duration on generate response (#1524)
|
il y a 1 an |
|
Bruce MacDonald
|
3144e2a439
exponential back-off (#1484)
|
il y a 1 an |
|
Bruce MacDonald
|
c0960e29b5
retry on concurrent request failure (#1483)
|
il y a 1 an |
 Patrick Devine
|
910e9401d0
Multimodal support (#1216)
|
il y a 1 an |
 Jeffrey Morgan
|
fa2f095bd9
fix model name returned by `/api/generate` being different than the model name provided
|
il y a 1 an |
|
Jeffrey Morgan
|
2dd040d04c
do not use `--parallel 2` for old runners
|
il y a 1 an |
|
Bruce MacDonald
|
bbe41ce41a
fix: parallel queueing race condition caused silent failure (#1445)
|
il y a 1 an |
 Michael Yang
|
b9495ea162
load projectors
|
il y a 1 an |
|
Bruce MacDonald
|
195e3d9dbd
chat api endpoint (#1392)
|
il y a 1 an |
|
Jeffrey Morgan
|
00d06619a1
Revert "chat api (#991)" while context variable is fixed
|
il y a 1 an |
|
Bruce MacDonald
|
7a0899d62d
chat api (#991)
|
il y a 1 an |
 Jing Zhang
|
82b9b329ff
windows CUDA support (#1262)
|
il y a 1 an |
|
Jeffrey Morgan
|
a3fcecf943
only set `main_gpu` if value > 0 is provided
|
il y a 1 an |
 Purinda Gunasekara
|
be61a81758
main-gpu argument is not getting passed to llamacpp, fixed. (#1192)
|
il y a 1 an |
|
Jeffrey Morgan
|
36a3bbf65f
Update llm/llama.go
|
il y a 1 an |
|
Bruce MacDonald
|
43a726149d
fix potentially inaccurate error message
|
il y a 1 an |
|
Jeffrey Morgan
|
41434a7cdc
build intel mac with correct binary and compile flags
|
il y a 1 an |
|
Jeffrey Morgan
|
5cba29b9d6
JSON mode: add `"format" as an api parameter (#1051)
|
il y a 1 an |
|
Bruce MacDonald
|
1ae84bc2a2
skip gpu if less than 2GB VRAM are available (#1059)
|
il y a 1 an |
|
Jeffrey Morgan
|
c44b619428
remove unused `fmt.Println`
|
il y a 1 an |
|
Jeffrey Morgan
|
17678b7225
Restore system prompt on requests and default `num_keep` to `0`
|
il y a 1 an |
|
Jeffrey Morgan
|
2e53704685
default rope params to 0 for new models (#968)
|
il y a 1 an |
|
Michael Yang
|
642128b75a
append LD_LIBRARY_PATH
|
il y a 1 an |
|
Bruce MacDonald
|
6d283882b1
catch insufficient permissions nvidia err (#934)
|
il y a 1 an |
|
Bruce MacDonald
|
2665f3c28e
offload 75% of available vram to improve stability (#921)
|
il y a 1 an |
