Jeffrey Morgan
|
c336693f07
calculate overhead based number of gpu devices (#1875)
|
1 gadu atpakaļ |
Jeffrey Morgan
|
08f1e18965
Offload layers to GPU based on new model size estimates (#1850)
|
1 gadu atpakaļ |
Jeffrey Morgan
|
c7ea8f237e
set `num_gpu` to 1 only by default on darwin arm64 (#1771)
|
1 gadu atpakaļ |
Daniel Hiltgen
|
a2ad952440
Fix windows system memory lookup
|
1 gadu atpakaļ |
Daniel Hiltgen
|
d966b730ac
Switch windows build to fully dynamic
|
1 gadu atpakaļ |
Daniel Hiltgen
|
7555ea44f8
Revamp the dynamic library shim
|
1 gadu atpakaļ |
Daniel Hiltgen
|
6558f94ed0
Fix darwin intel build
|
1 gadu atpakaļ |
Daniel Hiltgen
|
35934b2e05
Adapted rocm support to cgo based llama.cpp
|
1 gadu atpakaļ |