Jeffrey Morgan
|
be721ca0df
add more search paths for cuda libs
|
1 år sedan |
Jeffrey Morgan
|
c336693f07
calculate overhead based number of gpu devices (#1875)
|
1 år sedan |
Daniel Hiltgen
|
d74ce6bd4f
Detect very old CUDA GPUs and fall back to CPU
|
1 år sedan |
Jeffrey Morgan
|
1caa56128f
add cuda lib path for nvidia container toolkit
|
1 år sedan |
Jeffrey Morgan
|
df32537312
gpu: read memory info from all cuda devices (#1802)
|
1 år sedan |
Daniel Hiltgen
|
a2ad952440
Fix windows system memory lookup
|
1 år sedan |
Daniel Hiltgen
|
1d1eb1688c
Additional nvidial-ml path to check
|
1 år sedan |
Daniel Hiltgen
|
5646826a79
Add WSL2 path to nvidia-ml.so library
|
1 år sedan |
Daniel Hiltgen
|
1b991d0ba9
Refine build to support CPU only
|
1 år sedan |
Daniel Hiltgen
|
35934b2e05
Adapted rocm support to cgo based llama.cpp
|
1 år sedan |