Commit History

Author SHA1 Message Date
  Daniel Hiltgen 34b9db5afc Request and model concurrency 1 year ago
  Jeremy dfc6721b20 add support for libcudart.so for CUDA devices (adds Jetson support) 1 year ago
  Daniel Hiltgen 6c5ccb11f9 Revamp ROCm support 1 year ago
  Daniel Hiltgen 9d7b5d6c91 Ignore AMD integrated GPUs 1 year ago
  Daniel Hiltgen 987c16b2f7 Report more information about GPUs in verbose mode 1 year ago
  Jeffrey Morgan c336693f07 calculate overhead based number of gpu devices (#1875) 1 year ago
  Daniel Hiltgen a2ad952440 Fix windows system memory lookup 1 year ago
  Daniel Hiltgen 35934b2e05 Adapted rocm support to cgo based llama.cpp 1 year ago