Commit History

Autor SHA1 Mensaxe Data
  Daniel Hiltgen 434dfe30c5 Reintroduce nvidia nvml library for windows hai 11 meses
  Wang,Zhe fd5971be0b support ollama run on Intel GPUs hai 11 meses
  Daniel Hiltgen 8727a9c140 Record more GPU information hai 1 ano
  Daniel Hiltgen 089daaeabc Add CUDA Driver API for GPU discovery hai 1 ano
  Daniel Hiltgen 34b9db5afc Request and model concurrency hai 1 ano
  Jeremy dfc6721b20 add support for libcudart.so for CUDA devices (adds Jetson support) hai 1 ano
  Daniel Hiltgen 6c5ccb11f9 Revamp ROCm support hai 1 ano
  Daniel Hiltgen 9d7b5d6c91 Ignore AMD integrated GPUs hai 1 ano
  Daniel Hiltgen 987c16b2f7 Report more information about GPUs in verbose mode hai 1 ano
  Jeffrey Morgan c336693f07 calculate overhead based number of gpu devices (#1875) hai 1 ano
  Daniel Hiltgen a2ad952440 Fix windows system memory lookup hai 1 ano
  Daniel Hiltgen 35934b2e05 Adapted rocm support to cgo based llama.cpp hai 1 ano