Historique des commits

Auteur SHA1 Message Date
  Daniel Hiltgen 34b9db5afc Request and model concurrency il y a 1 an
  Michael Yang 7e33a017c0 partial offloading il y a 1 an
  Michael Yang 91b3e4d282 update memory calcualtions il y a 1 an
  Daniel Hiltgen 6d84f07505 Detect AMD GPU info via sysfs and block old cards il y a 1 an
  Daniel Hiltgen 8da7bef05f Support multiple variants for a given llm lib type il y a 1 an
  Jeffrey Morgan c336693f07 calculate overhead based number of gpu devices (#1875) il y a 1 an
  Daniel Hiltgen a2ad952440 Fix windows system memory lookup il y a 1 an
  Daniel Hiltgen d966b730ac Switch windows build to fully dynamic il y a 1 an
  Daniel Hiltgen 7555ea44f8 Revamp the dynamic library shim il y a 1 an
  Daniel Hiltgen 35934b2e05 Adapted rocm support to cgo based llama.cpp il y a 1 an