Historique des commits

Auteur SHA1 Message Date
  Daniel Hiltgen 20f6c06569 Make maximum pending request configurable il y a 1 an
  Mark Ward 63c763685f log when the waiting for the process to stop to help debug when other tasks execute during this wait. il y a 1 an
  Mark Ward f4a73d57a4 fix runner expire during active use. Clearing the expire timer as it is used. Allowing the finish to assign an expire timer so that the runner will expire after no use. il y a 1 an
  Daniel Hiltgen d6e3b64582 Fix concurrency for CPU mode il y a 1 an
  Daniel Hiltgen 9b5a3c5991 Merge pull request #3914 from dhiltgen/mac_perf il y a 1 an
  Jeffrey Morgan 00b0699c75 Reload model if `num_gpu` changes (#3920) il y a 1 an
  Daniel Hiltgen b123be5b71 Adjust context size for parallelism il y a 1 an
  Bryce Reitano 36a6daccab Restructure loading conditional chain il y a 1 an
  Bryce Reitano 284e02bed0 Move ggml loading to when we attempt fitting il y a 1 an
  Daniel Hiltgen 34b9db5afc Request and model concurrency il y a 1 an