Commit History

Autor SHA1 Mensaxe Data
  Jesse Gross f66216e399 ggml: Support heterogeneous KV cache layer sizes in memory estimation hai 1 mes
  Parth Sareen 314573bfe8 config: allow setting context length through env var (#8938) hai 2 meses
  Michael Yang 58245413f4 next ollama runner (#7913) hai 2 meses
  Stefan Weil abfdc4710f all: fix typos in documentation, code, and comments (#7021) hai 4 meses
  Sam 1bdab9fdb1 llm: introduce k/v context quantization (vRAM improvements) (#6279) hai 5 meses
  Daniel Hiltgen 05cd82ef94 Rename gpu package discover (#7143) hai 6 meses
  Michael Yang 77903ab8b4 llama3.1 hai 9 meses
  Michael Yang b732beba6a lint hai 9 meses
  Michael Yang df993fa37b comments hai 9 meses
  Michael Yang 5e9db9fb0b refactor convert hai 11 meses
  Michael Yang 35b89b2eab rfc: dynamic environ lookup hai 10 meses
  Blake Mizerany cb42e607c5 llm: speed up gguf decoding by a lot (#5246) hai 10 meses
  Daniel Hiltgen 6f351bf586 review comments and coverage hai 11 meses
  Daniel Hiltgen 6fd04ca922 Improve multi-gpu handling at the limit hai 11 meses