Jesse Gross
|
f66216e399
ggml: Support heterogeneous KV cache layer sizes in memory estimation
|
1 개월 전 |
Parth Sareen
|
314573bfe8
config: allow setting context length through env var (#8938)
|
2 달 전 |
Michael Yang
|
58245413f4
next ollama runner (#7913)
|
2 달 전 |
Stefan Weil
|
abfdc4710f
all: fix typos in documentation, code, and comments (#7021)
|
4 달 전 |
Sam
|
1bdab9fdb1
llm: introduce k/v context quantization (vRAM improvements) (#6279)
|
4 달 전 |
Daniel Hiltgen
|
05cd82ef94
Rename gpu package discover (#7143)
|
6 달 전 |
Michael Yang
|
77903ab8b4
llama3.1
|
9 달 전 |
Michael Yang
|
b732beba6a
lint
|
9 달 전 |
Michael Yang
|
df993fa37b
comments
|
9 달 전 |
Michael Yang
|
5e9db9fb0b
refactor convert
|
11 달 전 |
Michael Yang
|
35b89b2eab
rfc: dynamic environ lookup
|
10 달 전 |
Blake Mizerany
|
cb42e607c5
llm: speed up gguf decoding by a lot (#5246)
|
10 달 전 |
Daniel Hiltgen
|
6f351bf586
review comments and coverage
|
11 달 전 |
Daniel Hiltgen
|
6fd04ca922
Improve multi-gpu handling at the limit
|
11 달 전 |