 Michael Yang
|
58245413f4
next ollama runner (#7913)
|
hace 2 meses |
 Stefan Weil
|
abfdc4710f
all: fix typos in documentation, code, and comments (#7021)
|
hace 4 meses |
 Daniel Hiltgen
|
05cd82ef94
Rename gpu package discover (#7143)
|
hace 6 meses |
|
Daniel Hiltgen
|
d632e23fba
Add Windows arm64 support to official builds (#5712)
|
hace 7 meses |
 Patrick Devine
|
abed273de3
add "stop" command (#6739)
|
hace 7 meses |
|
Michael Yang
|
77903ab8b4
llama3.1
|
hace 9 meses |
 Jeffrey Morgan
|
15c2d8fe14
server: parallelize embeddings in API web handler instead of in subprocess runner (#6220)
|
hace 8 meses |
|
Michael Yang
|
b732beba6a
lint
|
hace 9 meses |
|
Michael Yang
|
df993fa37b
comments
|
hace 9 meses |
|
Michael Yang
|
5e9db9fb0b
refactor convert
|
hace 11 meses |
|
Michael Yang
|
5c1912769e
Merge pull request #5473 from ollama/mxyng/environ
|
hace 9 meses |
 royjhan
|
1b44d873e7
Add Metrics to `api\embed` response (#5709)
|
hace 9 meses |
 Daniel Hiltgen
|
345420998e
Prevent partial loading on mixed GPU brands
|
hace 9 meses |
|
Michael Yang
|
0f1910129f
int
|
hace 10 meses |
|
Jeffrey Morgan
|
80ee9b5e47
Remove out of space test temporarily (#5825)
|
hace 9 meses |
|
Daniel Hiltgen
|
06e5d74e34
Merge pull request #5506 from dhiltgen/sched_tests
|
hace 9 meses |
|
royjhan
|
b9f5e16c80
Introduce `/api/embed` endpoint supporting batch embedding (#5127)
|
hace 9 meses |
|
Daniel Hiltgen
|
f4408219e9
Refine scheduler unit tests for reliability
|
hace 10 meses |
|
Daniel Hiltgen
|
af28b94533
Merge pull request #5469 from dhiltgen/prevent_system_oom
|
hace 10 meses |
|
Daniel Hiltgen
|
955f2a4e03
Only set default keep_alive on initial model load
|
hace 10 meses |
|
Daniel Hiltgen
|
3c75113e37
Prevent loading models larger than total memory
|
hace 10 meses |
|
Daniel Hiltgen
|
3518aaef33
Merge pull request #4218 from dhiltgen/auto_parallel
|
hace 10 meses |
 Blake Mizerany
|
cb42e607c5
llm: speed up gguf decoding by a lot (#5246)
|
hace 10 meses |
|
Daniel Hiltgen
|
17b7186cd7
Enable concurrency by default
|
hace 1 año |
|
Daniel Hiltgen
|
45cacbaf05
Merge pull request #4517 from dhiltgen/gpu_incremental
|
hace 10 meses |
|
Daniel Hiltgen
|
6f351bf586
review comments and coverage
|
hace 11 meses |
|
Daniel Hiltgen
|
fc37c192ae
Refine CPU load behavior with system memory visibility
|
hace 11 meses |
|
Daniel Hiltgen
|
6fd04ca922
Improve multi-gpu handling at the limit
|
hace 11 meses |
|
Jeffrey Morgan
|
dd7c9ebeaf
server: longer timeout in `TestRequests` (#5046)
|
hace 10 meses |
|
Michael Yang
|
e40145a39d
lint
|
hace 11 meses |
