 Jesse Gross
|
6cd566872b
sched: Lift parallel restriction for multimodal models except mllama
|
il y a 6 mois |
 Daniel Hiltgen
|
05cd82ef94
Rename gpu package discover (#7143)
|
il y a 6 mois |
 Patrick Devine
|
abed273de3
add "stop" command (#6739)
|
il y a 7 mois |
|
Daniel Hiltgen
|
90ca84172c
Fix embeddings memory corruption (#6467)
|
il y a 8 mois |
 Richard Lyons
|
885cf45087
Fix white space.
|
il y a 8 mois |
|
Richard Lyons
|
9352eeb752
Reset NumCtx.
|
il y a 8 mois |
|
Richard Lyons
|
0ad0e738cd
Override numParallel only if unset.
|
il y a 8 mois |
 Michael Yang
|
2697d7f5aa
lint
|
il y a 8 mois |
|
Michael Yang
|
b732beba6a
lint
|
il y a 9 mois |
|
Michael Yang
|
5c1912769e
Merge pull request #5473 from ollama/mxyng/environ
|
il y a 9 mois |
 Daniel Hiltgen
|
345420998e
Prevent partial loading on mixed GPU brands
|
il y a 9 mois |
|
Michael Yang
|
85d9d73a72
comments
|
il y a 9 mois |
|
Michael Yang
|
0f1910129f
int
|
il y a 10 mois |
|
Michael Yang
|
8570c1c0ef
keepalive
|
il y a 10 mois |
|
Michael Yang
|
55cd3ddcca
bool
|
il y a 10 mois |
 Jeffrey Morgan
|
791650ddef
sched: only error when over-allocating system memory (#5626)
|
il y a 9 mois |
|
Jeffrey Morgan
|
e4ff73297d
server: fix model reloads when setting `OLLAMA_NUM_PARALLEL` (#5560)
|
il y a 9 mois |
|
Jeffrey Morgan
|
0ee87615c7
sched: don't error if paging to disk on Windows and macOS (#5523)
|
il y a 10 mois |
|
Daniel Hiltgen
|
af28b94533
Merge pull request #5469 from dhiltgen/prevent_system_oom
|
il y a 10 mois |
|
Daniel Hiltgen
|
955f2a4e03
Only set default keep_alive on initial model load
|
il y a 10 mois |
|
Daniel Hiltgen
|
3c75113e37
Prevent loading models larger than total memory
|
il y a 10 mois |
|
Daniel Hiltgen
|
cff3f44f4a
Fix case for NumCtx
|
il y a 10 mois |
|
Daniel Hiltgen
|
3518aaef33
Merge pull request #4218 from dhiltgen/auto_parallel
|
il y a 10 mois |
 Blake Mizerany
|
cb42e607c5
llm: speed up gguf decoding by a lot (#5246)
|
il y a 10 mois |
|
Daniel Hiltgen
|
9929751cc8
Disable concurrency for AMD + Windows
|
il y a 10 mois |
|
Daniel Hiltgen
|
17b7186cd7
Enable concurrency by default
|
il y a 1 an |
|
Daniel Hiltgen
|
6f351bf586
review comments and coverage
|
il y a 11 mois |
|
Daniel Hiltgen
|
ff4f0cbd1d
Prevent multiple concurrent loads on the same gpus
|
il y a 11 mois |
|
Daniel Hiltgen
|
fc37c192ae
Refine CPU load behavior with system memory visibility
|
il y a 11 mois |
|
Daniel Hiltgen
|
434dfe30c5
Reintroduce nvidia nvml library for windows
|
il y a 11 mois |
