 royjhan
|
786848dfd3
Merge branch 'main' into royh-batchembed
|
vor 10 Monaten |
 Michael Yang
|
9bbddc37a7
Merge pull request #5126 from ollama/mxyng/messages
|
vor 10 Monaten |
|
royjhan
|
b7c622dd32
Merge branch 'main' into royh-batchembed
|
vor 10 Monaten |
 Jeffrey Morgan
|
53da2c6965
llm: remove ambiguous comment when putting upper limit on predictions to avoid infinite generation (#5535)
|
vor 10 Monaten |
|
Michael Yang
|
ac7a842e55
fix model reloading
|
vor 10 Monaten |
 Roy Han
|
6caac01494
clear comments
|
vor 10 Monaten |
|
Roy Han
|
17de2b4405
Refactoring of legacy and new
|
vor 10 Monaten |
 Daniel Hiltgen
|
ccd7785859
Merge pull request #5243 from dhiltgen/modelfile_use_mmap
|
vor 10 Monaten |
 Daniel Hiltgen
|
0e982bc1f4
Fix corner cases on tmp cleaner on mac
|
vor 10 Monaten |
|
royjhan
|
a5f23d766e
Merge branch 'main' into royh-batchembed
|
vor 10 Monaten |
|
Roy Han
|
00a4cb26ca
use float32
|
vor 10 Monaten |
 Josh Yan
|
33a65e3ba3
error
|
vor 10 Monaten |
|
Roy Han
|
aee25acb5b
move normalization to go
|
vor 10 Monaten |
|
Daniel Hiltgen
|
97c9e11768
Switch use_mmap to a pointer type
|
vor 10 Monaten |
|
Daniel Hiltgen
|
3518aaef33
Merge pull request #4218 from dhiltgen/auto_parallel
|
vor 10 Monaten |
|
Roy Han
|
c111d8bb51
normalization
|
vor 10 Monaten |
|
Roy Han
|
49e341147d
add server function
|
vor 10 Monaten |
|
Roy Han
|
c406fa7a4c
api/embed draft
|
vor 10 Monaten |
|
Roy Han
|
ff191d7cba
Initial Draft
|
vor 10 Monaten |
 Blake Mizerany
|
cb42e607c5
llm: speed up gguf decoding by a lot (#5246)
|
vor 10 Monaten |
|
Roy Han
|
0f87628b6d
Revert "Initial Batch Embedding"
|
vor 10 Monaten |
|
Daniel Hiltgen
|
17b7186cd7
Enable concurrency by default
|
vor 1 Jahr |
|
Daniel Hiltgen
|
5bf5aeec01
Refine mmap default logic on linux
|
vor 10 Monaten |
|
Daniel Hiltgen
|
96624aa412
Merge pull request #5072 from dhiltgen/windows_path
|
vor 11 Monaten |
|
Roy Han
|
c22d54895a
Initial Batch Embedding
|
vor 11 Monaten |
|
Daniel Hiltgen
|
7784ca33ce
Tighten up memory prediction logging
|
vor 11 Monaten |
|
Daniel Hiltgen
|
171796791f
Adjust mmap logic for cuda windows for faster model load
|
vor 11 Monaten |
|
Daniel Hiltgen
|
b2799f111b
Move libraries out of users path
|
vor 11 Monaten |
|
Daniel Hiltgen
|
da3bf23354
Workaround gfx900 SDMA bugs
|
vor 11 Monaten |
|
Daniel Hiltgen
|
6f351bf586
review comments and coverage
|
vor 11 Monaten |
