Jeffrey Morgan
|
a64570dcae
Fix clearing kv cache between requests with the same prompt (#2186)
|
1 年之前 |
Daniel Hiltgen
|
3bc28736cd
Merge pull request #2143 from dhiltgen/llm_verbosity
|
1 年之前 |
Daniel Hiltgen
|
730dcfcc7a
Refine debug logging for llm
|
1 年之前 |
Daniel Hiltgen
|
27a2d5af54
Debug logging on init failure
|
1 年之前 |
Jeffrey Morgan
|
89c4aee29e
Unlock mutex when failing to load model (#2117)
|
1 年之前 |
Daniel Hiltgen
|
fedd705aea
Mechanical switch from log to slog
|
1 年之前 |
Daniel Hiltgen
|
1b249748ab
Add multiple CPU variants for Intel Mac
|
1 年之前 |
Bruce MacDonald
|
a897e833b8
do not cache prompt (#2018)
|
1 年之前 |
Daniel Hiltgen
|
2ecb247276
Fix intel mac build
|
1 年之前 |
Daniel Hiltgen
|
39928a42e8
Always dynamically load the llm server library
|
1 年之前 |