Daniel Hiltgen
|
d88c527be3
Build multiple CPU variants and pick the best
|
1 ano atrás |
Jeffrey Morgan
|
08f1e18965
Offload layers to GPU based on new model size estimates (#1850)
|
1 ano atrás |
Jeffrey Morgan
|
5feec959ad
dont use `-Wall` in static build (#1833)
|
1 ano atrás |
Daniel Hiltgen
|
77d96da94b
Code shuffle to clean up the llm dir
|
1 ano atrás |
Bruce MacDonald
|
0b3118e0af
fix: relay request opts to loaded llm prediction (#1761)
|
1 ano atrás |
Daniel Hiltgen
|
d966b730ac
Switch windows build to fully dynamic
|
1 ano atrás |