 Daniel Hiltgen
|
46c5f5fd9e
Runtime selection of new or old runners
|
9 kuukautta sitten |
|
Daniel Hiltgen
|
41bf8d9932
Update sync with latest llama.cpp layout, and run against b3485
|
9 kuukautta sitten |
 jmorganca
|
b9db5ab5d0
revert llm changes
|
11 kuukautta sitten |
|
jmorganca
|
82214396b5
replace static build in `llm`
|
11 kuukautta sitten |
 Josh
|
10e768826c
fix: quant err message (#5616)
|
9 kuukautta sitten |
|
Daniel Hiltgen
|
b51e3b63ac
Statically link c++ and thread lib
|
10 kuukautta sitten |
|
jmorganca
|
a08f20d910
release: remove unwanted mingw dll.a files
|
10 kuukautta sitten |
|
jmorganca
|
6cea036027
Revert "llm: only statically link libstdc++"
|
10 kuukautta sitten |
|
jmorganca
|
5796bfc401
llm: only statically link libstdc++
|
10 kuukautta sitten |
|
jmorganca
|
f1a379aa56
llm: statically link pthread and stdc++ dependencies in windows build
|
10 kuukautta sitten |
|
Jeffrey Morgan
|
5304b765b2
llm: put back old include dir (#5507)
|
10 kuukautta sitten |
|
Jeffrey Morgan
|
78fb33dd07
fix typo in cgo directives in `llm.go` (#5501)
|
10 kuukautta sitten |
|
Jeffrey Morgan
|
8f8e736b13
update llama.cpp submodule to `d7fd29f` (#5475)
|
10 kuukautta sitten |
 Michael Yang
|
829ff87bd1
revert tokenize ffi (#4761)
|
11 kuukautta sitten |
|
Jeffrey Morgan
|
763bb65dbb
use `int32_t` for call to tokenize (#4738)
|
11 kuukautta sitten |
|
Michael Yang
|
bf54c845e9
vocab only
|
11 kuukautta sitten |
|
Michael Yang
|
26a00a0410
use ffi for tokenizing/detokenizing
|
1 vuosi sitten |
|
Michael Yang
|
01811c176a
comments
|
1 vuosi sitten |
|
Michael Yang
|
9685c34509
quantize any fp16/fp32 model
|
1 vuosi sitten |
 Hernan Martinez
|
86e67fc4a9
Add import declaration for windows,arm64 to llm.go
|
1 vuosi sitten |
|
Michael Yang
|
9502e5661f
cgo quantize
|
1 vuosi sitten |
|
Daniel Hiltgen
|
58d95cc9bd
Switch back to subprocessing for llama.cpp
|
1 vuosi sitten |
|
Michael Yang
|
91b3e4d282
update memory calcualtions
|
1 vuosi sitten |
|
Michael Yang
|
d338d70492
refactor model parsing
|
1 vuosi sitten |
 Patrick Devine
|
1b272d5bcd
change `github.com/jmorganca/ollama` to `github.com/ollama/ollama` (#3347)
|
1 vuosi sitten |
|
Jeffrey Morgan
|
f9cd55c70b
disable gpu for certain model architectures and fix divide-by-zero on memory estimation
|
1 vuosi sitten |
|
Daniel Hiltgen
|
6c5ccb11f9
Revamp ROCm support
|
1 vuosi sitten |
|
Daniel Hiltgen
|
a1dfab43b9
Ensure the libraries are present
|
1 vuosi sitten |
|
Jeffrey Morgan
|
4458efb73a
Load all layers on `arm64` macOS if model is small enough (#2149)
|
1 vuosi sitten |
|
Daniel Hiltgen
|
fedd705aea
Mechanical switch from log to slog
|
1 vuosi sitten |
