Aucune description

Jeffrey Morgan 6292f4b64c update `Dockerfile`		il y a 1 an
api	6093a88c1a add llama.cpp go bindings	il y a 1 an
app	7bf3212c5b auto updater for macos	il y a 1 an
cmd	9164981d72 move prompt templates out of python bindings	il y a 1 an
docs	55898a3382 Move python docs to separate file	il y a 1 an
llama	0240165388 fix llama.cpp build	il y a 1 an
python	9164981d72 move prompt templates out of python bindings	il y a 1 an
server	9164981d72 move prompt templates out of python bindings	il y a 1 an
signature	76cb60d496 wip go engine	il y a 1 an
templates	9164981d72 move prompt templates out of python bindings	il y a 1 an
web	172274b809 fix auto update route	il y a 1 an
.dockerignore	6292f4b64c update `Dockerfile`	il y a 1 an
.gitignore	d34985b9df add templates to prompt command	il y a 1 an
.prettierrc.json	8685a5ad18 move .prettierrc.json to root	il y a 1 an
Dockerfile	6292f4b64c update `Dockerfile`	il y a 1 an
LICENSE	df5fdd6647 `proto` -> `ollama`	il y a 1 an
README.md	6093a88c1a add llama.cpp go bindings	il y a 1 an
go.mod	6093a88c1a add llama.cpp go bindings	il y a 1 an
go.sum	6093a88c1a add llama.cpp go bindings	il y a 1 an
main.go	6093a88c1a add llama.cpp go bindings	il y a 1 an
models.json	0efa1f9fb2 format `models.json`	il y a 1 an

Ollama

An easy, fast runtime for large language models, powered by llama.cpp.

Note: this project is a work in progress. Certain models that can be run with ollama are intended for research and/or non-commercial use only.

Install

Using pip:

pip install ollama

Using docker:

docker run ollama/ollama

To run a model, use ollama run:

ollama run orca-mini-3b

You can also run models from hugging face:

ollama run huggingface.co/TheBloke/orca_mini_3B-GGML

Or directly via downloaded model files:

ollama run ~/Downloads/orca-mini-13b.ggmlv3.q4_0.bin

go generate ./...
go build .