首頁 探索 說明
註冊 登入
OpenSource
/
ollama
2
0
複刻 0
Files 問題管理 0 合併請求 0 Wiki
分支: parth/set-context-size-openai
分支列表 標籤列表
ollama
/
llama
/
runner
Jeffrey Morgan 1deafd8254 llama: update vendored code to commit 46e3556 (#8308) 3 月之前
..
README.md 3919f4ba3d llama: fix runner api example url in README.md (#8307) 3 月之前
cache.go 4879a234c4 build: Make target improvements (#7499) 4 月之前
cache_test.go 4879a234c4 build: Make target improvements (#7499) 4 月之前
image.go 4879a234c4 build: Make target improvements (#7499) 4 月之前
image_test.go 4879a234c4 build: Make target improvements (#7499) 4 月之前
runner.go 1deafd8254 llama: update vendored code to commit 46e3556 (#8308) 3 月之前
stop.go 4879a234c4 build: Make target improvements (#7499) 4 月之前
stop_test.go 4879a234c4 build: Make target improvements (#7499) 4 月之前

README.md

runner

Note: this is a work in progress

A minimial runner for loading a model and running inference via a http web server.

./runner -model <model binary>

Completion

curl -X POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/completion

Embeddings

curl -X POST -H "Content-Type: application/json" -d '{"prompt": "turn me into an embedding"}' http://localhost:8080/embedding