Home Verkennen Help
Registreren Inloggen
OpenSource
/
ollama
2
0
Vork 0
Bestanden Issues 0 Pull-aanvragen 0 Wiki
Boom: d3709f85b5
Aftakkingen Labels
ollama
/
server
Jeffrey Morgan d3709f85b5 build server into desktop app 1 jaar geleden
..
.gitignore d3709f85b5 build server into desktop app 1 jaar geleden
README.md 369108e1ad Add dependencies to `requirements.txt` 1 jaar geleden
build.py d3709f85b5 build server into desktop app 1 jaar geleden
requirements.txt 369108e1ad Add dependencies to `requirements.txt` 1 jaar geleden
server.py d3709f85b5 build server into desktop app 1 jaar geleden

README.md

Server

🙊

Installation

If using Apple silicon, you need a Python version that supports arm64:

wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh

Get the dependencies:

pip install -r requirements.txt

Building

python3 build.py

Running

Put your model in models/ and run:

python server.py

API

POST /generate

model: string - The name of the model to use in the models folder. prompt: string - The prompt to use.