|
3 ay önce | |
---|---|---|
.. | ||
README.md | 90698c7d15 benchmark: new Go runner | 3 ay önce |
new_runner.sh | 90698c7d15 benchmark: new Go runner | 3 ay önce |
new_runner_benchmark_test.go | c2b11611a8 Update new_runner_benchmark_test.go | 3 ay önce |
server_benchmark_test.go | 90698c7d15 benchmark: new Go runner | 3 ay önce |
Performance benchmarking for Ollama.
127.0.0.1:11434
)llama3.2:1b
)# Run all tests
go test -bench=. -timeout 30m ./...
go test -bench=Runner
or to test multiple models:
# run this from within the benchmark directory
# requires: llama3.2:1b, llama3.1:8b, llama3.3:70b
sh new_runner.sh