Bruce MacDonald c2b11611a8 Update new_runner_benchmark_test.go 3 ay önce
..
README.md 90698c7d15 benchmark: new Go runner 3 ay önce
new_runner.sh 90698c7d15 benchmark: new Go runner 3 ay önce
new_runner_benchmark_test.go c2b11611a8 Update new_runner_benchmark_test.go 3 ay önce
server_benchmark_test.go 90698c7d15 benchmark: new Go runner 3 ay önce

README.md

Benchmark

Performance benchmarking for Ollama.

Prerequisites

  • Ollama server running locally (127.0.0.1:11434)
  • Desired models pre-downloaded (e.g., llama3.2:1b)

Run Benchmark

# Run all tests
go test -bench=. -timeout 30m ./...

New Runner Benchmark

go test -bench=Runner

or to test multiple models:

# run this from within the benchmark directory
# requires: llama3.2:1b, llama3.1:8b, llama3.3:70b
sh new_runner.sh