Browse Source

Add env var so podman will map cuda GPUs

Without this env var, podman's GPU logic doesn't map the GPU through
Daniel Hiltgen 1 year ago
parent
commit
794a916a72
1 changed files with 1 additions and 0 deletions
  1. 1 0
      Dockerfile

+ 1 - 0
Dockerfile

@@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0
 ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
 ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
 ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
+ENV NVIDIA_VISIBLE_DEVICES=all
 
 ENTRYPOINT ["/bin/ollama"]
 CMD ["serve"]