瀏覽代碼

Add env var so podman will map cuda GPUs

Without this env var, podman's GPU logic doesn't map the GPU through
Daniel Hiltgen 1 年之前
父節點
當前提交
794a916a72
共有 1 個文件被更改,包括 1 次插入0 次删除
  1. 1 0
      Dockerfile

+ 1 - 0
Dockerfile

@@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0
 ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
 ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
 ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
+ENV NVIDIA_VISIBLE_DEVICES=all
 
 ENTRYPOINT ["/bin/ollama"]
 CMD ["serve"]