瀏覽代碼

Adding the missing env variable
ENV RAG_EMBEDDING_MODEL_DEVICE_TYPE="cuda"

Joseph Young 1 年之前
父節點
當前提交
9bea40bd40
共有 1 個文件被更改,包括 1 次插入0 次删除
  1. 1 0
      Dockerfile-cuda

+ 1 - 0
Dockerfile-cuda

@@ -32,6 +32,7 @@ RUN npm run build
 ######## CUDA WebUI backend ########
 FROM --platform=linux/amd64 nvidia/cuda:"$CUDA_VERSION"-devel-ubuntu22.04 AS cuda-build-amd64
 #FROM --platform=linux/amd64 cgr.dev/chainguard/pytorch-cuda12:latest AS cuda-build-amd64 # fails with python requirements conflicts
+ENV RAG_EMBEDDING_MODEL_DEVICE_TYPE="cuda"
 
 # Set environment variables for NVIDIA Container Toolkit
 ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 \