浏览代码

Bump llama.cpp to b1842 and add new cuda lib dep

Upstream llama.cpp has added a new dependency with the
NVIDIA CUDA Driver Libraries (libcuda.so) which is part of the
driver distribution, not the general cuda libraries, and is not
available as an archive, so we can not statically link it.  This may
introduce some additional compatibility challenges which we'll
need to keep an eye on.
Daniel Hiltgen 1 年之前
父节点
当前提交
795674dd90
共有 2 个文件被更改,包括 2 次插入1 次删除
  1. 1 0
      llm/generate/gen_linux.sh
  2. 1 1
      llm/llama.cpp

+ 1 - 0
llm/generate/gen_linux.sh

@@ -141,6 +141,7 @@ if [ -d "${CUDA_LIB_DIR}" ]; then
         ${CUDA_LIB_DIR}/libcublasLt_static.a \
         ${CUDA_LIB_DIR}/libcudadevrt.a \
         ${CUDA_LIB_DIR}/libculibos.a \
+        -lcuda \
         -lrt -lpthread -ldl -lstdc++ -lm
 fi
 

+ 1 - 1
llm/llama.cpp

@@ -1 +1 @@
-Subproject commit 328b83de23b33240e28f4e74900d1d06726f5eb1
+Subproject commit 584d674be622fbf1578694ada6e62eebedbfd377