瀏覽代碼

fix: continue with failures when bulk loading urls with WebBaseLoader

Jun Siang Cheah 11 月之前
父節點
當前提交
9ed1a31575
共有 1 個文件被更改,包括 1 次插入0 次删除
  1. 1 0
      backend/apps/rag/main.py

+ 1 - 0
backend/apps/rag/main.py

@@ -584,6 +584,7 @@ def get_web_loader(url: Union[str, Sequence[str]], verify_ssl: bool = True):
         url,
         verify_ssl=verify_ssl,
         requests_per_second=RAG_WEB_SEARCH_CONCURRENT_REQUESTS,
+        continue_on_failure=True,
     )