瀏覽代碼

enh: min_p

Timothy J. Baek 9 月之前
父節點
當前提交
8fcb5cee66
共有 1 個文件被更改,包括 6 次插入0 次删除
  1. 6 0
      backend/apps/ollama/main.py

+ 6 - 0
backend/apps/ollama/main.py

@@ -857,6 +857,12 @@ async def generate_chat_completion(
             ):
                 payload["options"]["top_p"] = model_info.params.get("top_p", None)
 
+            if (
+                model_info.params.get("min_p", None)
+                and payload["options"].get("min_p") is None
+            ):
+                payload["options"]["min_p"] = model_info.params.get("min_p", None)
+
             if (
                 model_info.params.get("use_mmap", None)
                 and payload["options"].get("use_mmap") is None