Przeglądaj źródła

small fix on examples/python-simplechat/client.py to actually get a streamed response and get tokens printed as we receive it (#4671)

Rayan Mostovoi 11 miesięcy temu
rodzic
commit
8a8e7afa96
1 zmienionych plików z 1 dodań i 0 usunięć
  1. 1 0
      examples/python-simplechat/client.py

+ 1 - 0
examples/python-simplechat/client.py

@@ -9,6 +9,7 @@ def chat(messages):
     r = requests.post(
         "http://0.0.0.0:11434/api/chat",
         json={"model": model, "messages": messages, "stream": True},
+	stream=True
     )
     r.raise_for_status()
     output = ""