Sfoglia il codice sorgente

fix: openai usage display issue

Timothy Jaeryang Baek 2 mesi fa
parent
commit
7e2b2ec761
1 ha cambiato i file con 10 aggiunte e 0 eliminazioni
  1. 10 0
      backend/open_webui/utils/middleware.py

+ 10 - 0
backend/open_webui/utils/middleware.py

@@ -1487,6 +1487,16 @@ async def process_chat_response(
                                 else:
                                     choices = data.get("choices", [])
                                     if not choices:
+                                        usage = data.get("usage", {})
+                                        if usage:
+                                            await event_emitter(
+                                                {
+                                                    "type": "chat:completion",
+                                                    "data": {
+                                                        "usage": usage,
+                                                    },
+                                                }
+                                            )
                                         continue
 
                                     delta = choices[0].get("delta", {})