瀏覽代碼

Report better warning on client closed abort of load

If the client closes the connection before we finish loading the model
we abort, so lets make the log message clearer why to help users
understand this failure mode
Daniel Hiltgen 1 年之前
父節點
當前提交
c4209d6d21
共有 1 個文件被更改,包括 1 次插入1 次删除
  1. 1 1
      llm/server.go

+ 1 - 1
llm/server.go

@@ -528,7 +528,7 @@ func (s *llmServer) WaitUntilRunning(ctx context.Context) error {
 	for {
 		select {
 		case <-ctx.Done():
-			slog.Info("context expired before server started")
+			slog.Warn("client connection closed before server finished loading, aborting load")
 			return fmt.Errorf("timed out waiting for llama runner to start: %w", ctx.Err())
 		case err := <-s.done:
 			msg := ""