huangzz 2cf7424a80
fix(llm-error): retry streamed 200-OK responses that carry no generation chunk (#6803)
* fix(llm-error): retry streamed 200-OK responses that carry no generation chunk

The non-streaming empty-generations glitch (IndexError) is already
classified as transient and retried. The streaming path reports the same
upstream glitch as ValueError("No generations found in stream.") from
langchain_core's generate_from_stream; it fell through to "generic" and
failed after one attempt regardless of llm_call.retry_max_attempts.

Classify that ValueError as transient so it uses the configured retry
budget. Unrelated ValueErrors stay generic.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* style(llm-error): keep comments adjacent to their constants

---------

Co-authored-by: huangzz <110116@nd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Willem Jiang <willem.jiang@gmail.com>
2026-10-13 22:18:17 +08:00
..