jay 63211d5da6

fix(readability): preserve <a> links when Readability.js silently degrades on Windows (#7412) ...

* fix(readability): preserve <a> links when Readability.js silently degrades on Windows

On Windows, simple_json_from_html_string(use_readability=True) invokes the
Readability.js subprocess, which succeeds without error but returns the
unextracted document instead of the extracted article. The pure-Python
fallback (use_readability=False) also drops every <a> destination. The net
effect is that web_fetch returns link-free Markdown on Windows.

Fix: after extraction, check whether the output retained the <a> elements
that the resolved HTML carried. When they are all gone, fall back to
converting the resolved HTML directly with markdownify — which preserves
<a> as [text](href) — so links survive regardless of the Readability.js
outcome.

Measured: 17 of 22 test_web_fetch_relative_links.py failures resolved;
43/48 pass on Windows (5 remaining are pre-existing malformed-markup
extraction tests, unrelated to this change).

Closes #6459

* test(readability): add degraded-extraction and scope-pinning tests

* test(readability): detect unwanted article fallback

* test(readability): classify HTML body in authority-tag census

---------

Co-authored-by: Willem Jiang <willem.jiang@gmail.com>

2026-10-25 08:56:21 +08:00

..

deerflow

fix(readability): preserve <a> links when Readability.js silently degrades on Windows (#7412)

2026-10-25 08:56:21 +08:00

pyproject.toml

feat(workflows): add multi-Gateway coordination and session-authorized failover (#7138)

2026-10-23 23:31:43 +08:00