github/deer-flow
1
0
Fork 0
mirror of https://github.com/bytedance/deer-flow.git synced 2026-04-25 11:18:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
deer-flow/backend/docs/TODO.md
luo jiyin 07fc25d285
feat: switch memory updater to async LLM calls (#2138) 
* docs: mark memory updater async migration as completed

- Update TODO.md to mark the replacement of sync model.invoke()
  with async model.ainvoke() in title_middleware and memory updater
  as completed using [x] format

Addresses #2131

* feat: switch memory updater to async LLM calls

- Add async aupdate_memory() method using await model.ainvoke()
- Convert sync update_memory() to use async wrapper
- Add _run_async_update_sync() for nested loop context handling
- Maintain backward compatibility with existing sync API
- Add ThreadPoolExecutor for async execution from sync contexts

Addresses #2131

* test: add tests for async memory updater

- Add test_async_update_memory_uses_ainvoke() to verify async path
- Convert existing tests to use AsyncMock and ainvoke assertions
- Add test_sync_update_memory_wrapper_works_in_running_loop()
- Update all model mocks to use async await patterns

Addresses #2131

* fix: apply ruff formatting to memory updater

- Format multi-line expressions to single line
- Ensure code style consistency with project standards
- Fix lint issues caught by GitHub Actions

* test: add comprehensive tests for async memory updater

- Add test_async_update_memory_uses_ainvoke() to verify async path
- Convert existing tests to use AsyncMock and ainvoke assertions
- Add test_sync_update_memory_wrapper_works_in_running_loop()
- Update all model mocks to use async await patterns
- Ensure backward compatibility with sync API

* fix: satisfy ruff formatting in memory updater test

---------

Co-authored-by: Willem Jiang <willem.jiang@gmail.com>
2026-04-14 11:10:42 +08:00

1.8 KiB
Raw Permalink Blame History

TODO List

Completed Features

  • Launch the sandbox only after the first file system or bash tool is called
  • Add Clarification Process for the whole process
  • Implement Context Summarization Mechanism to avoid context explosion
  • Integrate MCP (Model Context Protocol) for extensible tools
  • Add file upload support with automatic document conversion
  • Implement automatic thread title generation
  • Add Plan Mode with TodoList middleware
  • Add vision model support with ViewImageMiddleware
  • Skills system with SKILL.md format
  • Replace time.sleep(5) with asyncio.sleep() in packages/harness/deerflow/tools/builtins/task_tool.py (subagent polling)

Planned Features

  • Pooling the sandbox resources to reduce the number of sandbox containers
  • Add authentication/authorization layer
  • Implement rate limiting
  • Add metrics and monitoring
  • Support for more document formats in upload
  • Skill marketplace / remote skill installation
  • Optimize async concurrency in agent hot path (IM channels multi-task scenario)
  • Replace subprocess.run() with asyncio.create_subprocess_shell() in packages/harness/deerflow/sandbox/local/local_sandbox.py
    • Replace sync requests with httpx.AsyncClient in community tools (tavily, jina_ai, firecrawl, infoquest, image_search)
    • Replace sync model.invoke() with async model.ainvoke() in title_middleware and memory updater
    • Consider asyncio.to_thread() wrapper for remaining blocking file I/O
    • For production: use langgraph up (multi-worker) instead of langgraph dev (single-worker)

Resolved Issues

  • Make sure that no duplicated files in state.artifacts
  • Long thinking but with empty content (answer inside thinking process)