mirror of
https://github.com/bytedance/deer-flow.git
synced 2026-06-16 20:42:01 +00:00
* Add user-owned IM channel connections
* Fix dev startup and channel connect popup
* Use async channel connect flow
* Harden dev service daemon startup
* Support local IM channel connections
* Align IM connections with local channels
* Fix safe user id digest algorithm
* Address Copilot IM channel feedback
* Address IM channel review comments
* Support all integrated IM channel connections
* Format additional channel connection tests
* Keep unavailable channel connect buttons clickable
* Fix IM channel provider icons
* Add runtime setup for enabled IM channels
* Guard global shortcut key handling
* Keep configured IM channels editable
* Avoid password autofill for channel secrets
* Make channel threads visible to connection owners
* Persist IM runtime config locally
* Allow disconnecting runtime IM channels
* Route no-auth channel sessions to local user
* Use default user for auth-disabled local mode
* Show IM channel source on threads
* Prefill IM channel runtime config
* Reflect IM channel runtime health
* Ignore Feishu message read events
* Ignore Feishu non-content message events
* Let setup wizard enable IM channels
* Fix frontend formatting after merge
* Stabilize backend tests without local config
* Isolate channel runtime config tests
* Address channel connection review comments
* Use sha256 user buckets with legacy migration
* Ensure runtime IM channels are ready after restart
* Persist disconnected IM channel state
* Address channel connection review comments
* Address channel connection review findings
Frontend connect flow:
- Open the runtime-config dialog only when a provider still needs
credentials; configured providers go straight to the connect flow, so
the binding-code/deep-link path is reachable from the UI again.
- After saving credentials, continue into the connect flow when a user
binding is still required (multi-user mode) instead of stopping at a
"Connected" toast.
- Extract shared provider-state helpers to core/channels/provider-state
and add unit + e2e coverage for the direct-connect and
configure-then-connect paths.
Provider status semantics:
- Report connection_status from the user's newest connection row;
with no binding it is not_connected, except in auth-disabled local
mode where a configured running channel is effectively connected.
Concurrency and event-loop correctness:
- Offload ChannelRuntimeConfigStore construction and writes, channel
service construction, and Slack connection replies to threads; add a
tests/blocking_io/ anchor for the runtime-config handlers.
- Consume binding codes with a conditional UPDATE so a code can only be
used once under concurrent workers; retry upsert_connection as an
update when a concurrent insert wins the unique constraint.
- Serialize ensure_channel_ready per channel so concurrent provider
polls cannot double-start a channel worker.
Config and migration hardening:
- Stop mutating the get_app_config()-cached Telegram provider config;
the runtime store now owns the UI-entered bot username.
- Register channel_connections in STARTUP_ONLY_FIELDS with the
standardized startup-only Field description.
- Match the legacy unsafe-id bucket by recomputing its exact SHA-1 name
so another user's same-prefix bucket can never be migrated.
- Remove the unused Telegram process_webhook_update path and document
src/core/channels in the frontend docs.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* Address PR review comments on authz scoping and channel runtime
Security (review feedback from ShenAC-SAC):
- Scope internal-token callers to the connection owner carried in
X-DeerFlow-Owner-User-Id instead of bypassing owner checks outright,
in both require_permission(owner_check=True) and the stateless run
endpoints. Internal callers keep access to their own and
shared/legacy threads, and may claim a default-owned channel thread
for its real owner, but a leaked internal token no longer grants
cross-user thread access.
- Require admin privileges for POST/DELETE /api/channels/{provider}/
runtime-config: runtime credentials and channel workers are
instance-wide shared state (same model as the MCP config API).
Read-only provider listing stays available to all users.
Performance (review feedback from willem-bd):
- Skip the redundant thread channel-metadata PATCH after the first
successful backfill per thread.
- Reuse the per-connection Slack WebClient until its token changes
instead of constructing one per outbound message.
- Reconcile channel readiness for all providers concurrently in
GET /api/channels/providers.
Also resolve the code-quality unused-import flag in the blocking-io
anchor by pre-importing the channel service via importlib.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* Fix prettier formatting in provider-state test
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* Reconcile UI runtime channel config with config reload on restart
Main now reloads a channel's config.yaml entry on restart_channel()
(#3514, issue #3497). Adapt the user-owned connection flow to coexist:
- configure_channel() restarts with reload_config=False — the caller
just supplied the authoritative config (browser-entered credentials
that are never written to config.yaml), so a file reload must not
clobber it with the stale on-disk entry.
- _load_channel_config() re-applies the UI runtime-store overlay used
at startup, so an operator-triggered restart keeps browser-entered
credentials for channels without a config.yaml entry and does not
resurrect a channel disconnected from the UI.
- Offload the reload's disk IO (config.yaml + runtime store) with
asyncio.to_thread, matching the blocking-IO policy on this branch.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
175 lines
6.6 KiB
Python
175 lines
6.6 KiB
Python
#!/usr/bin/env python3
|
|
"""DeerFlow Interactive Setup Wizard.
|
|
|
|
Usage:
|
|
uv run python scripts/setup_wizard.py
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
import sys
|
|
from pathlib import Path
|
|
|
|
# Make the scripts/ directory importable so wizard.* works
|
|
sys.path.insert(0, str(Path(__file__).resolve().parent))
|
|
|
|
|
|
def _is_interactive() -> bool:
|
|
return sys.stdin.isatty() and sys.stdout.isatty()
|
|
|
|
|
|
def main() -> int:
|
|
try:
|
|
if not _is_interactive():
|
|
print(
|
|
"Non-interactive environment detected.\n"
|
|
"Please edit config.yaml and .env directly, or run 'make setup' in a terminal."
|
|
)
|
|
return 1
|
|
|
|
from wizard.ui import (
|
|
ask_yes_no,
|
|
bold,
|
|
cyan,
|
|
green,
|
|
print_header,
|
|
print_info,
|
|
print_success,
|
|
yellow,
|
|
)
|
|
from wizard.writer import write_config_yaml, write_env_file
|
|
|
|
project_root = Path(__file__).resolve().parents[1]
|
|
config_path = project_root / "config.yaml"
|
|
env_path = project_root / ".env"
|
|
|
|
print()
|
|
print(bold("Welcome to DeerFlow Setup!"))
|
|
print("This wizard will help you configure DeerFlow in a few minutes.")
|
|
print()
|
|
|
|
if config_path.exists():
|
|
print(yellow("Existing configuration detected."))
|
|
print()
|
|
should_reconfigure = ask_yes_no("Do you want to reconfigure?", default=False)
|
|
if not should_reconfigure:
|
|
print()
|
|
print_info("Keeping existing config. Run 'make doctor' to verify your setup.")
|
|
return 0
|
|
print()
|
|
|
|
total_steps = 5
|
|
|
|
from wizard.steps.llm import run_llm_step
|
|
|
|
llm = run_llm_step(f"Step 1/{total_steps}")
|
|
|
|
from wizard.steps.search import run_search_step
|
|
|
|
search = run_search_step(f"Step 2/{total_steps}")
|
|
search_provider = search.search_provider
|
|
search_api_key = search.search_api_key
|
|
fetch_provider = search.fetch_provider
|
|
fetch_api_key = search.fetch_api_key
|
|
|
|
from wizard.steps.execution import run_execution_step
|
|
|
|
execution = run_execution_step(f"Step 3/{total_steps}")
|
|
|
|
from wizard.steps.channels import run_channels_step
|
|
|
|
channels = run_channels_step(f"Step 4/{total_steps}")
|
|
|
|
print_header(f"Step {total_steps}/{total_steps} · Writing configuration")
|
|
|
|
write_config_yaml(
|
|
config_path,
|
|
provider_use=llm.provider.use,
|
|
model_name=llm.model_name,
|
|
display_name=f"{llm.provider.display_name} / {llm.model_name}",
|
|
api_key_field=llm.provider.api_key_field,
|
|
env_var=llm.provider.env_var,
|
|
extra_model_config=llm.provider.extra_config_for(llm.model_name) or None,
|
|
base_url=llm.base_url,
|
|
search_use=search_provider.use if search_provider else None,
|
|
search_tool_name=search_provider.tool_name if search_provider else "web_search",
|
|
search_extra_config=search_provider.extra_config if search_provider else None,
|
|
web_fetch_use=fetch_provider.use if fetch_provider else None,
|
|
web_fetch_tool_name=fetch_provider.tool_name if fetch_provider else "web_fetch",
|
|
web_fetch_extra_config=fetch_provider.extra_config if fetch_provider else None,
|
|
sandbox_use=execution.sandbox_use,
|
|
allow_host_bash=execution.allow_host_bash,
|
|
include_bash_tool=execution.include_bash_tool,
|
|
include_write_tools=execution.include_write_tools,
|
|
channel_connection_providers=channels.enabled_providers,
|
|
)
|
|
print_success(f"Config written to: {config_path.relative_to(project_root)}")
|
|
|
|
if not env_path.exists():
|
|
env_example = project_root / ".env.example"
|
|
if env_example.exists():
|
|
import shutil
|
|
shutil.copyfile(env_example, env_path)
|
|
|
|
env_pairs: dict[str, str] = {}
|
|
if llm.api_key:
|
|
env_pairs[llm.provider.env_var] = llm.api_key
|
|
if search_api_key and search_provider and search_provider.env_var:
|
|
env_pairs[search_provider.env_var] = search_api_key
|
|
if fetch_api_key and fetch_provider and fetch_provider.env_var:
|
|
env_pairs[fetch_provider.env_var] = fetch_api_key
|
|
|
|
if env_pairs:
|
|
write_env_file(env_path, env_pairs)
|
|
print_success(f"API keys written to: {env_path.relative_to(project_root)}")
|
|
|
|
frontend_env = project_root / "frontend" / ".env"
|
|
frontend_env_example = project_root / "frontend" / ".env.example"
|
|
if not frontend_env.exists() and frontend_env_example.exists():
|
|
import shutil
|
|
shutil.copyfile(frontend_env_example, frontend_env)
|
|
print_success("frontend/.env created from example")
|
|
|
|
print_header("Setup complete!")
|
|
print(f" {green('✓')} LLM: {llm.provider.display_name} / {llm.model_name}")
|
|
if search_provider:
|
|
print(f" {green('✓')} Web search: {search_provider.display_name}")
|
|
else:
|
|
print(f" {'—':>3} Web search: not configured")
|
|
if fetch_provider:
|
|
print(f" {green('✓')} Web fetch: {fetch_provider.display_name}")
|
|
else:
|
|
print(f" {'—':>3} Web fetch: not configured")
|
|
sandbox_label = "Local sandbox" if execution.sandbox_use.endswith("LocalSandboxProvider") else "Container sandbox"
|
|
print(f" {green('✓')} Execution: {sandbox_label}")
|
|
if execution.include_bash_tool:
|
|
bash_label = "enabled"
|
|
if execution.allow_host_bash:
|
|
bash_label += " (host bash)"
|
|
print(f" {green('✓')} Bash: {bash_label}")
|
|
else:
|
|
print(f" {'—':>3} Bash: disabled")
|
|
if execution.include_write_tools:
|
|
print(f" {green('✓')} File write: enabled")
|
|
else:
|
|
print(f" {'—':>3} File write: disabled")
|
|
if channels.enabled_providers:
|
|
print(f" {green('✓')} IM channels: {', '.join(channels.enabled_providers)}")
|
|
else:
|
|
print(f" {'—':>3} IM channels: disabled")
|
|
print()
|
|
print("Next steps:")
|
|
print(f" {cyan('make install')} # Install dependencies (first time only)")
|
|
print(f" {cyan('make dev')} # Start DeerFlow")
|
|
print()
|
|
print(f"Run {cyan('make doctor')} to verify your setup at any time.")
|
|
print()
|
|
return 0
|
|
except KeyboardInterrupt:
|
|
print("\n\nSetup cancelled.")
|
|
return 130
|
|
|
|
|
|
if __name__ == "__main__":
|
|
sys.exit(main())
|