mirror of
https://github.com/bytedance/deer-flow.git
synced 2026-09-15 00:19:14 +00:00
* feat(projects): project workspaces with scoped chats and thread membership
Backend:
- projects table model and migration; fail-closed ProjectRepository with
ownership checks, CRUD/archive/restore/delete router, and atomic thread
move between projects
- threads_meta.project_id column exposed as reserved deerflow_project_id
metadata; project-aware thread create/search with pagination bounds and
membership echoed in create responses
- first-run admission assigns the project only at genuine first run, seeded
at write time and dropped when invalid; serialized against project
deletion and thread assignment
- branch creation inherits the source thread's project membership (an
archived/deleted project degrades the branch to unassigned instead of
failing the request)
Frontend:
- projects data layer, thread move API, and sidebar projects section with
flat/grouped modes, archived-project threads, and stable virtual-list
offsets
- project detail page with project-scoped new chat
(/workspace/chats/new?project=) and paginated thread list
- move-to-project thread menu, new-project dialog, archived-project gates
- project-scoped new chats pre-create the thread with membership before the
first submit or /goal set, so runs never proceed outside the project
- goal-set preparation is fenced against conversation switches: a stale
continuation is dropped instead of saving the goal or launching the
abandoned submission on the newly opened conversation
- project thread lists join thread lifecycle invalidations (stop, pin) so
an open project page never keeps stale titles, recency, or pagination
* fix(chats): keep archive undo toast when the sidebar row unmounts
The archive success toast was fired from per-mutate callbacks passed to
mutation.mutate. React Query drops those handlers when the observer
component unmounts before the mutation settles; archiving the open chat
removes its sidebar row mid-flight, so the undo toast never appeared and
the e2e archive-undo test timed out waiting for it.
Move the success/error handlers to the mutation level (useArchiveThread
options, same pattern as useMoveThreadToProject) where callbacks are
delivered even after the originating row unmounts.
* fix(projects): pin project thread listing contract and exclude archived chats
GET /api/projects/{id}/threads returned the thread store row verbatim
(list[dict], no response_model): user_id/assistant_id leaked, any future
ThreadMetaRow column would auto-leak, and the OpenAPI schema was empty.
Return a narrow ProjectThreadResponse (the exact fields ProjectThread
declares) with the same metadata secret redaction the surrounding thread
endpoints get from _MetadataRedactingResponse.
The listing also ran search() without the archived filter, so a retired
chat rendered as a normal row on the project page while the sidebar hid
it. Search archived=False to mirror the sidebar's archived:false lists;
restore stays on the global Archived tab.
Both regressions pinned by new router tests: wire-shape allowlist and
archived-member exclusion.
* docs(migrations): record the 0019/0020 chain against the bootstrap reservation
The tree now chains 0018 -> 0019_projects -> 0020_threads_meta_project_id,
so migrations/AGENTS.md was stale twice over: the revision index stopped at
0018 and the rolling-forward section still claimed the tree 'deliberately
remains at 0018'.
Document the new head and record the intentional numeric-prefix reuse of
0019: 0019_projects is in-chain while 0019_thread_incarnations stays the
reserved, allowlisted out-of-tree rollout id. The owning rollout revision
must re-parent onto this tree's head when it merges so alembic never sees
two heads off 0018; bootstrap.py now cross-references that note next to
_FORWARD_COMPATIBLE_REVISION.
* fix(chats): invalidate project thread lists on archive/restore
useArchiveThread refreshed the infinite sidebar cache, threads/search and
the per-thread metadata cache but not the project-scoped list
([...PROJECTS_QUERY_KEY, 'threads', id]) this PR adds — the one thread
mutation not wired to that key, after usePinThread, useRenameThread,
useDeleteThread, useMoveThreadToProject and invalidateStoppedThreadCaches.
An archive from a sidebar row while a project page is open therefore left
the archived chat rendered as a normal row until remount (and undo left it
missing). Invalidate the prefix in the mutation-level success handler.
Regression test asserts the project-list prefix is invalidated on success.
* fix(projects): fetch project discovery only in grouped sidebar mode
RecentChatList mounted two useProjects queries per sidebar render, but
knownProjectIds is consumed only by the grouped-mode exclusion filter; in
the default flat mode every page load paid two GET /api/projects?status=
round trips for data nothing read. Gate both queries on grouped mode —
GroupedProjectList fetches the same keys when the toggle is on and
TanStack dedupes the observers.
Also set retry: false on useProject: a deleted or foreign project 404s
deterministically, and the page renders a dedicated not-found state for
it, so the default 1s/2s/4s retry backoff kept deep links in 'loading'
for ~7s before that state appeared. Matches useThreadMetadata /
useThreadTokenUsage.
* fix(threads): fail closed on project-scoped create in memory mode
MemoryThreadMetaStore.create accepted project_id and silently ignored it,
making memory mode the one membership path that fails open: POST
/api/threads with a project id returned 200 and the run started
unassigned, violating the invariant that a run never proceeds outside the
selected project (the SQL store raises ProjectNotAssignableError inside
the insert transaction for the same request).
Raise ProjectNotAssignableError whenever project_id is present so the
router's existing 404 mapping applies, the frontend keeps the composer
text for a retry, and memory mode behaves exactly like SQL mode.
set_project already reports rejection; create now matches it.
Store-level test (raises, nothing persisted, project filter stays empty,
unscoped creates still work) plus a router-level test asserting the 404
and that no row is left behind.
* fix(projects): window the project page thread list
ProjectThreadsSection rendered every loaded page as a plain Link row, so a
long-lived project accumulated unbounded DOM on the page's scroll surface:
each load-more appended another 100 rows and every formatTimeAgo tick
re-rendered the whole list.
Reuse VirtualThreadList (now generic over any row shape with a
thread_id), pointing its scroll parent at this page's ScrollArea viewport
via the shared [data-slot="scroll-area-viewport"] selector used by
/workspace/chats; under the 60-row threshold it falls back to the plain
render, so small projects are unchanged.
* fix(projects): restore row dividers and pin them with a render test
The row class template literal concatenated transition-colors directly
with the conditional border-b token, so non-final rows rendered the
invalid class 'transition-colorsborder-b' and lost both the divider and
the transition. Compose the row classes with cn() and a boolean guard
instead.
The section moved out of page.tsx into a testable component so the row
markup finally has coverage: a DOM test asserts every row except the
final data row carries border-b (index-based, not last: — correct under
virtualization where the last mounted row is not the last data row), and
the untitled fallback plus load-more button render for a partial page.
* fix(projects): validate forward schemas and fence membership reads
237 lines
7.6 KiB
Python
237 lines
7.6 KiB
Python
"""Owner isolation tests for MemoryThreadMetaStore.
|
|
|
|
Mirrors the SQL-backed tests in test_owner_isolation.py but exercises
|
|
the in-memory LangGraph Store backend used when database.backend=memory.
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
from types import SimpleNamespace
|
|
|
|
import pytest
|
|
from langgraph.store.memory import InMemoryStore
|
|
|
|
from deerflow.persistence.projects import ProjectNotAssignableError
|
|
from deerflow.persistence.thread_meta.memory import MemoryThreadMetaStore
|
|
from deerflow.runtime.user_context import reset_current_user, set_current_user
|
|
|
|
USER_A = SimpleNamespace(id="user-a", email="a@test.local")
|
|
USER_B = SimpleNamespace(id="user-b", email="b@test.local")
|
|
|
|
|
|
def _as_user(user):
|
|
class _Ctx:
|
|
def __enter__(self):
|
|
self._token = set_current_user(user)
|
|
return user
|
|
|
|
def __exit__(self, *exc):
|
|
reset_current_user(self._token)
|
|
|
|
return _Ctx()
|
|
|
|
|
|
@pytest.fixture
|
|
def store():
|
|
return MemoryThreadMetaStore(InMemoryStore())
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_search_isolation(store):
|
|
"""search() returns only threads owned by the current user."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha", display_name="A's thread")
|
|
with _as_user(USER_B):
|
|
await store.create("t-beta", display_name="B's thread")
|
|
|
|
with _as_user(USER_A):
|
|
results = await store.search()
|
|
assert [r["thread_id"] for r in results] == ["t-alpha"]
|
|
|
|
with _as_user(USER_B):
|
|
results = await store.search()
|
|
assert [r["thread_id"] for r in results] == ["t-beta"]
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_search_matches_nested_thread_metadata(store):
|
|
with _as_user(USER_A):
|
|
await store.create("root", metadata={})
|
|
await store.create("child", metadata={"branch_parent_thread_id": "root"})
|
|
await store.create("other", metadata={"branch_parent_thread_id": "elsewhere"})
|
|
|
|
results = await store.search(metadata={"branch_parent_thread_id": "root"})
|
|
|
|
assert [record["thread_id"] for record in results] == ["child"]
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_search_metadata_preserves_json_type_and_presence_contract(store):
|
|
with _as_user(USER_A):
|
|
await store.create("missing", metadata={})
|
|
await store.create("null", metadata={"value": None})
|
|
await store.create("bool", metadata={"value": True})
|
|
await store.create("int", metadata={"value": 1})
|
|
await store.create("float", metadata={"value": 1.0})
|
|
|
|
null_hits = await store.search(metadata={"value": None})
|
|
bool_hits = await store.search(metadata={"value": True})
|
|
int_hits = await store.search(metadata={"value": 1})
|
|
float_hits = await store.search(metadata={"value": 1.0})
|
|
|
|
assert [record["thread_id"] for record in null_hits] == ["null"]
|
|
assert [record["thread_id"] for record in bool_hits] == ["bool"]
|
|
assert [record["thread_id"] for record in int_hits] == ["int"]
|
|
assert {record["thread_id"] for record in float_hits} == {"float", "int"}
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_update_display_name_can_remove_stale_metadata(store):
|
|
with _as_user(USER_A):
|
|
await store.create(
|
|
"branch",
|
|
display_name="Original (2)",
|
|
metadata={"branch_title_sequence": 2, "keep": True},
|
|
)
|
|
await store.update_display_name(
|
|
"branch",
|
|
"Report Q4",
|
|
remove_metadata_keys=("branch_title_sequence",),
|
|
)
|
|
result = await store.get("branch")
|
|
|
|
assert result is not None
|
|
assert result["display_name"] == "Report Q4"
|
|
assert result["metadata"] == {"keep": True}
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_get_isolation(store):
|
|
"""get() returns None for threads owned by another user."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha", display_name="A's thread")
|
|
|
|
with _as_user(USER_B):
|
|
assert await store.get("t-alpha") is None
|
|
|
|
with _as_user(USER_A):
|
|
result = await store.get("t-alpha")
|
|
assert result is not None
|
|
assert result["display_name"] == "A's thread"
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_update_display_name_denied(store):
|
|
"""User B cannot rename User A's thread."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha", display_name="original")
|
|
|
|
with _as_user(USER_B):
|
|
await store.update_display_name("t-alpha", "hacked")
|
|
|
|
with _as_user(USER_A):
|
|
row = await store.get("t-alpha")
|
|
assert row is not None
|
|
assert row["display_name"] == "original"
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_update_status_denied(store):
|
|
"""User B cannot change status of User A's thread."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha")
|
|
|
|
with _as_user(USER_B):
|
|
await store.update_status("t-alpha", "error")
|
|
|
|
with _as_user(USER_A):
|
|
row = await store.get("t-alpha")
|
|
assert row is not None
|
|
assert row["status"] == "idle"
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_update_metadata_denied(store):
|
|
"""User B cannot modify metadata of User A's thread."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha", metadata={"key": "original"})
|
|
|
|
with _as_user(USER_B):
|
|
await store.update_metadata("t-alpha", {"key": "hacked"})
|
|
|
|
with _as_user(USER_A):
|
|
row = await store.get("t-alpha")
|
|
assert row is not None
|
|
assert row["metadata"]["key"] == "original"
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_delete_denied(store):
|
|
"""User B cannot delete User A's thread."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha")
|
|
|
|
with _as_user(USER_B):
|
|
await store.delete("t-alpha")
|
|
|
|
with _as_user(USER_A):
|
|
row = await store.get("t-alpha")
|
|
assert row is not None
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_no_context_raises(store):
|
|
"""Calling methods without user context raises RuntimeError."""
|
|
with pytest.raises(RuntimeError, match="no user context is set"):
|
|
await store.search()
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_explicit_none_bypasses_filter(store):
|
|
"""user_id=None bypasses isolation (migration/CLI escape hatch)."""
|
|
with _as_user(USER_A):
|
|
await store.create("t-alpha")
|
|
with _as_user(USER_B):
|
|
await store.create("t-beta")
|
|
|
|
all_rows = await store.search(user_id=None)
|
|
assert {r["thread_id"] for r in all_rows} == {"t-alpha", "t-beta"}
|
|
|
|
row = await store.get("t-alpha", user_id=None)
|
|
assert row is not None
|
|
|
|
|
|
@pytest.mark.anyio
|
|
@pytest.mark.no_auto_user
|
|
async def test_create_with_project_id_fails_closed(store):
|
|
"""Memory mode has no projects backend; a create carrying a project id
|
|
must fail closed (ProjectNotAssignableError) instead of silently
|
|
persisting an unassigned thread — the router maps the error to 404 and
|
|
the frontend keeps the composer for a retry, matching the SQL store's
|
|
missing/foreign/archived project behavior."""
|
|
with _as_user(USER_A):
|
|
with pytest.raises(ProjectNotAssignableError):
|
|
await store.create("t-proj", project_id="p1")
|
|
|
|
# Nothing persisted, and the store's project filter fails closed too.
|
|
assert await store.search() == []
|
|
assert await store.search(project_id="p1") == []
|
|
|
|
# Unscoped creates still work.
|
|
await store.create("t-plain")
|
|
assert [r["thread_id"] for r in await store.search()] == ["t-plain"]
|
|
|
|
# Membership moves report rejection (never a silent unassign).
|
|
assert await store.set_project("t-plain", "p1") is False
|