Add CoEvoke dataset to ChatDev README

This commit is contained in:
zhoutianle 2026-11-06 15:35:49 +08:00
parent c0826fd705
commit 3275e33f11
6 changed files with 84 additions and 12 deletions

View File

@ -9,8 +9,8 @@
<p>让工具、模型、技能和智能体按计划协作完成任务。</p>
<p>
<a href="#quick-start"><img src="execorchestra/docs/assets/nav-start-zh.svg" height="28" alt="快速开始"></a>&nbsp;
<a href="execorchestra/docs/SERVICES.md"><img src="execorchestra/docs/assets/nav-services-zh.svg" height="28" alt="模型与服务"></a>&nbsp;
<a href="#documentation"><img src="execorchestra/docs/assets/nav-docs-zh.svg" height="28" alt="项目文档"></a>
<a href="#documentation"><img src="execorchestra/docs/assets/nav-docs-zh.svg" height="28" alt="项目文档"></a>&nbsp;
<a href="https://huggingface.co/datasets/Some-thy/CoEvoke"><img src="execorchestra/docs/assets/nav-hugging-face.svg" height="28" alt="在 Hugging Face 查看 CoEvoke"></a>
</p>
<p><a href="README.md">English</a> · <strong>简体中文</strong></p>
</div>
@ -211,6 +211,18 @@ bash scripts/run_xbench_demo.sh
</details>
## 🤗 相关数据集
**CoEvoke** (https://huggingface.co/datasets/Some-thy/CoEvoke) 收录了软件工程、数学推理、自然语言逻辑推理和逻辑网格谜题中的多智能体协作片段。每条片段保留智能体间的消息、工具交互和中间评审结果,可用于分析协作过程,也可作为训练智能体协同完成任务的轨迹样本。
| 来源 | 母轨迹 | 去重任务 | 单轮片段 | 相邻双轮片段 | 片段合计 |
| --- | ---: | ---: | ---: | ---: | ---: |
| SWE (`swe_oracle`) | 1,763 | 1,763 | 3,315 | 1,552 | 4,867 |
| DeepMath (`deepmath`) | 923 | 831 | 1,656 | 733 | 2,389 |
| ProofWriter (`proofwriter`) | 1,392 | 1,096 | 2,315 | 923 | 3,238 |
| ZebraLogic (`zebra`) | 489 | 440 | 905 | 416 | 1,321 |
| **合计** | **4,567** | **4,130** | **8,191** | **3,624** | **11,815** |
<a id="documentation"></a>
## 📚 项目文档

View File

@ -9,8 +9,8 @@
<p>Coordinate tools, models, skills, and agents through executable plans.</p>
<p>
<a href="#quick-start"><img src="execorchestra/docs/assets/nav-start-en.svg" height="28" alt="Quick start"></a>&nbsp;
<a href="execorchestra/docs/SERVICES.md"><img src="execorchestra/docs/assets/nav-services-en.svg" height="28" alt="Models and services"></a>&nbsp;
<a href="#documentation"><img src="execorchestra/docs/assets/nav-docs-en.svg" height="28" alt="Documentation"></a>
<a href="#documentation"><img src="execorchestra/docs/assets/nav-docs-en.svg" height="28" alt="Documentation"></a>&nbsp;
<a href="https://huggingface.co/datasets/Some-thy/CoEvoke"><img src="execorchestra/docs/assets/nav-hugging-face.svg" height="28" alt="View CoEvoke on Hugging Face"></a>
</p>
<p><strong>English</strong> · <a href="README-zh.md">简体中文</a></p>
</div>
@ -207,6 +207,18 @@ This XBench DeepSearch-2510 task asks for the name of a coauthor of an XBench pa
</details>
## 🤗 Related Dataset
**CoEvoke** (https://huggingface.co/datasets/Some-thy/CoEvoke) captures multi-agent collaboration across software engineering, mathematical reasoning, natural-language logical reasoning, and logic-grid puzzles. Each episode records agent messages, tool interactions, and intermediate review decisions, providing trajectory examples for analyzing coordination and training agents to work together.
| Source | Parent trajectories | Canonical tasks | Single-loop | Adjacent double-loop | Total episodes |
| --- | ---: | ---: | ---: | ---: | ---: |
| SWE (`swe_oracle`) | 1,763 | 1,763 | 3,315 | 1,552 | 4,867 |
| DeepMath (`deepmath`) | 923 | 831 | 1,656 | 733 | 2,389 |
| ProofWriter (`proofwriter`) | 1,392 | 1,096 | 2,315 | 923 | 3,238 |
| ZebraLogic (`zebra`) | 489 | 440 | 905 | 416 | 1,321 |
| **Total** | **4,567** | **4,130** | **8,191** | **3,624** | **11,815** |
<a id="documentation"></a>
## 📚 Documentation

View File

@ -1,7 +1,7 @@
b2fee92cd5927b6b07a46056f85b2423e6c1986a11535bcf03712be6bf0a4bc5 .gitattributes
9351a1a5ccd6b2df3e4bc9b798acc394033a17b7dab4ca79169bcf1d876f529d .gitignore
a413fe221db8a6d16f6c8916a5310a80cb15ce01d47149b5e79d8137bb87d77c README-zh.md
040311dee6d92e01ce9956777549ec13d52d29167fc9583d4d295023fe547237 README.md
4f1fab63c9f77294ceb3d2b6ffef21e57b5b3668d98908fc5bae40d0e2bc92cc README-zh.md
5420e1466db8d54e572c7a9ca7e1eb3ed002d4434c0a382b278fdce816f77941 README.md
ddc517e3f9166aaddaf4e0e132b446d3f69fa935eae4b33629154b92f73e005a execorchestra/.dockerignore
5514d531ff0fbd931525f6d8296fbb64e6c4b0811bc981e18b05f44e88eb549b execorchestra/.env.example
f60f533fd856b0eb1b15db2baccfcf22a077f9deba440e23f5323f4666ac7754 execorchestra/.gitignore
@ -2114,8 +2114,9 @@ a29bb5bcfdf31c04e24a80d5c5750dd03b4da86758c942416d22c50b3479d887 execorchestra/
cee1779323a69069a768ad7dea1805cdda272315968443cb4986893adccd99b0 execorchestra/docs/assets/mode-direct.svg
91e9de2f43baf26f45d714594a3347a925686552f536134fe5e5519d74cfe9b4 execorchestra/docs/assets/mode-extended.svg
22ed5ca84598804976b8c1a9b4f1955c96be84369219520d5e473da45b8cd278 execorchestra/docs/assets/mode-localized.svg
6532595e5070d2fd0df51c00b7be786a8cf43a39efa0fcc1fe49d50b066f316d execorchestra/docs/assets/nav-docs-en.svg
eea638176230b1d1cb268d40d6733142aa416451619ed2b3cd1ddb98838442ce execorchestra/docs/assets/nav-docs-zh.svg
71a2a58fe13ff64880458ea6c6c6fb80b0692bd181e36a57a3636cb1f531d0a1 execorchestra/docs/assets/nav-docs-en.svg
ec1854a245cbe6edf228843f9c8562e40ef7ed795d0a28f3af722bd6a5c2acdb execorchestra/docs/assets/nav-docs-zh.svg
da8054a248b43bcb6721b46742f4e158cdd3c3a4ffed177247dc8a3b9abe83b3 execorchestra/docs/assets/nav-hugging-face.svg
1ceef571aa58181f7f1846d8482dcf2055e17b6f26829c39db9dc4e43749d435 execorchestra/docs/assets/nav-services-en.svg
f9d35260fb467b300cbca5104f98a7ad8ada7228908710980a6d8edd68a14822 execorchestra/docs/assets/nav-services-zh.svg
ce5b3854f2f602c661ef8112fb4da97b586b42a6589e4347446aa4ce5b9416ae execorchestra/docs/assets/nav-start-en.svg

View File

@ -1,9 +1,9 @@
<svg xmlns="http://www.w3.org/2000/svg" width="118" height="28" viewBox="0 0 118 28" role="img" aria-labelledby="title">
<title id="title">Docs · Explore</title>
<rect width="118" height="28" rx="3" fill="#46576A"/>
<path d="M48 0H115Q118 0 118 3V25Q118 28 115 28H48Z" fill="#F0DDA7"/>
<path d="M48 0H115Q118 0 118 3V25Q118 28 115 28H48Z" fill="#12847E"/>
<g fill="#fff" text-anchor="middle" font-family="Segoe UI, Helvetica, Arial, sans-serif" font-size="12" font-weight="600">
<text x="24" y="18.5">Docs</text>
<text fill="#66522A" x="83" y="18.5">Explore</text>
<text x="83" y="18.5">Explore</text>
</g>
</svg>

Before

Width:  |  Height:  |  Size: 535 B

After

Width:  |  Height:  |  Size: 520 B

View File

@ -1,9 +1,9 @@
<svg xmlns="http://www.w3.org/2000/svg" width="138" height="28" viewBox="0 0 138 28" role="img" aria-labelledby="title">
<title id="title">项目文档 · 查看指南</title>
<rect width="138" height="28" rx="3" fill="#46576A"/>
<path d="M68 0H135Q138 0 138 3V25Q138 28 135 28H68Z" fill="#F0DDA7"/>
<path d="M68 0H135Q138 0 138 3V25Q138 28 135 28H68Z" fill="#12847E"/>
<g fill="#fff" text-anchor="middle" font-family="Segoe UI, Helvetica, Arial, sans-serif" font-size="12" font-weight="600">
<text x="34" y="18.5">项目文档</text>
<text fill="#66522A" x="103" y="18.5">查看指南</text>
<text x="103" y="18.5">查看指南</text>
</g>
</svg>

Before

Width:  |  Height:  |  Size: 562 B

After

Width:  |  Height:  |  Size: 547 B

View File

@ -0,0 +1,47 @@
<svg xmlns="http://www.w3.org/2000/svg" width="190" height="28" viewBox="0 0 190 28" role="img" aria-labelledby="title">
<title id="title">Hugging Face · CoEvoke</title>
<rect width="190" height="28" rx="3" fill="#46576A"/>
<path d="M122 0H187Q190 0 190 3V25Q190 28 187 28H122Z" fill="#F0DDA7"/>
<!-- Official Hugging Face icon: https://huggingface.co/front/assets/huggingface_logo-noborder.svg -->
<svg x="9" y="5.5" width="18" height="17" viewBox="0 0 95 88" fill="none" aria-hidden="true">
<path fill="#FFD21E" d="M47.21 76.5a34.75 34.75 0 1 0 0-69.5 34.75 34.75 0 0 0 0 69.5Z" />
<path
fill="#FF9D0B"
d="M81.96 41.75a34.75 34.75 0 1 0-69.5 0 34.75 34.75 0 0 0 69.5 0Zm-73.5 0a38.75 38.75 0 1 1 77.5 0 38.75 38.75 0 0 1-77.5 0Z"
/>
<path
fill="#3A3B45"
d="M58.5 32.3c1.28.44 1.78 3.06 3.07 2.38a5 5 0 1 0-6.76-2.07c.61 1.15 2.55-.72 3.7-.32ZM34.95 32.3c-1.28.44-1.79 3.06-3.07 2.38a5 5 0 1 1 6.76-2.07c-.61 1.15-2.56-.72-3.7-.32Z"
/>
<path
fill="#FF323D"
d="M46.96 56.29c9.83 0 13-8.76 13-13.26 0-2.34-1.57-1.6-4.09-.36-2.33 1.15-5.46 2.74-8.9 2.74-7.19 0-13-6.88-13-2.38s3.16 13.26 13 13.26Z"
/>
<path
fill="#3A3B45"
fill-rule="evenodd"
d="M39.43 54a8.7 8.7 0 0 1 5.3-4.49c.4-.12.81.57 1.24 1.28.4.68.82 1.37 1.24 1.37.45 0 .9-.68 1.33-1.35.45-.7.89-1.38 1.32-1.25a8.61 8.61 0 0 1 5 4.17c3.73-2.94 5.1-7.74 5.1-10.7 0-2.34-1.57-1.6-4.09-.36l-.14.07c-2.31 1.15-5.39 2.67-8.77 2.67s-6.45-1.52-8.77-2.67c-2.6-1.29-4.23-2.1-4.23.29 0 3.05 1.46 8.06 5.47 10.97Z"
clip-rule="evenodd"
/>
<path
fill="#FF9D0B"
d="M70.71 37a3.25 3.25 0 1 0 0-6.5 3.25 3.25 0 0 0 0 6.5ZM24.21 37a3.25 3.25 0 1 0 0-6.5 3.25 3.25 0 0 0 0 6.5ZM17.52 48c-1.62 0-3.06.66-4.07 1.87a5.97 5.97 0 0 0-1.33 3.76 7.1 7.1 0 0 0-1.94-.3c-1.55 0-2.95.59-3.94 1.66a5.8 5.8 0 0 0-.8 7 5.3 5.3 0 0 0-1.79 2.82c-.24.9-.48 2.8.8 4.74a5.22 5.22 0 0 0-.37 5.02c1.02 2.32 3.57 4.14 8.52 6.1 3.07 1.22 5.89 2 5.91 2.01a44.33 44.33 0 0 0 10.93 1.6c5.86 0 10.05-1.8 12.46-5.34 3.88-5.69 3.33-10.9-1.7-15.92-2.77-2.78-4.62-6.87-5-7.77-.78-2.66-2.84-5.62-6.25-5.62a5.7 5.7 0 0 0-4.6 2.46c-1-1.26-1.98-2.25-2.86-2.82A7.4 7.4 0 0 0 17.52 48Zm0 4c.51 0 1.14.22 1.82.65 2.14 1.36 6.25 8.43 7.76 11.18.5.92 1.37 1.31 2.14 1.31 1.55 0 2.75-1.53.15-3.48-3.92-2.93-2.55-7.72-.68-8.01.08-.02.17-.02.24-.02 1.7 0 2.45 2.93 2.45 2.93s2.2 5.52 5.98 9.3c3.77 3.77 3.97 6.8 1.22 10.83-1.88 2.75-5.47 3.58-9.16 3.58-3.81 0-7.73-.9-9.92-1.46-.11-.03-13.45-3.8-11.76-7 .28-.54.75-.76 1.34-.76 2.38 0 6.7 3.54 8.57 3.54.41 0 .7-.17.83-.6.79-2.85-12.06-4.05-10.98-8.17.2-.73.71-1.02 1.44-1.02 3.14 0 10.2 5.53 11.68 5.53.11 0 .2-.03.24-.1.74-1.2.33-2.04-4.9-5.2-5.21-3.16-8.88-5.06-6.8-7.33.24-.26.58-.38 1-.38 3.17 0 10.66 6.82 10.66 6.82s2.02 2.1 3.25 2.1c.28 0 .52-.1.68-.38.86-1.46-8.06-8.22-8.56-11.01-.34-1.9.24-2.85 1.31-2.85Z"
/>
<path
fill="#FFD21E"
d="M38.6 76.69c2.75-4.04 2.55-7.07-1.22-10.84-3.78-3.77-5.98-9.3-5.98-9.3s-.82-3.2-2.69-2.9c-1.87.3-3.24 5.08.68 8.01 3.91 2.93-.78 4.92-2.29 2.17-1.5-2.75-5.62-9.82-7.76-11.18-2.13-1.35-3.63-.6-3.13 2.2.5 2.79 9.43 9.55 8.56 11-.87 1.47-3.93-1.71-3.93-1.71s-9.57-8.71-11.66-6.44c-2.08 2.27 1.59 4.17 6.8 7.33 5.23 3.16 5.64 4 4.9 5.2-.75 1.2-12.28-8.53-13.36-4.4-1.08 4.11 11.77 5.3 10.98 8.15-.8 2.85-9.06-5.38-10.74-2.18-1.7 3.21 11.65 6.98 11.76 7.01 4.3 1.12 15.25 3.49 19.08-2.12Z"
/>
<path
fill="#FF9D0B"
d="M77.4 48c1.62 0 3.07.66 4.07 1.87a5.97 5.97 0 0 1 1.33 3.76 7.1 7.1 0 0 1 1.95-.3c1.55 0 2.95.59 3.94 1.66a5.8 5.8 0 0 1 .8 7 5.3 5.3 0 0 1 1.78 2.82c.24.9.48 2.8-.8 4.74a5.22 5.22 0 0 1 .37 5.02c-1.02 2.32-3.57 4.14-8.51 6.1-3.08 1.22-5.9 2-5.92 2.01a44.33 44.33 0 0 1-10.93 1.6c-5.86 0-10.05-1.8-12.46-5.34-3.88-5.69-3.33-10.9 1.7-15.92 2.78-2.78 4.63-6.87 5.01-7.77.78-2.66 2.83-5.62 6.24-5.62a5.7 5.7 0 0 1 4.6 2.46c1-1.26 1.98-2.25 2.87-2.82A7.4 7.4 0 0 1 77.4 48Zm0 4c-.51 0-1.13.22-1.82.65-2.13 1.36-6.25 8.43-7.76 11.18a2.43 2.43 0 0 1-2.14 1.31c-1.54 0-2.75-1.53-.14-3.48 3.91-2.93 2.54-7.72.67-8.01a1.54 1.54 0 0 0-.24-.02c-1.7 0-2.45 2.93-2.45 2.93s-2.2 5.52-5.97 9.3c-3.78 3.77-3.98 6.8-1.22 10.83 1.87 2.75 5.47 3.58 9.15 3.58 3.82 0 7.73-.9 9.93-1.46.1-.03 13.45-3.8 11.76-7-.29-.54-.75-.76-1.34-.76-2.38 0-6.71 3.54-8.57 3.54-.42 0-.71-.17-.83-.6-.8-2.85 12.05-4.05 10.97-8.17-.19-.73-.7-1.02-1.44-1.02-3.14 0-10.2 5.53-11.68 5.53-.1 0-.19-.03-.23-.1-.74-1.2-.34-2.04 4.88-5.2 5.23-3.16 8.9-5.06 6.8-7.33-.23-.26-.57-.38-.98-.38-3.18 0-10.67 6.82-10.67 6.82s-2.02 2.1-3.24 2.1a.74.74 0 0 1-.68-.38c-.87-1.46 8.05-8.22 8.55-11.01.34-1.9-.24-2.85-1.31-2.85Z"
/>
<path
fill="#FFD21E"
d="M56.33 76.69c-2.75-4.04-2.56-7.07 1.22-10.84 3.77-3.77 5.97-9.3 5.97-9.3s.82-3.2 2.7-2.9c1.86.3 3.23 5.08-.68 8.01-3.92 2.93.78 4.92 2.28 2.17 1.51-2.75 5.63-9.82 7.76-11.18 2.13-1.35 3.64-.6 3.13 2.2-.5 2.79-9.42 9.55-8.55 11 .86 1.47 3.92-1.71 3.92-1.71s9.58-8.71 11.66-6.44c2.08 2.27-1.58 4.17-6.8 7.33-5.23 3.16-5.63 4-4.9 5.2.75 1.2 12.28-8.53 13.36-4.4 1.08 4.11-11.76 5.3-10.97 8.15.8 2.85 9.05-5.38 10.74-2.18 1.69 3.21-11.65 6.98-11.76 7.01-4.31 1.12-15.26 3.49-19.08-2.12Z"
/>
</svg>
<g fill="#fff" text-anchor="middle" font-family="Segoe UI, Helvetica, Arial, sans-serif" font-size="12" font-weight="600">
<text x="74" y="18.5">Hugging Face</text>
<text fill="#66522A" x="157" y="18.5">CoEvoke</text>
</g>
</svg>

After

Width:  |  Height:  |  Size: 5.3 KiB