AI Agent Coding & Development Case Hub: Verified-Source Records on Docs, Migrations, Builds, and Parallel Agents
Data basis and how to read this page. This domain holds 345 published cases (site statistics, 2026-11-09). This page draws only on 10 of them that we read line by line and re-checked for source accessibility (10/10 reachable, verified 2026-11-09). Every figure here is source-reported; this site has independently re-tested none of them. Re-check the original source before citing any number.
Who this page is for, and what it promises. For engineers and technical leads evaluating whether to hand development work to AI agents. After this page you can state: which development task types have publicly traceable records, where humans stand in each (the five-bucket model: setup / preparation / oversight / review / exception handling), who vouches for each disclosed number, and under what conditions these attempts fail.
Task map
Six task types with verified examples (each with its boundary):
- Documentation generation & upkeep — engineering discussions → doc drafts → human review of every page. Boundary: conceptual errors need a domain expert as the safety net; line-count metrics are the easiest to inflate.
- Examples: Fern writer workflow (~20k new doc lines/mo across ~500 pages, self-reported, not single-tool attributable); Aspire cross-repo docs PRs (396 runs, 82 merged PRs in a rolling 30-day window, vendor-reported).
- Deep dive: our task guide How AI assists technical documentation — a single-workflow read with evidence boundaries; this hub does not repeat it.
- Large-scale migration & upgrades — legacy stacks, framework/language/database moves across batches of services. Boundary: "zero bugs" is usually a handoff-time state, not a production conclusion; total time and cost often go undisclosed.
- Examples: Solo legacy migration (95%+ API coverage at QA handoff, self-reported); Brex 180 microservices (~90% lower cost per service, company engineering blog).
- Small-scope fixes & PRs — well-defined single defects. Boundary: complex full-stack tasks were still rewritten by humans; don't extrapolate "5 minutes per small task" to all tasks.
- Example: RunLLM delegating minor fixes to Devin (~5 min human testing per small task; complex tasks failed and were rewritten).
- Greenfield builds & scaffolding — new services, full-stack project setup. Boundary: environment/dependency setup is the most common stall; vague prompts cause irreversible deletions.
- Examples: Copilot agent mode full-stack (all models initially failed on React/Tailwind v4/ShadCN setup); Cursor scaffolding Terraform/k8s/CI (spec-compliant, but a vague "cleanup" prompt deleted 14 files).
- Parallel agents & long runs — multi-session/multi-container division of labor. Boundary: coordination cost is underestimated; research prototypes are not production designs.
- Examples: 16 agents building a C compiler (
2,000 sessions, $20k API, 100k lines; author is an Anthropic researcher); [10 parallel Claude sessions](/cases/bcce5845-b8c2-81ce-4273-dbcbb536bb20/en) (index-transcribed, unverified).
- Examples: 16 agents building a C compiler (
- Low-level & kernel patches — performance-sensitive system code. Boundary: press coverage ≠ merged fact; a branch-only patch is not production-validated.
- Example: Claude Code drafting a Linux kernel patch (branch only; merge into the window unconfirmed).
For all 345 records (mostly not line-checked by us), browse the full catalog by category.
Comparison table
| Case | Tool | Scale | Human role (5-bucket) | Source-disclosed results | Disclosed failure points | Evidence |
|---|---|---|---|---|---|---|
| Fern docs workflow | Devin, Claude Code | ~500 pages | Review (every page), exception handling (engineer corrections) | ~20,000 new doc lines/mo (self-reported, not independently verified, not single-tool attributable) | PDF draft organization off; changelog omitted; auth-doc concept errors | User-shared |
| Aspire docs PRs | GitHub Agentic Workflows | Cross-repo pipeline | Review (mandatory per-PR approval) | 396 runs, 82 merged PRs, 44.8h median merge in a rolling 30-day window (May 3 – June 2, 2026; vendor-reported) | Not disclosed by source | Vendor self-report |
| Solo legacy migration | Claude Code | 4→2 repos, full stack | Review (pre-execution plans), oversight (Confluence/Jira) | 95%+ API / 91% frontend coverage, zero bugs at QA handoff; ~50 tickets, 580 tests; ~15 work days, close to $5,000 in API tokens via AWS Bedrock (self-reported) | Confluence large edits via comments; Jira link creation via MCP fails | User-shared |
| Brex microservice migration | Cursor (self-hosted agents) | 180 services / 1 month | Setup (Linear tickets), review (mandatory before production merge) | Cost per migration down ~90% (infra + token costs vs engineering time); first manual attempt: 3 engineers, ~50 services in a quarter | First "single giant agent" attempt failed | User-shared (company eng blog) |
| Devin small fixes | Devin | Single defects | Setup (task boundaries), review (tests & PRs) | ~5 min human testing per small task (source claim) | Complex full-stack tasks failed, team rewrote | User-shared (index-transcribed) |
| Copilot agent mode | GitHub Copilot, Claude | Full-stack from scratch | Oversight (babysitting shell), prep (spec/tasks/instructions) | Completion time not disclosed | All models initially failed React/Tailwind v4/ShadCN setup; routine steps needed manual intervention | User-shared |
| Cursor scaffolding | Cursor | Terraform/k8s/CI | Review (PRs) | Run duration not disclosed | Vague "cleanup" prompt deleted 14 files | User-shared |
| 16-agent C compiler | Claude Code (16 instances) | 100k-line compiler building Linux 6.9 | Setup (harness, task locks); ongoing involvement not stated | ~2,000 sessions, $20k API (author-reported) | Zero-context containers slow orientation; author calls it a very early research prototype | Vendor self-report (Anthropic eng blog) |
| Parallel Claude sessions | Claude Code | ~10 parallel sessions | Setup (spec planning); division of labor not stated | No independently verifiable metrics disclosed | Conflict/cost/coverage coordination unquantified | User-shared (index-transcribed) |
| Linux kernel patch | Claude Code | Single-branch kernel patch | Oversight (Torvalds directed), review (human-run measurements) | Phoronix calls performance impact significant (chart referenced) | Unmerged; production value unverified | User-shared (press report) |
Cross-case conclusions
- Every quantified result is source-reported; we have re-run none of them. 10/10. Check the original before citing a number.
- Human involvement concentrates in setup and review; zero hands-off success stories in this sample. Even the closest case (Aspire) makes per-PR human approval mandatory.
- The same specific failure patterns recur: environment/dependency setup stalls, vague prompts causing deletions, concept errors needing domain experts.
- Demo ≠ production. The kernel patch is branch-only; the C compiler's author calls it a research prototype; "zero bugs at QA handoff" is a point-in-time state.
- Numbers don't attribute cleanly to tools. Fern's ~20k lines can't be credited to one tool; team gains usually change process and tools at once.
Verify it yourself
- Open any case in the table and click its original source: confirm it is reachable, note the measurement window (e.g., May 3 – June 2, 2026), and check who the author is.
- Read the evidence label on the case page: treat "vendor self-report" as promotional, and for "index-transcribed" entries, re-check against the original.
- Compare each case-page figure against the original source, watching the units — a "44.8-hour median time-to-merge" is not generation time; "~20k lines a month" is not one tool's output.
- Run the case page's "try it" prompt in your own environment for two weeks and record your own error rates and human hours instead of quoting someone else's savings.
- Revisit this table as a reminder: this site has re-tested no numbers; replace every figure with your own pilot data before deciding.
Next steps
- Start small: pick small-scope fixes or docs-PR automation (clear boundaries, cheap rollback), run a two-week pilot with the case page's "try it," and log your own error rates.
- Go deeper on documentation: read the task guide How AI assists technical documentation (a Fern-based, single-workflow deep dive).
- Keep exploring: browse the full catalog under "Software & development" for all 345 records (mostly not line-checked by us).
- After you try: share your practice and numbers via the submission form on the homepage, noting the source and how humans stayed involved.