Summary
Overall Status: PARTIAL (Serena find_symbol unavailable via MCP; test #17 skipped)
PR used for review testing: #17983 (copilot/add-dependabot-permission-checks)
Run: §22330477648 · 2026-02-24
Core Test Results
| # |
Test |
Result |
| 1 |
GitHub MCP: Last 2 merged PRs |
✅ #17999, #17996 |
| 2 |
Safe Inputs GH CLI: Query 2 PRs |
✅ #17997, #17986 |
| 3 |
Serena MCP: activate_project + find_symbol |
⚠️ activate ✅ / find_symbol ❌ (MCP EOF) |
| 4 |
Make Build |
✅ go build succeeded |
| 5 |
Playwright: GitHub page title |
✅ "GitHub · Change is constant..." |
| 6 |
Tavily Web Search |
✅ 3 results for "GitHub Agentic Workflows" |
| 7 |
File Writing: smoke test file |
✅ /tmp/gh-aw/agent/smoke-test-claude-22330477648.txt |
| 8 |
Bash Tool: verify file |
✅ cat confirmed contents |
| 9 |
Discussion Interaction: #17998 |
✅ comment added |
| 10 |
Agentic Workflows MCP: smoke-claude status |
✅ active, compiled |
PR Review Test Results (#17983)
| # |
Test |
Result |
| 11 |
Update PR body |
✅ appended test marker |
| 12 |
PR Review Comments (2) |
✅ on smoke-codex.md:15 and compiler_activation_jobs.go:943 |
| 13 |
Submit PR Review |
✅ COMMENT submitted |
| 14 |
Resolve Review Thread |
✅ PRRT_kwDOPc1QR85wQwD6 resolved |
| 15 |
Add Reviewer |
✅ copilot added |
| 16 |
Push to PR Branch |
✅ smoke-test-22330477648.txt pushed |
| 17 |
Close PR |
⚠️ skipped — no safe test PR to close |
Test #3 Error Detail
mcp__serena__find_symbol and mcp__serena__get_symbols_overview both returned:
MCP error 0: connection closed: calling "tools/call": client is closing: EOF
activate_project succeeded. The LSP-backed symbol search tools encountered repeated EOF disconnects.
Test #10 Detail
[{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active",
"time_remaining":"N/A","on":{"pull_request":{"names":["smoke"],"types":["labeled"]},
"reaction":"heart","schedule":"every 12h","status-comment":true}}]
💥 [THE END] — Illustrated by Smoke Claude
Summary
Overall Status: PARTIAL (Serena
find_symbolunavailable via MCP; test #17 skipped)PR used for review testing: #17983 (
copilot/add-dependabot-permission-checks)Run: §22330477648 · 2026-02-24
Core Test Results
go buildsucceeded/tmp/gh-aw/agent/smoke-test-claude-22330477648.txtcatconfirmed contentsPR Review Test Results (#17983)
smoke-codex.md:15andcompiler_activation_jobs.go:943PRRT_kwDOPc1QR85wQwD6resolvedcopilotaddedsmoke-test-22330477648.txtpushedTest #3 Error Detail
mcp__serena__find_symbolandmcp__serena__get_symbols_overviewboth returned:activate_projectsucceeded. The LSP-backed symbol search tools encountered repeated EOF disconnects.Test #10 Detail
[{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active", "time_remaining":"N/A","on":{"pull_request":{"names":["smoke"],"types":["labeled"]}, "reaction":"heart","schedule":"every 12h","status-comment":true}}]