Test Results — 2026-03-04
Overall Status: PARTIAL (all non-skipped tests passed, #17 skipped)
PR Used for Review Testing: #19576 (Update CLI versions)
Run: §22667873177
Core Tests (#1–10)
| # |
Test |
Result |
| 1 |
GitHub MCP Testing (last 2 merged PRs: #19570, #19539) |
✅ |
| 2 |
Safe Inputs GH CLI (queried PRs #19585, #19584) |
✅ |
| 3 |
Serena MCP (activated project; find_symbol returned 92k+ chars of symbols) |
✅ |
| 4 |
Make Build (make build succeeded, binary compiled) |
✅ |
| 5 |
Playwright (github.com title: "GitHub · Change is constant…") |
✅ |
| 6 |
Tavily Web Search ("GitHub Agentic Workflows" returned 3 results) |
✅ |
| 7 |
File Writing (/tmp/gh-aw/agent/smoke-test-claude-22667873177.txt created) |
✅ |
| 8 |
Bash Tool (file content verified via cat) |
✅ |
| 9 |
Discussion Interaction (discussion #19578, comic-book comment added) |
✅ |
| 10 |
Agentic Workflows MCP (smoke-claude: active, compiled, every 12h) |
✅ |
PR Review Safe Output Tests (#11–17)
| # |
Test |
Result |
| 11 |
Update PR body (appended test message) |
✅ |
| 12 |
PR Review Comments (2 comments on 2 different files) |
✅ |
| 13 |
Submit PR Review (COMMENT review submitted) |
✅ |
| 14 |
Resolve Review Thread (PRRT_kwDOPc1QR85yCkfW resolved) |
✅ |
| 15 |
Add Reviewer (copilot added) |
✅ |
| 16 |
Push to PR Branch (smoke test file committed and pushed) |
✅ |
| 17 |
Close PR |
⚠️ Skipped — no safe test PR to close |
Test Details
Test #3 — Serena: Project activated at /home/runner/work/gh-aw/gh-aw (Go, TypeScript, Bash). find_symbol("main") returned 92,548 chars of results (many symbols found).
Test #4 — Make Build: Output: go build -ldflags "-s -w -X main.version=cc1817c" -o gh-aw ./cmd/gh-aw — success.
Test #5 — Playwright: Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test #6 — Tavily: Top result: "My Experience with GitHub Agentic Workflows" (score: 0.9999924).
Test #10 — Agentic Workflows: smoke-claude workflow: engine=claude, compiled=Yes, status=active, triggers: PR (label: smoke), reaction: heart, schedule every 12h.
Test #12 — Review Comments:
.changeset/patch-update-cli-versions-20260304.md line 3: changeset type feedback.github/workflows/agent-performance-analyzer.lock.yml line 75: version bump note
Test #16 — Push: smoke-test-push-22667873177.txt committed and pushed to copilot/update-cli-versions.
💥 [THE END] — Illustrated by Smoke Claude · ◷
Test Results — 2026-03-04
Overall Status: PARTIAL (all non-skipped tests passed, #17 skipped)
PR Used for Review Testing: #19576 (Update CLI versions)
Run: §22667873177
Core Tests (#1–10)
find_symbolreturned 92k+ chars of symbols)make buildsucceeded, binary compiled)/tmp/gh-aw/agent/smoke-test-claude-22667873177.txtcreated)cat)smoke-claude: active, compiled, every 12h)PR Review Safe Output Tests (#11–17)
PRRT_kwDOPc1QR85yCkfWresolved)copilotadded)Test Details
Test #3 — Serena: Project activated at
/home/runner/work/gh-aw/gh-aw(Go, TypeScript, Bash).find_symbol("main")returned 92,548 chars of results (many symbols found).Test #4 — Make Build: Output:
go build -ldflags "-s -w -X main.version=cc1817c" -o gh-aw ./cmd/gh-aw— success.Test #5 — Playwright: Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test #6 — Tavily: Top result: "My Experience with GitHub Agentic Workflows" (score: 0.9999924).
Test #10 — Agentic Workflows:
smoke-claudeworkflow: engine=claude, compiled=Yes, status=active, triggers: PR (label: smoke), reaction: heart, schedule every 12h.Test #12 — Review Comments:
.changeset/patch-update-cli-versions-20260304.mdline 3: changeset type feedback.github/workflows/agent-performance-analyzer.lock.ymlline 75: version bump noteTest #16 — Push:
smoke-test-push-22667873177.txtcommitted and pushed tocopilot/update-cli-versions.