Test Results
| # |
Test |
Status |
| 1 |
GitHub MCP Testing |
✅ |
| 2 |
Safe Inputs GH CLI Testing |
✅ |
| 3 |
Serena MCP Testing |
❌ |
| 4 |
Playwright Testing |
✅ |
| 5 |
Web Fetch Testing |
✅ |
| 6 |
File Writing Testing |
✅ |
| 7 |
Bash Tool Testing |
✅ |
| 8 |
Discussion Interaction Testing |
✅ |
| 9 |
Build gh-aw |
✅ |
| 10 |
Discussion Creation Testing |
✅ |
| 11 |
Workflow Dispatch Testing |
✅ |
| 12 |
PR Review Testing |
N/A (no triggering PR) |
Overall Status: ⚠️ PARTIAL PASS
Details
Test Details
1. GitHub MCP ✅ — Last 2 merged PRs: #18502 (fix: upgrade Copilot CLI default version to 0.0.418), #18503
2. Safe Inputs GH CLI ✅ — Queried PRs: #18505, #18504 (both by copilot-swe-agent)
3. Serena MCP ❌ — activate_project and find_symbol tools not available in this workflow configuration
4. Playwright ✅ — Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
5. Web Fetch ✅ — Response contains "GitHub"
6. File Writing ✅ — Created /tmp/gh-aw/agent/smoke-test-copilot-22449888558.txt
7. Bash Tool ✅ — File content verified: "Smoke test passed for Copilot at Thu Feb 26 15:58:28 UTC 2026"
8. Discussion Interaction ✅ — Got discussion #18512, added playful comment
9. Build gh-aw ✅ — make build succeeded with GOCACHE/GOMODCACHE in /tmp
10. Discussion Creation ✅ — Created "copilot was here" discussion
11. Workflow Dispatch ✅ — Dispatched haiku-printer: "Tests run and pass clean / Automation breathes and hums / Green lights all the way"
12. PR Review N/A — Workflow not triggered by a pull_request event
Run Info
📰 BREAKING: Report filed by Smoke Copilot
Test Results
Overall Status:⚠️ PARTIAL PASS
Details
Test Details
1. GitHub MCP ✅ — Last 2 merged PRs: #18502 (fix: upgrade Copilot CLI default version to 0.0.418), #18503
2. Safe Inputs GH CLI ✅ — Queried PRs: #18505, #18504 (both by copilot-swe-agent)
3. Serena MCP ❌ —
activate_projectandfind_symboltools not available in this workflow configuration4. Playwright ✅ — Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
5. Web Fetch ✅ — Response contains "GitHub"
6. File Writing ✅ — Created
/tmp/gh-aw/agent/smoke-test-copilot-22449888558.txt7. Bash Tool ✅ — File content verified: "Smoke test passed for Copilot at Thu Feb 26 15:58:28 UTC 2026"
8. Discussion Interaction ✅ — Got discussion #18512, added playful comment
9. Build gh-aw ✅ —
make buildsucceeded with GOCACHE/GOMODCACHE in /tmp10. Discussion Creation ✅ — Created "copilot was here" discussion
11. Workflow Dispatch ✅ — Dispatched haiku-printer: "Tests run and pass clean / Automation breathes and hums / Green lights all the way"
12. PR Review N/A — Workflow not triggered by a pull_request event
Run Info