Smoke Test Results: Claude Engine — Run 30069222211
Date: 2026-07-24
Run URL: https://github.com/github/gh-aw/actions/runs/30069222211
Overall Status: PARTIAL (Playwright CLI skill version mismatch, Tavily used alternate command)
PR used for review tests: #47695 (Bump AWF firewall to v0.27.41 and MCPG to v0.4.5)
Test Results
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP — Last 2 Merged PRs |
✅ |
#47697, #47689 via gh CLI |
| 2 |
GH CLI Testing (gh pr list) |
✅ |
Listed #47706, #47699 |
| 3 |
Make Build Testing |
✅ |
Build succeeded via mcpscripts-make |
| 4 |
Playwright Testing |
❌ |
Skill version mismatch — playwright-cli install --skills needed |
| 5 |
Tavily Web Search |
✅ |
5 results for "GitHub Agentic Workflows" |
| 6 |
File Writing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-30069222211.txt created |
| 7 |
Bash Tool |
✅ |
File content verified via cat |
| 8 |
Discussion Interaction |
✅ |
Comment added to discussion #335 |
| 9 |
Agentic Workflows MCP |
✅ |
Found smoke-claude (active) and smoke-claude-on-copilot (Unknown) |
| 10 |
Slack Post |
✅ |
Posted to #smoke-tests |
| 11 |
Code Scanning Alert |
✅ |
Dummy warning alert created |
| 12 |
Check Run |
✅ |
Success check run created |
| 13 |
Update PR |
✅ |
PR #47695 body appended |
| 14 |
PR Review Comment |
✅ |
2 review comments added |
| 15 |
Submit PR Review |
✅ |
COMMENT review submitted |
| 16 |
Resolve Review Thread |
✅ |
Unresolved thread resolved |
| 17 |
Add Reviewer |
✅ |
copilot added as reviewer |
| 18 |
Push to PR Branch |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed |
| 19 |
Close PR |
⚠️ |
Skipped — no safe test PR to close |
Error Details
Test #4 (Playwright): playwright-cli skill at .claude/skills/playwright-cli does not match tool version. Resolution: run playwright-cli install --skills.
Agentic Workflows Status Summary
smoke-claude: active, engine=claude, triggers: PR label, heart reaction, slash command
smoke-claude-on-copilot: Unknown status, engine=claude, compiled=Yes
💥 [THE END] — Illustrated by Smoke Claude · sonnet46 · 64.9 AIC · ⌖ 18.8 AIC · ⊞ 6.1K · ◷
Comment /smoke-claude to run again
Smoke Test Results: Claude Engine — Run 30069222211
Date: 2026-07-24
Run URL: https://github.com/github/gh-aw/actions/runs/30069222211
Overall Status: PARTIAL (Playwright CLI skill version mismatch, Tavily used alternate command)
PR used for review tests: #47695 (Bump AWF firewall to v0.27.41 and MCPG to v0.4.5)
Test Results
playwright-cli install --skillsneeded/tmp/gh-aw/agent/smoke-test-claude-30069222211.txtcreatedsmoke-claude(active) andsmoke-claude-on-copilot(Unknown)Error Details
Test #4 (Playwright):
playwright-cliskill at.claude/skills/playwright-clidoes not match tool version. Resolution: runplaywright-cli install --skills.Agentic Workflows Status Summary
smoke-claude: active, engine=claude, triggers: PR label, heart reaction, slash commandsmoke-claude-on-copilot: Unknown status, engine=claude, compiled=Yes