Automated smoke test validation for the Claude engine. PR used for review tests: #19525 (copilot/update-generated-footer).
Test Results
| # |
Test |
Result |
| 1 |
GitHub MCP: Review last 2 merged PRs (#19518, #19507) |
✅ |
| 2 |
Safe Inputs GH CLI: Query 2 PRs (#19528, #19527) |
✅ |
| 3 |
Serena MCP: Activate project + find symbols (7 found) |
✅ |
| 4 |
Make Build: make build succeeded |
✅ |
| 5 |
Playwright: github.com title contains "GitHub" |
✅ |
| 6 |
Tavily: Search "GitHub Agentic Workflows" (3 results) |
✅ |
| 7 |
File Writing: Created smoke test file |
✅ |
| 8 |
Bash: Verified file contents |
✅ |
| 9 |
Discussion #19524: Comic-book comment added |
✅ |
| 10 |
Agentic Workflows MCP: smoke-claude status (active) |
✅ |
| 11 |
Update PR #19525 body (appended test message) |
✅ |
| 12 |
PR Review Comments: 2 inline comments added |
✅ |
| 13 |
Submit PR Review: COMMENT review submitted |
✅ |
| 14 |
Resolve Review Thread |
⚠️ Skipped — no threads on PR |
| 15 |
Add Reviewer: copilot added to PR #19525 |
✅ |
| 16 |
Push to PR Branch: committed & pushed test file |
✅ |
| 17 |
Close PR |
⚠️ Skipped — triggering PR, not safe to close |
Overall Status: PARTIAL (2 skipped, 0 failed, 15 passed)
Test Details
GitHub MCP (#1)
Serena MCP (#3)
Found 7 symbols matching Workflow:
Workflow struct in pkg/cli/copilot_setup.go
ValidationResult/Workflow in pkg/cli/compile_config.go
OverviewDisplay/Workflow in pkg/cli/audit_report.go
WorkflowStats/Workflow, WorkflowStatus/Workflow, WorkflowListItem/Workflow, TestOverview/Workflow
Agentic Workflows MCP (#10)
- smoke-claude: active, compiled: Yes
- Triggers: pull_request (labeled: smoke), reaction (heart), schedule (every 12h)
PR Review Tests (#11–16)
Run URL: https://github.com/github/gh-aw/actions/runs/22657504616
Timestamp: 2026-03-04T06:19Z
💥 [THE END] — Illustrated by Smoke Claude · ◷
Automated smoke test validation for the Claude engine. PR used for review tests: #19525 (
copilot/update-generated-footer).Test Results
make buildsucceededOverall Status: PARTIAL (2 skipped, 0 failed, 15 passed)
Test Details
GitHub MCP (#1)
.github#19518: "Fix runtime-import path duplication when repo is named.github" — merged 2026-03-04Serena MCP (#3)
Found 7 symbols matching
Workflow:Workflowstruct inpkg/cli/copilot_setup.goValidationResult/Workflowinpkg/cli/compile_config.goOverviewDisplay/Workflowinpkg/cli/audit_report.goWorkflowStats/Workflow,WorkflowStatus/Workflow,WorkflowListItem/Workflow,TestOverview/WorkflowAgentic Workflows MCP (#10)
PR Review Tests (#11–16)
[WIP] Update generated footer to include gh-aw-workflow-call-idadd_comment.cjs,add_comment.test.cjs,.changeset/patch-add-workflow-call-id-marker.mdadd_comment.cjsline 9,add_comment.test.cjsline 1307Run URL: https://github.com/github/gh-aw/actions/runs/22657504616
Timestamp: 2026-03-04T06:19Z