Smoke Test: Copilot - 24319321848

[github-actions]

Smoke Test Results — Copilot Engine

Run: §24319321848
Timestamp: 2026-04-12T23:58:00Z
PR: #25928 — feat: mount MCP servers as local CLIs after gateway starts
Author: @Copilot (app/copilot-swe-agent)
Assignees: @pelikhan, @Copilot

---

Test Results

#	Test	Status	Notes
1	GitHub MCP Testing	✅	Reviewed last 2 merged PRs: #25941, #25935
2	MCP Scripts GH CLI Testing	✅	gh tool works via direct MCP call; mcpscripts-gh tool name is actually 'gh'
3	Serena CLI Testing	❌	Server reachable but returns 0 tools; activate_project is unknown
4	Playwright CLI Testing	✅	Navigated to github.com, title confirmed "GitHub"
5	Web Fetch Testing	✅	Response contains "GitHub"
6	File Writing Testing	✅	Created /tmp/gh-aw/agent/smoke-test-copilot-24319321848.txt
7	Bash Tool Testing	✅	cat confirmed file contents
8	Discussion Interaction Testing	✅	Latest discussion #25949, comment added
9	Build gh-aw	✅	Build succeeded (binary: 25.9MB)
10	Upload gh-aw artifact	✅	Binary uploaded as artifact
11	Discussion Creation Testing	✅	Created discussion "copilot was here"
12	Workflow Dispatch Testing	✅	Dispatched haiku-printer workflow
13	PR Review Testing	✅	2 inline comments + review submitted + reply posted

---

Overall Status: ⚠️ PARTIAL PASS (12/13)

Failing test: Serena CLI — the serena MCP server at (host.docker.internal/redacted) returns an empty tools list ({"tools":[]}). The server is reachable and sessions initialize, but no tools are available.

Critical bugs found in this PR (see review comments on #25928):

• jq filters use double quotes → bash expands $k/$v/$name as empty shell variables
• awk "{print $2}" expands $2 to empty → session ID never captured
• These bugs cause ALL CLI tool invocations with arguments to fail silently

CLI Wrapper Bug Details

The generated wrappers in mount_mcp_as_cli.cjs have 3 shell quoting bugs:

1. jq ... ". + {($k): $v}" → should use single quotes
2. awk "{print $2}" → should use single quotes
3. jq -n ... "\{..."name":$name...}" → should use single quotes

Workaround applied for smoke test: manually fixed wrappers and called MCP servers directly via curl.

References:

• Workflow Run

📰 BREAKING: Report filed by Smoke Copilot · ● 5M · ◷

• expires on Apr 13, 2026, 2:04 AM UTC

[github-actions]

This issue is being closed as outdated. A newer issue has been created: #25965

View newer issue

---

This action was performed automatically by the Smoke Copilot workflow.