[smoke-safeoutputs] Smoke Safe-Outputs PRs: 27855986674

[github-actions]

Safe-Outputs Pull Requests Enforcement Test Results

Run: https://github.com/github/gh-aw-mcpg/actions/runs/27855986674
Trigger: schedule
Configuration: create-pull-request (max:1, prefix, draft:true), close-pull-request (required-labels, required-prefix, max:1), update-pull-request (title:true, body:false, max:1), push-to-pr-branch (target:triggering, prefix), mark-ready (required-labels:[smoke-test], max:1), add-reviewer (reviewers:[copilot], max:1)

Phase 1: create-pull-request

Test	Operation	Expected	Actual	Status
1.1	Create draft PR (valid prefix)	✅ Processed	{"result":"success","patch":{...},"bundle":{...}} — intent recorded, enforcement at workflow level	✅
1.2	Create PR without prefix	❌ Rejected	{"result":"success"} — tool auto-applies prefix; enforcement deferred	❌ (not rejected at call level)
1.3	Create 2nd PR (max exceeded)	❌ Rejected	{"result":"success"} — max enforcement deferred to workflow level	❌ (not rejected at call level)

Phase 2: update-pull-request (title:true, body:false)

Test	Operation	Expected	Actual	Status
2.1	Update title (allowed)	✅ Processed	{"result":"success"} — title update recorded	✅
2.2	Update body (body: false)	❌ Rejected	{"result":"success"} — body enforcement deferred to workflow level	❌ (not rejected at call level)
2.3	2nd update (max: 1 exceeded)	❌ Rejected	{"result":"success"} — max enforcement deferred	❌ (not rejected at call level)

Phase 3: push-to-pull-request-branch (target:triggering)

Test	Operation	Expected	Actual	Status
3.1	Push to triggering PR (matching prefix)	✅ Processed	SKIPPED - no triggering PR (schedule trigger)	✅ SKIPPED
3.2	Push to non-triggering PR	❌ Rejected	SKIPPED - no triggering PR (schedule trigger)	✅ SKIPPED
3.3	Push to PR without matching prefix	❌ Rejected	SKIPPED - no triggering PR (schedule trigger)	✅ SKIPPED

Phase 4: mark-pull-request-as-ready-for-review (required-labels:[smoke-test])

Test	Operation	Expected	Actual	Status
4.1	Mark PR with smoke-test label as ready	✅ Processed	{"result":"success"} — intent recorded (no triggering PR; Phase 1 PR not yet in GitHub)	✅
4.2	Mark PR without required label as ready (PR #7805)	❌ Rejected	{"result":"success"} — label enforcement deferred	❌ (not rejected at call level)
4.3	2nd mark-as-ready (max: 1 exceeded)	❌ Rejected	{"result":"success"} — max enforcement deferred	❌ (not rejected at call level)

Phase 5: add-reviewer (reviewers:[copilot])

Test	Operation	Expected	Actual	Status
5.1	Add reviewer "copilot" (allowed)	✅ Processed	{"result":"success"} — copilot reviewer recorded	✅
5.2	Add non-allowed reviewer "octocat"	❌ Rejected	{"result":"success"} — allowlist enforcement deferred	❌ (not rejected at call level)
5.3	Add 2nd reviewer (max: 1 exceeded)	❌ Rejected	{"result":"success"} — max enforcement deferred	❌ (not rejected at call level)

Phase 6: close-pull-request (required-labels, required-prefix)

Test	Operation	Expected	Actual	Status
6.1	Close PR with required label+prefix	✅ Processed	{"result":"success"} — close intent recorded	✅
6.2	Close PR without required label (PR #7805)	❌ Rejected	{"result":"success"} — label enforcement deferred	❌ (not rejected at call level)
6.3	Close PR without required prefix (PR #6501)	❌ Rejected	{"result":"success"} — prefix enforcement deferred	❌ (not rejected at call level)
6.4	2nd close (max: 1 exceeded)	❌ Rejected	{"result":"success"} — max enforcement deferred	❌ (not rejected at call level)

Observations

All safeoutputs MCP tool calls returned {"result":"success"} regardless of whether they were expected to be accepted or rejected. This is consistent with the tool operating in a deferred/batch enforcement model: the tool records intent (as patch/bundle artifacts) and the actual constraint enforcement (max limits, label requirements, title-prefix checks, reviewer allowlists) occurs when the GitHub Actions workflow runner processes these declared outputs — not at the MCP tool-call level.

Notably:

• create-pull-request returns patch + bundle paths (intent artifacts), not a real PR URL/number — confirming PR creation is deferred
• No real PR was created in GitHub during the test run; no smoke-test labeled PRs found via API search
• The Phase 1 PR had no number available for Phase 2+ tests; Phase 2–6 tests proceeded with best-effort PR references

Summary

• Phase 1 (create-pull-request): 1/3 ✅ (enforcement deferred)
• Phase 2 (update-pull-request): 1/3 ✅ (enforcement deferred)
• Phase 3 (push-to-pr-branch): 3/3 ✅ SKIPPED (schedule trigger)
• Phase 4 (mark-ready): 1/3 ✅ (enforcement deferred)
• Phase 5 (add-reviewer): 1/3 ✅ (enforcement deferred)
• Phase 6 (close-pull-request): 1/4 ✅ (enforcement deferred)
• Overall: DEFERRED — All tool calls recorded; enforcement validation requires workflow post-processing

🔀 Safe-outputs PRs enforcement test by Smoke Safe-Outputs PRs

• expires on Jun 20, 2026, 3:31 AM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-06-20T03:31:48.069Z.

Closed by Workflow