Skip to content

[None][test] Waive 2 failed cases for main in QA CI - #17201

Merged
xinhe-nv merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260803-111524
Aug 3, 2026
Merged

[None][test] Waive 2 failed cases for main in QA CI#17201
xinhe-nv merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260803-111524

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6551802

Waive entries added

full:RTX_PRO_6000_Blackwell_Server_Edition/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_guided_decoding_4gpus[xgrammar-mtp_nextn=0] SKIP (https://nvbugs/6551802)
full:RTX_PRO_6000_Blackwell_Server_Edition/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_guided_decoding_4gpus[llguidance-mtp_nextn=0] SKIP (https://nvbugs/6551802)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Dev Engineer Review

  • Added two SKIP entries for RTX_PRO_6000_Blackwell_Server_Edition.
  • The entries cover four-GPU DeepSeekV3Lite guided decoding with xgrammar and llguidance, both with mtp_nextn=0.
  • Both entries reference bug 6551802.
  • The existing llguidance entry with mtp_nextn=2 remains unchanged.
  • The waiver scope and format are consistent with the existing entries.
  • No code, API, performance, or error-handling changes are included.

QA Engineer Review

  • Modified tests/integration/test_lists/waives.txt.
  • Added two CI waiver entries for the xgrammar and llguidance configurations.
  • No test functions changed.
  • CBTS coverage data is unavailable.
  • Verdict: needs follow-up.

Bug(s): 6551802
Requested by: qa@nvidia.com

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@xinhe-nv
xinhe-nv enabled auto-merge (squash) August 3, 2026 11:15
@xinhe-nv

xinhe-nv commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "skip hang issues only"

@coderabbitai

coderabbitai Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Walkthrough

The integration waiver list now skips two four-GPU DeepSeekV3Lite guided-decoding configurations on RTX PRO 6000 Blackwell Server Edition systems. The existing llguidance waiver with mtp_nextn=2 remains.

Changes

Guided-decoding test waivers

Layer / File(s) Summary
Four-GPU configuration waivers
tests/integration/test_lists/waives.txt
Adds llguidance and xgrammar skip entries for mtp_nextn=0. Retains the existing llguidance entry for mtp_nextn=2.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Possibly related PRs

Suggested reviewers: qijune, dpitman-nvda, schetlur-nv

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Description check ✅ Passed The description identifies the bug, target branch, and two exact waive entries with their SKIP conditions.
Linked Issues check ✅ Passed The description links the relevant NVBugs issue 6551802, which matches the stated waiver reason.
Out of Scope Changes check ✅ Passed The two added waiver entries are limited to the documented DeepSeekV3Lite guided-decoding QA cases.
Title check ✅ Passed The title clearly identifies a test change that waives two failed QA CI cases on main.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Around line 329-331: Add the repository-standard NVIDIA copyright header at
the beginning of the modified waives.txt file, using 2026 as the copyright year,
while preserving the existing test waiver entries unchanged.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 61cce5f4-4288-409a-9568-20f55b7e2b70

📥 Commits

Reviewing files that changed from the base of the PR and between fff6b88 and 7350572.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #63436 [ skip ] triggered by Bot. Commit: 7350572 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #63436 [ skip ] completed with state SUCCESS. Commit: 7350572
Skipping testing for commit 7350572

Link to invocation

@xinhe-nv
xinhe-nv merged commit bd39b9c into NVIDIA:main Aug 3, 2026
13 checks passed
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260803-111524 branch August 3, 2026 11:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants