Skip to content

[fix] update integration test values#47146

Merged
eustlb merged 2 commits into
mainfrom
update-values
Jul 10, 2026
Merged

[fix] update integration test values#47146
eustlb merged 2 commits into
mainfrom
update-values

Conversation

@eustlb

@eustlb eustlb commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

CI

What does this PR do?

Fixes

  • DacIntegrationTest::test_integration_0_dac_16khz
  • DacIntegrationTest::test_integration_1_dac_24khz
  • DacIntegrationTest::test_integration_2_dac_44khz
  • DacIntegrationTest::test_integration_batch_0_dac_16khz
  • DacIntegrationTest::test_integration_batch_1_dac_24khz
  • DacIntegrationTest::test_integration_batch_2_dac_44khz
  • MoonshineStreamingModelIntegrationTests::test_medium_logits_batch
  • MoonshineStreamingModelIntegrationTests::test_small_logits_batch

torch 2.11 CI bump in #45243 and #45248 set cudnn.conv.fp32_precision="ieee", forcing full-precision conv and shifting DAC/moonshine outputs off their TF32-recorded expected values. This was confirmed by running tests twice: once with default cuDNN settings (matches the previously recorded test values) and once with torch.backends.cuda.matmul.allow_tf32 = False + torch.backends.cudnn.allow_tf32 = False (equivalent to what conftest.py's enable_tf32(False) + torch 2.11's new cudnn.conv.fp32_precision="ieee" produce). First run passed, meaning numerical drift.

To update the expected:

  1. for dac directly used the provided reproducer in test file with the CI runners env
  2. for moonshine, updated values from the runners (since no reproducer)

@eustlb

eustlb commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator Author

run-slow: dac, moonshine_streaming

@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/dac", "models/moonshine_streaming"]
quantizations: []

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

CI Results

Workflow Run ⚙️

Commit Info

Context Commit Description
RUN 93129cf3 workflow commit (merge commit)
PR bf57c73c branch commit (from PR)
main 4af901d5 base commit (on main)

✅ No failing test specific to this PR 🎉 👏 !

@eustlb
eustlb requested a review from vasqu July 7, 2026 20:28

@vasqu vasqu left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just super nits tbh 🤗

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm so we dont have a repro here, should we start including one here?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this was a day0, transformers is the only integration 🤗

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super nit but might be worth to refactor into fixtures structure, so many values :D

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

agree, will do!

@github-actions

Copy link
Copy Markdown
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: dac, moonshine_streaming

@github-actions

Copy link
Copy Markdown
Contributor

CI recap

Dashboard: View test results in Grafana
Latest run: 28890184108:1
Result: success | Jobs: 4 | Tests: 538 | Failures: 0 | Duration: 58s

@eustlb
eustlb added this pull request to the merge queue Jul 10, 2026
Merged via the queue into main with commit 74920ed Jul 10, 2026
34 checks passed
@eustlb
eustlb deleted the update-values branch July 10, 2026 14:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants