Add xcodec2 model by ebezzam · Pull Request #44178 · huggingface/transformers

ebezzam · 2026-02-20T12:36:21Z

What does this PR do?

Re-opening #37868

TODO

recompute expected outputs
passthrough code given new conventions
check for unused code paths / configuration parameters

Original checkpoint: https://huggingface.co/HKUSTAudio/xcodec2
Original modeling code: https://huggingface.co/HKUSTAudio/xcodec2/blob/main/modeling_xcodec2.py

…d-xcodec2

ebezzam · 2026-06-23T12:52:33Z

run-slow: dac, encodec, higgs_audio_v2_tokenizer, mimi, pe_audio, qwen2_5_omni, qwen3_omni_moe, seamless_m4t, wav2vec2_bert, xcodec, xcodec2

github-actions · 2026-06-23T12:54:03Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/dac", "models/encodec", "models/higgs_audio_v2_tokenizer", "models/mimi", "models/pe_audio", "models/qwen2_5_omni", "models/qwen3_omni_moe", "models/seamless_m4t", "models/wav2vec2_bert", "models/xcodec", "models/xcodec2"]
quantizations: []

github-actions · 2026-06-23T14:32:46Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	caea5740	workflow commit (merge commit)
PR	dc3378df	branch commit (from PR)
main	c2fafabb	base commit (on `main`)

Model CI Report

❌ 3 new failed tests from this PR 😭

wav2vec2_bert:
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_cpu_offload (✅ ⟹ ❌)
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_disk_offload_bin (✅ ⟹ ❌)
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_disk_offload_safetensors (✅ ⟹ ❌)

…d-xcodec2

ebezzam · 2026-06-23T16:39:26Z

run-slow: wav2vec2_bert

github-actions · 2026-06-23T16:41:04Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/wav2vec2_bert", "models/xcodec2"]
quantizations: []

github-actions · 2026-06-23T17:07:23Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	e75260e4	workflow commit (merge commit)
PR	512c681c	branch commit (from PR)
main	612c371a	base commit (on `main`)

Model CI Report

❌ 2 new failed tests from this PR 😭

wav2vec2_bert:
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_disk_offload_safetensors (✅ ⟹ ❌)
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_num_layers_is_small (✅ ⟹ ❌)

ebezzam · 2026-06-24T09:07:06Z

run-slow: wav2vec2_bert

github-actions · 2026-06-24T09:08:27Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/wav2vec2_bert", "models/xcodec2"]
quantizations: []

github-actions · 2026-06-24T09:20:42Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	2f3e7a72	workflow commit (merge commit)
PR	a31ed1c3	branch commit (from PR)
main	d87f670d	base commit (on `main`)

Model CI Report

❌ 2 new failed tests from this PR 😭

wav2vec2_bert:
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_cpu_offload (✅ ⟹ ❌)
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_disk_offload_safetensors (✅ ⟹ ❌)

ebezzam · 2026-06-24T09:36:47Z

        self.tdnn_kernel = tdnn_kernel
        self.tdnn_dilation = tdnn_dilation
        self.xvector_output_dim = xvector_output_dim
-        self.position_embeddings_type = position_embeddings_type


not being used, it is rather passed to the method for preparing the config to try different types (see here)

ebezzam · 2026-06-24T17:48:37Z

run-slow: wav2vec2_bert

github-actions · 2026-06-24T17:50:06Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/wav2vec2_bert", "models/xcodec2"]
quantizations: []

github-actions · 2026-06-24T18:01:43Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	a8c493b2	workflow commit (merge commit)
PR	78c3ed98	branch commit (from PR)
main	353b1532	base commit (on `main`)

✅ No failing test specific to this PR 🎉 👏 !

ebezzam · 2026-06-24T20:44:45Z

run-slow: wav2vec2_bert

github-actions · 2026-06-24T20:45:51Z

[For maintainers] Suggested jobs to run (before merge)

run-slow: auto, dac, encodec, higgs_audio_v2_tokenizer, mimi, pe_audio, qwen2_5_omni, qwen3_omni_moe, seamless_m4t, wav2vec2_bert, xcodec, xcodec2

github-actions · 2026-06-24T20:46:08Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/wav2vec2_bert", "models/xcodec2"]
quantizations: []

github-actions · 2026-06-24T20:59:30Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	6f8a7fad	workflow commit (merge commit)
PR	6d9c51c1	branch commit (from PR)
main	c21da1b5	base commit (on `main`)

Model CI Report

❌ 1 new failed tests from this PR 😭

wav2vec2_bert:
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_labels_out_of_vocab (✅ ⟹ ❌)

ebezzam · 2026-06-24T21:11:13Z

run-slow: wav2vec2_bert

github-actions · 2026-06-24T21:12:39Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/wav2vec2_bert", "models/xcodec2"]
quantizations: []

github-actions · 2026-06-24T21:26:31Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	7bb5864a	workflow commit (merge commit)
PR	2fe0150a	branch commit (from PR)
main	c21da1b5	base commit (on `main`)

Model CI Report

❌ 1 new failed tests from this PR 😭

wav2vec2_bert:
tests/models/wav2vec2_bert/test_modeling_wav2vec2_bert.py::Wav2Vec2BertModelTest::test_labels_out_of_vocab (✅ ⟹ ❌)

Deep-Unlearning and others added 30 commits April 29, 2025 16:34

Add xcodec model

277a96f

code formatting

349feae

typo xcodec2 name

e5f1da8

add xcodec2 in init file

fc0907c

fix import

ea0acbf

fix weight_norm init

8542db7

remove unused import

e98d981

add convert file

d1cd3ac

add ModelOutput class

74fa506

nit

02f5c94

fix device issue

dd0a17c

fix forward

3786203

nit

93dbfad

doc draft

d4d8c6a

draft test

c40912e

match tensor with the orignal implementation

17eb48c

Add doc file for xcodec2

3760438

finish model doc for xcodec2

a2faa55

update doc

31319fb

working xcodec2

8d9f8df

add test file for xcodec2

e5a1838

nit

473f95a

xcodec2 use EncodecFeatureExtractor

dd8aace

Merge branch 'main' into add-xcodec2

f6cf875

Standardize with Xcodec.

244bdb6

Merge branch 'main' into add-xcodec2

a84a69f

Merge branch 'main' into add-xcodec2

9d743e8

Address some PR comments and standardize.

2e23505

Remove Sequential.

0316080

Remove weight norm from model definition.

fcbeab7

ebezzam and others added 4 commits June 23, 2026 14:25

Merge branch 'main' into add-xcodec2

f230672

FIx for torch compile

8c9b8d9

Merge branch 'add-xcodec2' of github.com:ebezzam/transformers into ad…

7d91a28

…d-xcodec2

Merge branch 'main' into add-xcodec2

dc3378d

ebezzam added 2 commits June 23, 2026 18:38

Set test config for offload to pass.

0142779

Merge branch 'add-xcodec2' of github.com:ebezzam/transformers into ad…

512c681

…d-xcodec2

Increase allowed num layers.

a31ed1c

ebezzam commented Jun 24, 2026

View reviewed changes

Config that passes cpu offload.

78c3ed9

test config for disk/cpu offload

6d9c51c

Merge branch 'main' into add-xcodec2

2fe0150

Uh oh!

Conversation

ebezzam commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Uh oh!

ebezzam commented Jun 23, 2026

Uh oh!

github-actions Bot commented Jun 23, 2026

Uh oh!

github-actions Bot commented Jun 23, 2026

CI Results

Commit Info

Model CI Report

Uh oh!

ebezzam commented Jun 23, 2026

Uh oh!

github-actions Bot commented Jun 23, 2026

Uh oh!

github-actions Bot commented Jun 23, 2026

CI Results

Commit Info

Model CI Report

Uh oh!

ebezzam commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

CI Results

Commit Info

Model CI Report

Uh oh!

ebezzam Jun 24, 2026

Choose a reason for hiding this comment

Uh oh!

ebezzam commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

CI Results

Commit Info

Uh oh!

ebezzam commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

CI Results

Commit Info

Model CI Report

Uh oh!

ebezzam commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

Uh oh!

github-actions Bot commented Jun 24, 2026

CI Results

Commit Info

Model CI Report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

ebezzam commented Feb 20, 2026 •

edited

Loading