is xDiT support run wan2.1 and wan2.2 ?

[ying2025]

Does xDiT support running wan2.1 and wan2.2? Is there any detailed documentation, including for ComfyUI operation.
@Steaunk @lpetre

[feifeibear]

Wan2.1 already integrates xDiT natively, so there’s no need for us to add separate support.
Wan2.2 implements its own Ulysses-style parallelism, independently of our framework.

[avjves]

We are currently porting Wan2.X from diffusers to xDiT for easier interoperabilty. I'll link the branch/PR when it's ready. Does this sound something that could be merged into upstream xDiT @feifeibear?

By the way, Wan2.1 repo no longer works OOB with latest xDiT due to PR #559 .

[feifeibear]

We are currently porting Wan2.X from diffusers to xDiT for easier interoperabilty. I'll link the branch/PR when it's ready. Does this sound something that could be merged into upstream xDiT @feifeibear?

By the way, Wan2.1 repo no longer works OOB with latest xDiT due to PR #559 .

Wan2.2 support of course can be upstream to xDiT!

Wan2.1 repo no longer works OOB with latest xDiT. Because of the torch version?

[avjves]

Great!

The PR #559 changed the default attn_type to None from AttnType.FA. None is not supported, so one has to specify an attn_type to use it.

Wan2.1 relies on the old default behaviour here and doesn't specify the type:
https://github.com/Wan-Video/Wan2.1/blob/7c81b2f27defa56c7e627a4b6717c8f2292eee58/wan/distributed/xdit_context_parallel.py#L213

So running it errors here:
https://github.com/feifeibear/long-context-attention/blob/7a52abd669efb35e550680a239e1745b620b2bae/yunchang/kernels/__init__.py#L257

with error:

Unknown flash attention implementation: None

[feifeibear]

@avjves thanks for pointing out the problem. Coujld you plese help to fix the error by reverting part of the code?

[avjves]

This will then break the support for Apple Silicon that was introduced in that PR. I'm not familiar with it nor do I have access to Apple Silicon, so I can't fix that if I add a PR to revert that change. Is this ok?

[feifeibear]

Of course, at least we can revert the PR.
@avjves could help check the attn_type problem introduced in your PR?

unknown flash attention implementation: None

[avjves]

@ying2025
Wan 2.X I2V support has now been merged to xDiT :)
There's an example script available in the repo, examples/wan_i2v_example.py.

[nuclearwu]

@ying2025 Wan 2.X I2V support has now been merged to xDiT :) There's an example script available in the repo, examples/wan_i2v_example.py.

@avjves is #583 support run wan_t2v ?

[nuclearwu]

@ying2025 Wan 2.X I2V support has now been merged to xDiT :) There's an example script available in the repo, examples/wan_i2v_example.py.

@avjves I ran it on the npu and it reported insufficient memory

[avjves]

Hi, unfortunately it only supports I2V for now :(

What command did you use to run it? And what resolution did you use? It's a pretty big model, so higher resolution generation takes quite a bit of memory - at least with Wan2.2. How much total memory do you have?

[jcaraban]

@nuclearwu could you share the exact NPU model? Are you able to run any other xDiT workload on it?

[nuclearwu]

could you share the exact NPU model? Are you able to run any other xDiT workload on it?

@jcaraban 910B2, I have ran Flux and sd3 on it successfully. However, running wan2.2 failed

[nuclearwu]

Hi, unfortunately it only supports I2V for now :(

What command did you use to run it? And what resolution did you use? It's a pretty big model, so higher resolution generation takes quite a bit of memory - at least with Wan2.2. How much total memory do you have?

@avjves The following is script:

export YUNCHANG_AVAILABLE=1
export SP_KIT_AVAILABLE=1
export SEQUENCE_PARALLEL_AVAILABLE=1
export PYTORCH_NPU_ALLOC_CONF=max_split_size_mb:256
torchrun --nproc_per_node=8 examples/wan_i2v.py \
   --height 720 \
   --width 1280 \
   --num_frames 81 \
   --model /workspace/cache/grtest-zz/johnjan/modelscope/models/Wan-AI/Wan2___2-I2V-A14B-Diffusers/ \
   --ulysses_degree 8 \
   --prompt "Summer beach vacation style, a white cat wearing sunglasses sits on a surfboard. The fluffy-furred feline gazes directly at the camera with a relaxed expression. Blurred beach scenery forms the background featuring crystal-clear waters, distant green hills, and a blue sky dotted with white clouds. The cat assumes a naturally relaxed posture, as if savoring the sea breeze and warm sunlight. A close-up shot highlights the feline's intricate details and the refreshing atmosphere of the seaside." \
   --num_inference_steps 40 \
   --use_torch_compile \
   --seed 42 \
   --img_file_path /workspace/cache/grtest-zz/johnjan/wan-ai/wan-i2v/wan_i2v_input.JPG