Skip to content

Fix: Remove double softmax in MoE router load-balancing loss (Mixtral, Qwen2MoE, Qwen3VLMoE) - #45132

Closed
akintunero wants to merge 6 commits into
huggingface:mainfrom
akintunero:fix/issue-45120-double-softmax-moe
Closed

Fix: Remove double softmax in MoE router load-balancing loss (Mixtral, Qwen2MoE, Qwen3VLMoE)#45132
akintunero wants to merge 6 commits into
huggingface:mainfrom
akintunero:fix/issue-45120-double-softmax-moe

fix: remove leftover code fragments from mixtral test reorganization

6ed3ada
Select commit
Loading
Failed to load commit list.