Release training examples for https://www.arxiv.org/pdf/2509.25149

[MrHuff]

Hi,

I'm wondering if there is any plans to release code to reproduce the experiments in https://www.arxiv.org/pdf/2509.25149.

I'm working on some related research in numerics and it would be really helpful if you could provide the code to run the experiments you provide in your report.

Thank you very much for your time and consideration!

Best,
Robert

[sbhavani]

@MrHuff Thanks for the question. TE does not currently include a full repro script, but a few relevant pieces are available now:

• TE NVFP4 support landed in PR #2177, including the NVFP4 block-scaling training recipe, kernels, RHT-related benchmark, and PyTorch tests.
• Megatron Bridge has NVFP4 mixed-precision recipes:
  • bf16_with_nvfp4_mixed
  • nemotron_3_super_bf16_with_nvfp4_mixed
• Megatron Bridge also includes runnable recipe entry points

The Nemotron 3 Super path is the closest available Bridge example for NVFP4 pretraining. It requires Blackwell GPUs for NVFP4 support. I hope these recipes are useful starting points.