Skip to content

feat: add T-Head PPU runtime backend#35

Merged
voltjia merged 1 commit into
InfiniTensor:masterfrom
spike-zhu:feat/ppu-runtime-backend-support-spike
Jul 24, 2026
Merged

feat: add T-Head PPU runtime backend#35
voltjia merged 1 commit into
InfiniTensor:masterfrom
spike-zhu:feat/ppu-runtime-backend-support-spike

Conversation

@spike-zhu

@spike-zhu spike-zhu commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add the T-Head PPU backend option through WITH_THEAD.
  • Add infini::rt::Device::Type::kThead and runtime dispatch support.
  • Add the Thead PPU runtime implementation under src/native/cuda/thead/.

Motivation

InfiniCore previously used an in-tree runtime for Ali PPU. This change adds the required Ali PPU runtime infrastructure to InfiniRT, aligned with existing CUDA-like backends.

Type of Change

  • feat - new feature / new backend capability / new public API
  • fix - bug fix
  • perf - performance improvement without behavior change
  • refactor - code restructuring without behavior change
  • test - adding or fixing tests only
  • docs - documentation only
  • build / ci - build system or CI configuration
  • chore - tooling, formatting, or other non-code changes
  • Breaking change (requires a ! in the Conventional Commits prefix or a BREAKING CHANGE: footer)

Platforms Affected

  • CPU (WITH_CPU)
  • NVIDIA (WITH_NVIDIA)
  • Iluvatar (WITH_ILUVATAR)
  • Hygon (WITH_HYGON)
  • MetaX (WITH_METAX)
  • Moore (WITH_MOORE)
  • Cambricon (WITH_CAMBRICON)
  • Ascend (WITH_ASCEND)
  • T-Head(WITH_THEAD
  • Build system / CMake / generated headers
  • Public headers / installed consumer API
  • Documentation only

Smoke Build and Test Result

paste smoke build and test output here
image

Test Results on Supported Platforms

Platform Affected Build / Smoke Result Full Result / Notes
CPU
NVIDIA
Iluvatar
Hygon
MetaX
Moore
Cambricon
Ascend
Full `ctest` output (optional)
paste here

Benchmark / Performance Impact

Notes for Reviewers

InfiniCore now uses the standalone InfiniRT implementation instead of its in-tree Ali PPU runtime, with InfiniLM test:

image

@spike-zhu
spike-zhu force-pushed the feat/ppu-runtime-backend-support-spike branch from d429e89 to e328682 Compare July 24, 2026 02:27
@spike-zhu spike-zhu mentioned this pull request Jul 24, 2026
21 tasks
@spike-zhu
spike-zhu force-pushed the feat/ppu-runtime-backend-support-spike branch from e328682 to a2a7d53 Compare July 24, 2026 02:43
@spike-zhu
spike-zhu requested a review from voltjia July 24, 2026 02:43
@spike-zhu spike-zhu self-assigned this Jul 24, 2026

@voltjia voltjia left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

看了一下,没啥太大问题。后面应该就是按照刚才飞书上讨论的,把名称统一改成 ”T-Head“ 和 Thead 吧。

Comment thread scripts/generate_public_headers.py
Comment thread scripts/run_performance_tests.py
Comment thread scripts/run_performance_tests.py
@spike-zhu
spike-zhu force-pushed the feat/ppu-runtime-backend-support-spike branch from a2a7d53 to 25834a4 Compare July 24, 2026 05:58
@spike-zhu

Copy link
Copy Markdown
Contributor Author

看了一下,没啥太大问题。后面应该就是按照刚才飞书上讨论的,把名称统一改成 ”T-Head“ 和 Thead 吧。

已修改

@spike-zhu
spike-zhu requested a review from voltjia July 24, 2026 06:07

@voltjia voltjia left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR 描述里好像出现了几处 WITH_Thead,这个应该是全大写的,也就是 WITH_THEAD,不过反而是代码里没发现 hhh,改一下描述吧。

Comment thread CMakeLists.txt Outdated
@spike-zhu
spike-zhu force-pushed the feat/ppu-runtime-backend-support-spike branch from 25834a4 to b002b8f Compare July 24, 2026 07:47
@spike-zhu
spike-zhu requested a review from voltjia July 24, 2026 07:51
@spike-zhu

Copy link
Copy Markdown
Contributor Author

PR 描述里好像出现了几处 WITH_Thead,这个应该是全大写的,也就是 WITH_THEAD,不过反而是代码里没发现 hhh,改一下描述吧。

已调整

@voltjia voltjia changed the title feat: add Ali PPU runtime backend feat: add T-Head PPU runtime backend Jul 24, 2026
@voltjia
voltjia merged commit b15dc0f into InfiniTensor:master Jul 24, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants