Skip to content

metal : implement rope_back operator#24725

Merged
ggerganov merged 1 commit into
masterfrom
gg/rope-back-metal
Jun 17, 2026
Merged

metal : implement rope_back operator#24725
ggerganov merged 1 commit into
masterfrom
gg/rope-back-metal

Conversation

@ggerganov

@ggerganov ggerganov commented Jun 17, 2026

Copy link
Copy Markdown
Member

Overview

Add Metal backend support for ROPE_BACK by reusing existing rope kernels with a function constant to toggle forward/backward rotation.

Requirements

Reuse existing rope kernels with a function constant to toggle forward/backward
rotation, avoiding duplicate kernel code.

Assisted-by: pi:llama.cpp/Qwen3.6-27B
@ggerganov ggerganov marked this pull request as ready for review June 17, 2026 15:03
@ggerganov ggerganov requested a review from a team as a code owner June 17, 2026 15:03
@github-actions github-actions Bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Jun 17, 2026
@ggerganov ggerganov merged commit 0843245 into master Jun 17, 2026
33 checks passed
@ggerganov ggerganov deleted the gg/rope-back-metal branch June 17, 2026 17:36
papamoose pushed a commit to papamoose/llama.cpp that referenced this pull request Jun 27, 2026
Reuse existing rope kernels with a function constant to toggle forward/backward
rotation, avoiding duplicate kernel code.

Assisted-by: pi:llama.cpp/Qwen3.6-27B
adrianhoehne pushed a commit to adrianhoehne/llama.cpp that referenced this pull request Jul 5, 2026
Reuse existing rope kernels with a function constant to toggle forward/backward
rotation, avoiding duplicate kernel code.

Assisted-by: pi:llama.cpp/Qwen3.6-27B
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant