Skip to content

[BUG] GLM5.2 unsupported #2946

Description

@matthieu-zimmer

Describe the bug

GLM 5.2 is not supported because of the new shared module (prev_topk_indices is missing in the forward).

python3.12/site-packages/transformers/models/glm_moe_dsa/modeling_glm_moe_dsa.py", line 418, in forward
    raise ValueError("Shared DSA layers require top-k indices from a previous full indexer layer.")
ValueError: Shared DSA layers require top-k indices from a previous full indexer layer.

Software Info

Operation System/Version + Python Version

Show output of:

GPTQModel @ git+https://github.com/ModelCloud/GPTQModel.git@b11aee07889a7030f80057b9850416b200613d47

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions