liger-kernels: Add layer repos for remaining functions#995
Conversation
| LigerForCausalLMLoss.can_torch_compile = True | ||
|
|
||
|
|
||
| class liger_rotary_pos_emb_layer(nn.Module): |
There was a problem hiding this comment.
added layer suffices as it would clash with the original fns otherwise and we should keep BC imo
| # NOTE: We have this intentional graph break as we encounter issues such as IMAs and Cublas errors. | ||
| # We know that this is an optimized kernel already so there is less ways to | ||
| # fuse it either way; we rely on torch compile to go through the base model to optimize. | ||
| @torch.compiler.disable |
There was a problem hiding this comment.
It would need a proper fake wrapping but we already do the same for the function. I would really like to move this to a separate PR / fix this upstream in liger kernels directly
|
/kernel-bot build liger-kernels |
|
Build request processed. Command: Dispatched (1):
|
|
/kernel-bot merge-and-upload liger-kernels |
|
Build request processed. Command: Merge result: PR is already merged. Continuing with build/upload. Dispatched (1):
|
As per title, adds layer type versions for the functions