Add support for DeepseekV2ForCausalLM#7519

Merged

fairydreaming merged 30 commits intoggml-org:masterfrom

fairydreaming:deepseek-v2

May 28, 2024

Commits on May 16, 2024

Added initial support for DeepseekV2ForCausalLM.
sszymczy
committed

Commits on May 17, 2024

Merge branch 'ggerganov:master' into deepseek-v2
fairydreaming
authored

Commits on May 20, 2024

Referenced the relevant GitHub discussion instead of providing long comments.
sszymczy
committed
Added YaRN log multiplier model header parameter corresponding to the multiplier of the ln(s) from the sqrt(1/t) = 0.1 ln(s) + 1 equation.
sszymczy
committed

Commits on May 21, 2024

Commits on May 24, 2024

Commits on May 26, 2024

llama : correct llm_build_moe_ffn() arguments in build_arctic()
sszymczy
committed

Commits on May 27, 2024

Commits on May 28, 2024