The KimiLinear training formula is the same.

Kimi Linear Technical Report Released: Linear Attention Surpasses Full Attention in Multiple Scenarios, Open KDA Kernel and vLLM Integration

Moonshot AI announced the release of its Kimi Linear technical report and open weights, highlighting its core components: the Kimi Delta Attention (KD...