Multi-Head Latent Attention

Low-Rank Key-Value Joint Compression

DeepseekMoE