flashinfer.concat_ops¶
Helpers that concatenate / pack tensors for MLA-style attention layouts.
flashinfer.dsv3_ops re-exports concat_mla_k() for DeepSeek-V3 call
sites.
|
Concatenate k_nope and k_rope tensors for MLA attention. |
Helpers that concatenate / pack tensors for MLA-style attention layouts.
flashinfer.dsv3_ops re-exports concat_mla_k() for DeepSeek-V3 call
sites.
|
Concatenate k_nope and k_rope tensors for MLA attention. |