flashinfer.mhc¶
Multi-head residual Combination (mHC) kernels used by Agentic-style residual
mixing with a fixed HC=4 sub-head layout.
|
Apply mHC post mapping for HC=4. |
|
Apply mHC pre-map big-fuse using external projection and sqrsum. |
|
Apply mHC pre-map big-fuse and compute RMS sqrsum from |