flashinfer.comm.AllReduceFusionPattern¶
- class flashinfer.comm.AllReduceFusionPattern¶
- __init__()¶
Methods
__init__()Attributes
kARResidualRMSNormkARResidualRMSNormDynamicFP8QuantkARResidualRMSNormFP4QuantkARResidualRMSNormFP8QuantkARResidualRMSNormOutDynamicFP8QuantkARResidualRMSNormOutFP4QuantkARResidualRMSNormOutFP8QuantkARResidualRMSNormOutPerTokenGroupFP8PackedQuantkARResidualRMSNormPerTokenGroupFP8PackedQuantkAllReducekMoEFinalizeARResidualRMSNormkMoEReductionARResidualRMSNorm