flashinfer.comm.AllReduceFusionPattern¶
- class flashinfer.comm.AllReduceFusionPattern¶
- __init__()¶
Methods
__init__()Attributes
kARResidualRMSNormkARResidualRMSNormFP4QuantkARResidualRMSNormFP8QuantkARResidualRMSNormOutFP4QuantkARResidualRMSNormOutFP8QuantkARResidualRMSNormOutPerTokenGroupFP8PackedQuantkARResidualRMSNormPerTokenGroupFP8PackedQuantkAllReducekMoEFinalizeARResidualRMSNormkMoEReductionARResidualRMSNorm