flashinfer.comm.AllReduceFusionOp¶
- class flashinfer.comm.AllReduceFusionOp¶
- __init__()¶
Methods
__init__
()Attributes
LAST_PROCESS_FOR_UB
MOE_ALLREDUCE_RESIDUAL_RMS_NORM
MOE_FINALIZE_ALLREDUCE_RESIDUAL_RMS_NORM
NONE
RESIDUAL_RMS_NORM
RESIDUAL_RMS_NORM_OUT_QUANT_FP8
RESIDUAL_RMS_NORM_OUT_QUANT_NVFP4
RESIDUAL_RMS_NORM_QUANT_FP8
RESIDUAL_RMS_NORM_QUANT_NVFP4
RESIDUAL_RMS_PREPOST_NORM