flashinfer.comm.AllReduceFusionOp

class flashinfer.comm.AllReduceFusionOp
__init__()

Methods

Attributes

LAST_PROCESS_FOR_UB

MOE_ALLREDUCE_RESIDUAL_RMS_NORM

MOE_FINALIZE_ALLREDUCE_RESIDUAL_RMS_NORM

NONE

RESIDUAL_RMS_NORM

RESIDUAL_RMS_NORM_OUT_QUANT_FP8

RESIDUAL_RMS_NORM_OUT_QUANT_NVFP4

RESIDUAL_RMS_NORM_QUANT_FP8

RESIDUAL_RMS_NORM_QUANT_NVFP4

RESIDUAL_RMS_PREPOST_NORM