flashinfer.comm.AllReduceFusionOp¶

class flashinfer.comm.AllReduceFusionOp¶

Methods

Attributes

`LAST_PROCESS_FOR_UB`
`MOE_ALLREDUCE_RESIDUAL_RMS_NORM`
`MOE_FINALIZE_ALLREDUCE_RESIDUAL_RMS_NORM`
`NONE`
`RESIDUAL_RMS_NORM`
`RESIDUAL_RMS_NORM_OUT_QUANT_FP8`
`RESIDUAL_RMS_NORM_OUT_QUANT_NVFP4`
`RESIDUAL_RMS_NORM_QUANT_FP8`
`RESIDUAL_RMS_NORM_QUANT_NVFP4`
`RESIDUAL_RMS_PREPOST_NORM`