flashinfer.fused_moe.CuTileMxfp8Bf16Config

class flashinfer.fused_moe.CuTileMxfp8Bf16Config

cuTile MXFP8 weights with BF16 inputs to both GEMMs.

Shares prepared weights with CuTileMxfp8Config. Expert parallelism and fused shared experts are not supported.

__init__() → None

Methods

__init__()
prepare_weights(w1_fp8, w1_scale, w2_fp8, ...)	Prepare E4M3 weights with logical [E, N, K/32] E8M0 scales.
supported(arch)