flashinfer.fused_moe.cute_dsl.cute_dsl_fused_moe_nvfp4¶
- flashinfer.fused_moe.cute_dsl.cute_dsl_fused_moe_nvfp4(x: Tensor, x_sf: Tensor | None, token_selected_experts: Tensor, token_final_scales: Tensor, w1_weight: Tensor, w1_weight_sf: Tensor, w1_alpha: Tensor, fc2_input_scale: Tensor | None, w2_weight: Tensor, w2_weight_sf: Tensor, w2_alpha: Tensor, num_experts: int, top_k: int, num_local_experts: int | None = None, local_expert_offset: int = 0, output_dtype: dtype = torch.bfloat16, use_fused_finalize: bool = True, moe_output: Tensor | None = None, aux_stream: Stream | None = None, enable_pdl: bool = True, activation_type: int = 3, swiglu_alpha: float = 1.0, swiglu_beta: float = 0.0, swiglu_limit: float = 3.4028234663852886e+38, situ_beta: float | None = None, situ_linear_beta: float | None = None, *, quant_mode: str = 'w4a4', per_token_scale: Tensor | None = None) Tensor¶
Run a fused MoE forward pass using the CuTe-DSL NVFP4 kernels.
Warning
This API will be deprecated in the future, please use
cute_dsl_fused_moe()withquant_mode="w4a4"instead.See
cute_dsl_fused_moe()for the full parameter documentation; this function forwards every argument unchanged.