flashinfer.norm.supports_gated_residual_rmsnorm¶
- flashinfer.norm.supports_gated_residual_rmsnorm(branch: Tensor, residual: Tensor, weight: Tensor | None, alpha: Tensor, beta: Tensor, *, enable_pdl: bool = True, backend: Literal['auto', 'cake', 'cute'] = 'auto') bool¶
Return whether tensors satisfy the SM100/SM103/SM107 fused-kernel contract and
backend("auto": the Cake package or the CuTe DSL kernel) can run the call on their device."auto"answers for the call’s row count as well: a row count in a gap of the Cake package’s windows runs on the CuTe DSL kernel, so the answer is false there only where that kernel is unavailable."cake"answers whether the package ships a program for the device, the variant and the tensors’ storage; an explicit cake call still raises for a row count in a gap (is_cake_gated_residual_rmsnorm_supportedofflashinfer.cake_muse_spark_norm_backendanswers for the row count).