flashinfer.norm.supports_gated_residual_rmsnorm

flashinfer.norm.supports_gated_residual_rmsnorm(branch: Tensor, residual: Tensor, weight: Tensor | None, alpha: Tensor, beta: Tensor, *, enable_pdl: bool = True, backend: Literal['auto', 'cake', 'cute'] = 'auto') → bool

Return whether tensors satisfy the SM100/SM103/SM107 fused-kernel contract and backend ("auto": the Cake package or the CuTe DSL kernel) can run the call on their device. "auto" answers for the call’s row count as well: a row count in a gap of the Cake package’s windows runs on the CuTe DSL kernel, so the answer is false there only where that kernel is unavailable. "cake" answers whether the package ships a program for the device, the variant and the tensors’ storage; an explicit cake call still raises for a row count in a gap (is_cake_gated_residual_rmsnorm_supported of flashinfer.cake_muse_spark_norm_backend answers for the row count).