flashinfer.norm.supports_gated_residual_next_rmsnorm¶
- flashinfer.norm.supports_gated_residual_next_rmsnorm(branch: Tensor, residual: Tensor, next_weight: Tensor, alpha: Tensor | float, beta: Tensor, *, post_weight: Tensor | None = None, backend: Literal['auto', 'cake', 'cute'] = 'auto') bool¶
Return whether inputs satisfy the SM100/SM103/SM107 two-norm kernel contract and
backend("auto": the Cake package or the CuTe DSL kernel) can run the call on their device."auto"answers for the call’s row count as well: a row count in a gap of the Cake package’s windows runs on the CuTe DSL kernel, so the answer is false there only where that kernel is unavailable."cake"answers whether the package ships a program for the device and the variant; an explicit cake call still raises for a row count in a gap (is_cake_gated_residual_next_rmsnorm_supportedofflashinfer.cake_muse_spark_norm_backendanswers for the row count).