flashinfer.norm

Kernels for normalization layers.

rmsnorm(input, weight[, eps, out, enable_pdl])	Root mean square normalization.
fused_add_rmsnorm(input, residual, weight[, ...])	Fused add root mean square normalization.
gemma_rmsnorm(input, weight[, eps, out, ...])	Gemma-style root mean square normalization.
gemma_fused_add_rmsnorm(input, residual, weight)	Gemma-style fused add root mean square normalization.
layernorm(input, gemma, beta[, eps])	Layer normalization.