flashinfer.cake_rmsnorm_silu_gate_det_train.cake_rmsnorm_silu_gate_det¶
- flashinfer.cake_rmsnorm_silu_gate_det_train.cake_rmsnorm_silu_gate_det(x: Tensor, z: Tensor, weight: Tensor, eps: float = 1e-06) Tensor¶
Differentiable
RMSNorm(x) * weight * SiLU(z)over the last dimension (128):CakeRMSNormSiLUGateDetFunctionapplied to the arguments.