flashinfer.cake_mhc_nondet_train.cake_mhc_nondet_train_forward_stats

flashinfer.cake_mhc_nondet_train.cake_mhc_nondet_train_forward_stats(X: Tensor, fn: Tensor, scale: Tensor, base: Tensor, *, rms_eps: float = 1e-05, hc_eps: float = 1e-06, sinkhorn_iters: int = 20, stats_out: Tensor | None = None, workspace: Tensor | None = None) → Tensor

Recompute the per-token statistics of forward_prepare (checkpoint replay).

The arguments and output are those of cake_mhc_det_train_forward_stats(); the call runs the backend package (the deterministic package’s bits).

Parameters:
Returns:

FP32 [T, 64] stats, bitwise the record of cake_mhc_nondet_train_forward_prepare() for the same inputs.

Return type:

torch.Tensor