flashinfer.cake_kda_nondet_train.cake_kda_nondet_train_saved_bytes

flashinfer.cake_kda_nondet_train.cake_kda_nondet_train_saved_bytes(S: int, H: int, num_docs: int | None = None, *, save_mode: str = 'light', sm_count: int | None = None, use_qk_l2norm_in_kernel: bool = False) → int

Bytes of the saved set: Aqk and Akk (256 * S * H), plus, when num_docs is given, the device tables and the version’s per-call tensors: the forward’s gated queries qg (and, on the rows whose backward reads it from the set, the WY representation w / u) and the segment-boundary states under the size rule with save_mode="light"; the state tape, v_new and the segment transfers with save_mode="tape"; with use_qk_l2norm_in_kernel=True the FP32 reciprocal norms [2, S, H] (8 * S * H) in either.