flashinfer.cake_kda_det_train.cake_kda_det_train_saved_bytes¶
- flashinfer.cake_kda_det_train.cake_kda_det_train_saved_bytes(S: int, H: int, num_docs: int | None = None, *, save_mode: str = 'light', sm_count: int | None = None, use_qk_l2norm_in_kernel: bool = False) int¶
Bytes of the saved set:
AqkandAkk(256 * S * H), plus, whennum_docsis given, the device tables and the version’s per-call tensors: the forward’s gated queriesqg(and, on the rows whose backward reads it from the set, the WY representationw/u) and the segment-boundary states under the size rule withsave_mode="light"; the state tape,v_newand the segment transfers withsave_mode="tape"; withuse_qk_l2norm_in_kernel=Truethe FP32 reciprocal norms[2, S, H](8 * S * H) in either.