flashinfer.cake_kda_nondet_train_kcp.cake_kda_nondet_train_kcp_handoff_bytes¶
- flashinfer.cake_kda_nondet_train_kcp.cake_kda_nondet_train_kcp_handoff_bytes(ctx: Any, *, H: int = 64, saved_rows: str = 'auto') int¶
Bytes of the checkpoint hand-off’s set for one engaged call with
Hheads on this rank, the most by which it raises this rank’s checkpoint peak (seecake_kda_nondet_kcp()).saved_rows: the call’ssaved_rows("auto"by default: the"wy"rows form,768 * R * H);"tape"the tape set (NC_pad * H * 32768 + 768 * R * H);"intra"/"wy"the hand-off’s rows form (256 * R * H/768 * R * H),"none"0.- Parameters:
ctx – This rank’s context from
cake_kda_nondet_train_kcp_build_context().H (int, default=64) – Number of KDA heads.
saved_rows (str, default="auto") – Kept-row form:
"auto"uses"wy";"none"retains no hand-off rows. Other forms are"intra","wy"and"tape", as described above.