flashinfer.cake_kda_nondet_train_kcp.cake_kda_nondet_train_kcp_handoff_bytes

flashinfer.cake_kda_nondet_train_kcp.cake_kda_nondet_train_kcp_handoff_bytes(ctx: Any, *, H: int = 64, saved_rows: str = 'auto') → int

Bytes of the checkpoint hand-off’s set for one engaged call with H heads on this rank, the most by which it raises this rank’s checkpoint peak (see cake_kda_nondet_kcp()). saved_rows: the call’s saved_rows ("auto" by default: the "wy" rows form, 768 * R * H); "tape" the tape set (NC_pad * H * 32768 + 768 * R * H); "intra" / "wy" the hand-off’s rows form (256 * R * H / 768 * R * H), "none" 0.

Parameters:
  • ctx – This rank’s context from cake_kda_nondet_train_kcp_build_context().

  • H (int, default=64) – Number of KDA heads.

  • saved_rows (str, default="auto") – Kept-row form: "auto" uses "wy"; "none" retains no hand-off rows. Other forms are "intra", "wy" and "tape", as described above.