flashinfer.cake_rmsnorm_det_train.program_windows

flashinfer.cake_rmsnorm_det_train.program_windows(arch: str, hidden: int, kind: str, residual: bool, w_dtype: str = 'bf16') → tuple[tuple[int, int | None, str], ...]

The row-count windows of one route and the program each launches.

One (above, at_most, library) per main program of the route (the dw reduce companions share their owner’s window), from the smallest row counts up: the call with above < rows <= at_most (at_most None = unbounded) launches library. The windows tile every positive row count exactly once; a route whose records do not is refused. Within one window a row’s outputs do not depend on the token count (see the package docstrings); the edges are where they may change.