flashinfer.cake_sampling.choose_stage23¶
- flashinfer.cake_sampling.choose_stage23(top_k_max: int) tuple[int, int]¶
Smallest frozen
(threads, items)slab that holdstop_k_maxentries.
Back to top