flashinfer.fused_moe.get_scratchpad_size_bytes¶
- flashinfer.fused_moe.get_scratchpad_size_bytes() int¶
Return the global scratchpad size (bytes) required by the kernel.
The size is sourced from the C++
sizeof(MoEGemmSpec<Dims>)expression, so the buffer can never desync from the kernel’s struct layout.