flashinfer.msa_ops.msa_icp_index_score_plan_storage¶
- flashinfer.msa_ops.msa_icp_index_score_plan_storage(*, num_qo_heads: int, total_q: int, batch: int, device: device) dict¶
Sizes of a prefill plan’s storage:
work_range_numel(int64, one per SM),work_info_numel(int64) andworkspace_bytes(uint8).