flashinfer.msa_ops.msa_icp_decode_score_columns¶
- flashinfer.msa_ops.msa_icp_decode_score_columns(max_model_len: int, page_size: int) int¶
Decode score columns:
min(8192, ceil(max_model_len / (4 * page_size)) * 4).
Decode score columns: min(8192, ceil(max_model_len / (4 * page_size)) * 4).