flashinfer.comm.vllm_get_graph_buffer_ipc_meta

flashinfer.comm.vllm_get_graph_buffer_ipc_meta(fa: int) → Tuple[List[int], List[int]]

Return IPC metadata for graph-capture buffers.

Parameters:

fa (int) – Handle returned by init_custom_ar().

Returns:

(output_bytes, output_offsets) describing the registered graph-capture buffers. Used to publish IPC handles to peer ranks.

Return type:

Tuple[list[int], list[int]]