flashinfer.comm.trtllm_destroy_ipc_workspace_for_all_reduce_fusion

flashinfer.comm.trtllm_destroy_ipc_workspace_for_all_reduce_fusion(workspace: List[List[int]], group: ProcessGroup | None = None) None

Parameters: - workspace: the workspace to destroy. - group: the process group to use.

Note: This function is used to destroy a workspace for all reduce fusion. The workspace is a list of IPC handles. The workspace should be destroyed after calling trtllm_custom_all_reduce_fusion. The workspace can be reused for multiple all reduce fusion calls under the same configuration.