flashinfer.comm.trtllm_destroy_ipc_workspace_for_all_reduce¶
- flashinfer.comm.trtllm_destroy_ipc_workspace_for_all_reduce(workspace: List[List[int]], group: ProcessGroup | None = None) None ¶
Note: This function is used to destroy a workspace for all reduce. The workspace is a list of IPC handles. The workspace should be destroyed after calling trtllm_custom_all_reduce. The workspace can be reused for multiple all reduce calls under the same configuration.