flashinfer.comm.vllm_dispose

flashinfer.comm.vllm_dispose(fa: int) → None

Release the resources held by a vLLM custom all-reduce handle.

Parameters:

fa (int) – Handle returned by init_custom_ar().