flashinfer.comm.AllReduceFusionWorkspace¶
- class flashinfer.comm.AllReduceFusionWorkspace(world_size: int, rank: int)¶
Base class for AllReduce fusion workspaces.
- __init__(world_size: int, rank: int)¶
Methods
__init__(world_size, rank)destroy()Destroy workspace and free resources.
is_buffer_size_sufficient(tp_size, ...[, ...])Attributes
backendReturn backend name.
world_sizerank