flashinfer.moe_ep.NVLinkTwoSidedConfig

class flashinfer.moe_ep.NVLinkTwoSidedConfig(backend_name: str = 'nvlink_two_sided', comm_backend: 'CommBackend' | None = None)

Bases: object

Options of NVLinkTwoSidedAlltoAll.

Pass to create_communication(..., backend=NVLinkTwoSidedConfig()) or MoEEpLayer(..., backend=SplitConfig(comm=NVLinkTwoSidedConfig())). comm_backend exchanges the MNNVL memory handles and defaults to torch.distributed over the bootstrap process group.