flashinfer.comm.mnnvl.MnnvlMemory¶
- class flashinfer.comm.mnnvl.MnnvlMemory(mapping: Mapping, size: int)¶
-
Methods
__init__(mapping, size)as_torch_strided_tensor(dtype)close_mnnvl_memory(ptr)get_allocation_granularity(dev_id)get_allocation_prop(dev_id)get_comm(mapping)initialize()new_mnnvl_memory_address(mapping, size)open_mnnvl_memory(mapping, size)set_comm_from_config(mapping[, config])support_nvlink([need_all_up])supports_mnnvl()Attributes
address_refcntallocated_mapallocation_granularitycommconfigcurrent_mem_offsetcurrent_rank_stridecurrent_start_addressdev_idfabric_page_sizeinitialized