flashinfer.comm.mixed_comm.MixedCommMode

class flashinfer.comm.mixed_comm.MixedCommMode(value, names=<not given>, *values, module=None, qualname=None, type=None, start=1, boundary=None)

Enumeration of mixed communication execution modes.

Fused modes run a single fused kernel using virtual memory (intra-node) and nvshmem (inter-node). NCCL modes delegate to one or more NCCL collective calls. AUTOTUNE selects the best mode based on profiling.

Fused values must be aligned with MixedCommMode in mixed_comm.cuh.

__init__(*args, **kwds)

Methods

conjugate	Returns self, the complex conjugate of any int.
bit_length()	Number of bits necessary to represent self in binary.
bit_count()	Number of ones in the binary representation of the absolute value of self.
to_bytes([length, byteorder, signed])	Return an array of bytes representing an integer.
from_bytes([byteorder, signed])	Return the integer represented by the given array of bytes.
as_integer_ratio()	Return a pair of integers, whose ratio is equal to the original int.
is_integer()	Returns True.
__init__(*args, **kwds)

Attributes

real	the real part of a complex number
imag	the imaginary part of a complex number
numerator	the numerator of a rational number in lowest terms
denominator	the denominator of a rational number in lowest terms
FUSED_OPT_WAITS_MC
FUSED_OPT_WAITS_UC
FUSED_OPT_BYTES1_MC
FUSED_OPT_BYTES1_UC
FUSED_OPT_BYTES2_MC
FUSED_OPT_BYTES2_UC
NCCL_ONE
NCCL_TP_DP
AUTOTUNE