flashinfer.green_ctx.get_locality_domain_count

flashinfer.green_ctx.get_locality_domain_count(dev: device) → int

Number of locality domains (uGPUs, one per die) of dev.

Parameters:

dev – The CUDA device ("cuda" without an index means the current device).

Returns:

2 on Rubin VR200, 1 when the device or the installed driver / cuda-python does not expose locality domains.

Return type:

The number of locality domains