flashinfer.green_ctx¶
This module provides utilities for creating CUDA green contexts.
Green context creation¶
|
Split the device into multiple green contexts, return the corresponding streams and CUdevResource for each group and the remaining SMs. |
|
Split the device into multiple green contexts, each with a fixed number of SMs, return the corresponding streams and CUdevResource for each group and the remaining SMs. |