flashinfer.comm.CudaRTLibrary¶

class flashinfer.comm.CudaRTLibrary(so_file: str | None = None)¶

Methods

`CUDART_CHECK`(result)
`__init__`([so_file])
`cudaDeviceReset`()
`cudaDeviceSynchronize`()
`cudaFree`(devPtr)
`cudaGetErrorString`(error)
`cudaIpcGetMemHandle`(devPtr)
`cudaIpcOpenMemHandle`(handle)
`cudaMalloc`(size)
`cudaMemcpy`(dst, src, count)
`cudaMemset`(devPtr, value, count)
`cudaSetDevice`(device)

Attributes