flashinfer.moe_ep.MoEEpAutoWorkspace¶
- class flashinfer.moe_ep.MoEEpAutoWorkspace(layer, fleet, signature, *, row_bound=None)¶
Bases:
objectA prepared input profile and its selected EP plan.
Later selection retains storage referenced by earlier captures. Destroy this handle collectively only after retiring every graph that used it. Live row counts may vary within the prepared bound; other input layouts stay fixed.
- destroy()¶
Release all plan storage after its graphs have been retired.