flashinfer.moe_ep.AutoConfig¶
- class flashinfer.moe_ep.AutoConfig(candidates: tuple[MegaConfig | SplitConfig, ...], candidate: int | None = None)¶
Bases:
objectSelect a complete EP path from explicitly configured candidates.
Each split candidate keeps its configured transport.
candidatepins one entry while still allowing tuning within it. An unset value compares all eligible entries during an enabledautotune_v2()warmup.