Hide navigation sidebar

Hide table of contents sidebar

Skip to content

Toggle site navigation sidebar

FlashInfer 0.6.7 documentation

Toggle table of contents sidebar

FlashInfer 0.6.7 documentation

Get Started

Installation
Command Line Interface
Logging
Autotuning

Tutorials

Attention States and Recursive Attention
KV-Cache Layout in FlashInfer

PyTorch API Reference

FlashInfer Attention Kernels
Toggle navigation of FlashInfer Attention Kernels
flashinfer.gemm
Toggle navigation of flashinfer.gemm
flashinfer.fused_moe
Toggle navigation of flashinfer.fused_moe
flashinfer.cascade
Toggle navigation of flashinfer.cascade
flashinfer.comm
Toggle navigation of flashinfer.comm
flashinfer.sparse
flashinfer.page
Toggle navigation of flashinfer.page
flashinfer.sampling
Toggle navigation of flashinfer.sampling
flashinfer.topk
Toggle navigation of flashinfer.topk
flashinfer.logits_processor
Toggle navigation of flashinfer.logits_processor
flashinfer.norm
Toggle navigation of flashinfer.norm
flashinfer.rope
Toggle navigation of flashinfer.rope
flashinfer.activation
Toggle navigation of flashinfer.activation
flashinfer.quantization
Toggle navigation of flashinfer.quantization
- flashinfer.quantization.packbits
- flashinfer.quantization.segment_packbits
flashinfer.green_ctx
Toggle navigation of flashinfer.green_ctx
- flashinfer.green_ctx.split_device_green_ctx
- flashinfer.green_ctx.split_device_green_ctx_by_sm_count
flashinfer.fp4_quantization
Toggle navigation of flashinfer.fp4_quantization
flashinfer.testing
Toggle navigation of flashinfer.testing

Toggle table of contents sidebar

flashinfer.comm.QuantizationSFLayout¶

class flashinfer.comm.QuantizationSFLayout¶

__init__()¶

Methods

Attributes

`LINEAR`
`SWIZZLED_128x4`
`SWIZZLED_8x4`

flashinfer.comm.trtllm_allreduce_fusion

flashinfer.comm.AllReduceStrategyType

Copyright © 2023-2026, FlashInfer Contributors

Made with Sphinx and @pradyunsg's Furo

On this page

flashinfer.comm.QuantizationSFLayout
- QuantizationSFLayout
  - QuantizationSFLayout.__init__()