flashinfer.logits_processor.TensorType¶
- class flashinfer.logits_processor.TensorType(value, names=<not given>, *values, module=None, qualname=None, type=None, start=1, boundary=None)¶
TensorType represents the semantic type of tensors in the pipeline.
- __init__(*args, **kwds)¶
Attributes
LOGITS
Raw or masked float scores, real-valued vectors
PROBS
Non-negative float probabilities, maybe normalized
INDICES
Integer token IDs, terminal type