Skip to content

vllm.models.mistral.amd

Modules:

  • attention –
  • indexer –

    DSA lightning indexer and its FP8 key cache.

  • moe –
  • ops –

    Hand-fused eager Triton kernels for Mistral models on ROCm.

  • ssmax –

    Scalable-softmax (SSMax) query scaling.