Skip to content

vllm.models.mistral.mistral_large4.amd.specialized_decode.mono.common.runtime

Host-side mechanisms of a mono runner, one module each (imported directly, so the ones without an AITER dependency load without it): consensus (TP-uniform decisions), peer_memory (symmetric peer buffers), abi (kernel argument tables), compile (compile-only builds).

Modules:

  • consensus –

    Decisions every TP rank must take alike.

  • hip_ipc –

    Small ctypes wrapper for HIP allocation and IPC memory operations.

  • peer_memory –

    Symmetric peer memory for in-kernel TP reductions.

  • step_begin –

    A step's beginning (DESIGN_v3 I1), one launch: every mailbox buffer