The short version
A vLLM fork adding MXFP4 and early PARO quantization for AMD R9700 GPUs.
From the HackerLinks archive
A vLLM fork adding MXFP4 and early PARO quantization for AMD R9700 GPUs.
The short version
A vLLM fork adding MXFP4 and early PARO quantization for AMD R9700 GPUs.
Why it caught our attention
An AMD GPU user called the fork excellent and uses it daily.
Where it surfaced on Hacker News
“The MXFP4 fork is excellent too. Its my daily driver right now.”
intothemild · recommendation · first hand use
Direct HN comment
Speculative Decoding in vLLM on AMD GPUs