47 points | by kkm 3 hours ago ago
3 comments
We at doubleword are bullish for AMD for low-interactivity inference - it does just take a bigger lift on the software side...
Also the vllm patch accompanying the blogpost: https://github.com/doublewordai/vllm-amd-blog-doubleword
Nice work! Would DeepSeek V4 Pro on 8xMI300X work with these patches?
We at doubleword are bullish for AMD for low-interactivity inference - it does just take a bigger lift on the software side...
Also the vllm patch accompanying the blogpost: https://github.com/doublewordai/vllm-amd-blog-doubleword
Nice work! Would DeepSeek V4 Pro on 8xMI300X work with these patches?