Project dossier

China's CXMT says new memory-chip platform enters mass production

Every day there's a new post of some optimized config or new inference engine that is just super good at one specific thing and their claims make sense. And then at the bottom of the post or maybe after someone asked it says "NVFP4/MXFP4 only". Okay dude, good job! You made the fastest possible option a little slightly faster, and most likely your output is completely cooked and you get hallucinations left right and center. Just saw another one in r/ROCm again. It's fine if you run 4-bit for lar