Hmm, in the research I've seen, massively reduced ...
# general
r
Hmm, in the research I've seen, massively reduced precision like FP4/INT4 is only viable during inference