8-bit quantization

From MMSU to MMAU-Pro: MiMo-Audio-7B-Instruct: How to Get SOTA in Audio Understanding

MiMo-Audio, an open-source audio model, claims to achieve cross-task few-shot generalization after millions of hours of pre-training, and has taken th...