if I knew the served precision, It would save me the time of comparing the probabilities of a remote qwen 27B against my local native-precision 27B, and likewise for gemma4 31b. I am running qwen locally in native precision for the accuracy. The accuracy is what I'm after. I'd like to expand - using both my local GPU /w native precision 27B AND a remote qwen of the same precision. I don't want reduced precision for this work I'm doing.
It seems to me like they want our eyes to turn into hearts when we see "Qwen 27B" being served, but they aren't telling us they quantized it. I could run quantized qwen at twice the speed of native precision qwen, I don't want quantized.
