31 points sroussey 2 hours ago 9 comments
dyyd3333 1 hour ago | parent
mortalapeman 55 minutes ago | parent
kimixa 1 minute ago | parent
And I assume the metrics comparing qwen are using a quantized version - from the blog they compare memory use against qwen's "standard 4-bit deployment". Which might explain the improved performance over that base model they show - it might lose less from quantization.
Zetaphor 49 minutes ago | parent
fesoliveira 48 minutes ago | parent
SwellJoe 35 minutes ago | parent
rybosome 26 minutes ago | parent
This score is roughly on par with 5.6 Terra max, which in my direct experience is perfectly capable of driving a cloud agent harness that can do pretty complex knowledge work.
Definitely worth an evaluation!
paulhart 8 minutes ago | parent
PaulKeeble 6 minutes ago | parent