95 points notfried 2 hours ago 72 comments
cyberpunk 1 hour ago | parent
newsclues 1 hour ago | parent
ComputerGuru 1 hour ago | parent
close04 22 minutes ago | parent
The ECC in DDR5 is on-die ECC and that's not "real" ECC, it's what DDR5 needs to not fail. Side-band ECC is the standard method, employing extra memory chips and 72bit memory. OEMs mix these in the marketing materials to fool the users into thinking they buy the better option.
ComputerGuru 10 minutes ago | parent
bel8 1 hour ago | parent
Mashimo 53 minutes ago | parent
aeyes 38 minutes ago | parent
snowram 22 minutes ago | parent
cosmic_cheese 19 minutes ago | parent
It’s nice for games but I don’t really care for productivity use. In fact in that situation I’d take integer-scaled HiDPI density over refresh rate in that scenario.
cbg0 14 minutes ago | parent
dopa42365 14 minutes ago | parent
Xeoncross 1 hour ago | parent
The generation doesn't mater as much to me as the memory bandwidth. When that day comes, I'd rather have a M1 Max 64GB over a M5 Pro 64GB.
apples_oranges 1 hour ago | parent
wslh 1 hour ago | parent
I am one of those: bought the M1 Max with 64gb thinking in running VMs, afterward bought a lighter Air with less memory and ended up using the M1 Max as a kind of luxury for LLMs and multicore computing.
mikae1 1 hour ago | parent
The only hope we have is the AI bubble bursting, but that will undoubtedly come with its own set of macroeconomic surprises.
colechristensen 54 minutes ago | parent
bilbo0s 58 minutes ago | parent
I don't know man?
The generation kind of does matter. I'm not gonna lie, matrix multiplication units speed things up considerably. That hardware confers a material change in capability.
Maybe from M5 up, it doesn't matter? But you're definitely going to notice the difference between M1 and M5 for instance.
bitexploder 52 minutes ago | parent
And now if you stretch you can run DeepSeek Flash 4.1.
And if you were willing to roll up your sleeves you could build your own AI lab at home and run this model and models like GLM Flash 5.3 and DeepSeek Flash V4.1 at lower quants. The budget GPUs (like V100) are kind of not budget now, but still <5K to acquire 128GB of fast VRAM that can compete with a 5090 and actually has a lot more interesting options available IMO.
jonatron 46 minutes ago | parent
jmkni 37 minutes ago | parent
bitexploder 31 minutes ago | parent
bitexploder 33 minutes ago | parent
Dense models also don't like quantization as much and are less tolerant of it. There are some very interesting smaller models like https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4... Dory that I would check out. You need system RAM or to stream a larger MoE model from disk and it won't be fast. You need to specialize the models some to get quality results if you have very limited system resources.
origini 32 minutes ago | parent
It will show you on the model selection IF a model fits and if you use a "Qwen 3.8-35B-A3B" type of model, it should just work out of the box. A3B stands for Active which means you need a lot less fast ram.
You will run into issues fast though: If you have big tasks for it to do, your pc/mac will get warm very fast and noisy and you will cosume relevant more energy.
And as you mention: yeah small context!
Its still not that practical in my opinion.
Grombobulous 24 minutes ago | parent
https://github.com/Niko1221/Strata/
My setup is a Ryzen 3600, 90GB DDR4 allocated to a VM (don’t even really need that much, just had it available, special thanks to the year 2024), and an RX 9060XT 16GB ($500 GPU).
I get around 40-60 tok/s depending on the quantization level I choose.
As you can see, the CPU is nothing special, don’t even need DDR5.
brandall10 48 minutes ago | parent
So it depends on what you're doing. Using it for a fun oracle without feeding it too much context per turn? Sure, an older Max chip is great.
As a coding agent doing meaningful work on a sizable project? Compared to a cheap as chips cloud option, it will take an order of magnitude more time to complete.
johng 42 minutes ago | parent
It feels just as fast as day 1 and I've never had any speed issues. Say what you want about Apple and their pricing and ecosystem but I've been using their hardware for over 20 years now and it's always been top notch.
If you buy their support/AppleCare, your support and warranty is excellent too. They don't skimp. I've seen them go so far past the extra mile it's unreal.
dirtbag__dad 32 minutes ago | parent
kilroy123 31 minutes ago | parent
alasano 18 minutes ago | parent
Definitely grabbing 128 GB + for the next machine.
origini 37 minutes ago | parent
Isn't it also rumored that the M7 is reworked for AI?
And Xiaomi announced their AI Cube with 1.2t of bandwidth. Just because Nvidia is protecting its business by giving consumers either compute or bandwidth and Apple being something in between, doesn't mean we can't get both a lot better balanced.
vadansky 31 minutes ago | parent
alasano 20 minutes ago | parent
I'm gonna max out most of the specs on the next one I get, would feel insanely wasteful to do that now.
HelloUsername 1 hour ago | parent
ex1fm3ta 1 hour ago | parent
Aurornis 48 minutes ago | parent
Though I have had good results buying 1-2 generation old refurbished Macs as my secondary machines or for family members who don’t need cutting edge everything.
It’s even more valuable now that Apple silicon of every generation is more than enough to run every non-power user use case short of newer video games.
declan_roberts 47 minutes ago | parent
random__duck 6 minutes ago | parent
ex1fm3ta 1 hour ago | parent
phgn 1 hour ago | parent
ale 1 hour ago | parent
mdasen 58 minutes ago | parent
eddieroger 44 minutes ago | parent
saysjonathan 42 minutes ago | parent
0: https://www.ifixit.com/Teardown/iMac+Intel+27-Inch+EMC+2309+...
1: https://www.ifixit.com/Teardown/iMac+M3+24-Inch+Teardown:+Ap...
synchrone 1 hour ago | parent
https://www.apple.com/shop/product/mxk53am/a/magic-mouse-usb...
jtbaker 55 minutes ago | parent
everdrive 1 hour ago | parent
anentropic 52 minutes ago | parent
spider-mario 44 minutes ago | parent
sscarduzio 40 minutes ago | parent
stirlo 1 hour ago | parent
cosmic_cheese 24 minutes ago | parent
It’s too bad. A high end iMac still holds a lot of appeal, especially for those seeking clean desk setups. I’m using an MBP hooked up to dual monitors through a dock right now and it’s fine, but I do miss how clean my desk was back when it was a VESA mounted iMac Pro and companion monitor.
booty 18 minutes ago | parent
the iMac returned to its roots as the “family computer” or “grandma email box” kind of machine.
And receptionists! Don't forget receptionists. :)cosmic_cheese 13 minutes ago | parent
booty 2 minutes ago | parent
What's the appeal there? Doing big-RAM-requirement stuff that just won't run on a laptop?
booty 22 minutes ago | parent
24" is a good size for casual users which is the main market. You can have two roomy-ish GUI apps (two web pages, etc) side by side.
hyperbovine 17 minutes ago | parent
bitexploder 1 hour ago | parent
zf00002 34 minutes ago | parent
geff82 53 minutes ago | parent
Aurornis 50 minutes ago | parent
This has been reported for many months. Sorry if you missed the news, but if you need a much higher memory variant the M5 Pro/Max are what’s available this cycle.
iAMkenough 45 minutes ago | parent
verdverm 35 minutes ago | parent
jmull 38 minutes ago | parent
sharts 11 minutes ago | parent
tempodox 10 minutes ago | parent
wiether 9 minutes ago | parent
I would love to have a pink one for my MBP!