22 points wondersky 39 minutes ago 5 comments

boodleboodle 14 minutes ago | parent

Whats the best model i should be runnning with two dgxs? Is there a reason they chose glm and not deepseek

gpugreg 2 minutes ago | parent

    > Is there a reason they chose glm and not deepseek
GLM-5.3's architecture is simpler and it came out earlier.

walrus01 7 minutes ago | parent

I'll get right on that after an elderly relative passes away and leaves me a valuable piece of real estate in a major city that will sell for enough money to buy two DGX stations in the current market. Or I win the lottery.

flowerthoughts 2 minutes ago | parent

GB300 DGX. Each with 256 GiB of RAM and a price of $100k?

For an enterprise, that price seems doable. But if you want 50-100 tps like Claude does, and you only have 10 users, maybe you're not an enterprise.

To pull a recent analogy, I guess we're still at the early Model S stage of LLMs.

jbellis 1 minute ago | parent

This doesn't seem all that impressive for $200k of hardware? You could serve 4bit off 8xB6000 for ~half the price. No idea what throughput you'd get tho so maybe that's the flex.