22 points wondersky 39 minutes ago 5 comments
walrus01 7 minutes ago | parent
I'll get right on that after an elderly relative passes away and leaves me a valuable piece of real estate in a major city that will sell for enough money to buy two DGX stations in the current market. Or I win the lottery.
flowerthoughts 2 minutes ago | parent
GB300 DGX. Each with 256 GiB of RAM and a price of $100k?
For an enterprise, that price seems doable. But if you want 50-100 tps like Claude does, and you only have 10 users, maybe you're not an enterprise.
To pull a recent analogy, I guess we're still at the early Model S stage of LLMs.
jbellis 1 minute ago | parent
This doesn't seem all that impressive for $200k of hardware? You could serve 4bit off 8xB6000 for ~half the price. No idea what throughput you'd get tho so maybe that's the flex.