69 points karakoram 11 hours ago 81 comments
lambdadelirium 11 hours ago | parent
ShadowOfThePit 11 hours ago | parent
Also...
> Please don't complain about tangential annoyances—e.g. article or website formats, name collisions, or back-button breakage. They're too common to be interesting.
ShadowOfThePit 11 hours ago | parent
> He describes using AI agents as getting help with “almost anything that you do in your day-to-day life. (...) Almost anything you want to do, it knows you, and it’s there to help. And it will actually sort of run ahead and say, ‘What about this?’ Or it’ll help you see around corners.”
Wow, impressive. Both the capabilities and how much he's willing to share.
Is it worth $17k per month? For me, absolutely not. But people spend more on luxurious cars and such, so if you've got money to spare...
> Y Combinator is also using an agent that is “rebuilding the way we operate at YC. We now have an internal AI agent, for instance, named Stray Light that kind of has a personality, and then it has a company brain. It actually has the total context of every founder we’ve ever backed, anyone who’s ever emailed us, like all the applications.”
Holy anthropomorphization. But besides that, what's the goal of doing this? Keeping a handy overview of when and why someone said something?
randysalami 10 hours ago | parent
Because they can. It’s as simple as that. To find meaning, to feel in control, to win. To dominate.
switchers 10 hours ago | parent
27183 10 hours ago | parent
SpicyLemonZest 10 hours ago | parent
You'd be surprised how important such an overview can be in relationship-based businesses. People spend a lot of time trying to track down a vague memory they have of someone telling them something. CRM platforms are big for a reason, after all.
pythonaut_16 7 hours ago | parent
The only way I can imagine to burn that many tokens is just to run every task fully through the most expensive LLM with no real strategy. Like indexing emails should be a combo of scripts and small summarizing prompts I'd think.
ex1fm3ta 10 hours ago | parent
A_D_E_P_T 10 hours ago | parent
(Figures vary, see e.g. https://www.linkedin.com/posts/christham_4-weeks-on-claude-2... for $13,700/mo.)
If you hit your limits on two Max 20x plans, you could very well be exceeding $300k/yr in token use at current API rates.
pu_pe 10 hours ago | parent
TiredOfLife 9 hours ago | parent
bartread 10 hours ago | parent
I wouldn't say this was the norm, but I have burned through £1k of tokens in a couple of days before. And, on that same gig, I realised a test I was considering running would burn £2.5k worth of tokens over the course of a few hours so spent a couple of hours of my own time re-engineering it to get that down to £150.
The point is that I don't necessarily know that spending a shitload of money on tokens really tells us anything useful. If he's getting a return on that investment, fine, whatever.
Obviously most of us couldn't afford to spend that much ourselves, no matter how much value it might deliver, and many of our employers wouldn't be too happy if we spent it on their dime either. Equally, if you can, and it's delivering real value, then I don't see why you wouldn't?
plusfour 10 hours ago | parent
details please, if it's interesting
hparadiz 10 hours ago | parent
deadnomore 9 hours ago | parent
sixtyj 8 hours ago | parent
You can do it if your employer has endless pockets.
Example: $30/1M input tokens (I don’t count output or cache, for simplification), you have several daily agents for everything => 3M tokens daily per agent * 10 agents ~> $900/day => $328k/year (API spending)
bartread 7 hours ago | parent
nodesocket 10 hours ago | parent
bartread 7 hours ago | parent
And, in fact, I got it from £2500 to £150 by careful model selection (I ran a trial over a small dataset with different models until I found the least expensive/capable model that would reliably do what I needed), using a local model for one step, and paring down the inputs as well so the token count plummeted.
wolvoleo 19 minutes ago | parent
They feel like they're super smart but it's just as smart as hiring a $500k/yr PhD as a PA to schedule your meetings and answer the phone. Sure it does a good job but you're just wasting money and abilities.
They feel super edgy and bleeding edge but all they really do differently is switching the AI chat from auto to the most expensive option all the time. When I see what they're using it for they're only grasping the basics of its abilities.
They're also people sending 2 page AI generated emails that make no sense for literally everything where a "Yeah sure let's do that" would have sufficed.
Unfortunately most of these are business leaders who just want to look edgy and "all in on AI" so we can't really limit their tokens. Yet they're also the ones saying we spend too much and want to limit some of our dev teams actually putting it to good use.
hartjer 10 hours ago | parent
up2isomorphism 10 hours ago | parent
jgalt212 10 hours ago | parent
meindnoch 10 hours ago | parent
Jtsummers 10 hours ago | parent
georgemcbay 10 hours ago | parent
Garry Tan is fully aligned with Elon Musk in going after MacKenzie Scott's charitable giving, making spurious arguments that she's doing it in the wrong way when they are all just running cover for the fact that she's one of the few at that level of wealth being charitable at all these days.
Silly woman, she should give her money away the right way, which I guess is by attempting to buy political power.
Jtsummers 9 hours ago | parent
https://garryslist.org/posts/mackenzie-scott-s-26-billion-su... - The rant itself.
lovich 3 hours ago | parent
> This isn’t generosity. It’s negligence at scale.
Is when I realized I was wasting my time reading the article
Hikikomori 4 hours ago | parent
bitwize 2 hours ago | parent
2020s, techbros: "Here's why it's a huge problem for non-billionaires to have things."
vrganj 10 hours ago | parent
georgemcbay 10 hours ago | parent
"Garry, this is a text file".
qwr1 10 hours ago | parent
Software? I'm not aware of anything.
fantasizr 10 hours ago | parent
itishappy 10 hours ago | parent
fantasizr 10 hours ago | parent
itishappy 9 hours ago | parent
> “It’s too expensive right now,” he said, adding that he knows the amount of money he spends on AI agents is “a crazy privilege that not everyone can do.”
johnfn 10 hours ago | parent
wahnfrieden 10 hours ago | parent
ks2048 10 hours ago | parent
bwfan123 19 minutes ago | parent
This is a difficult question to answer ! I would ask a related question which is equally hard. Has AI-use increased your human cognitive capability or decreased it ?
glennfiedler 10 hours ago | parent
bix6 10 hours ago | parent
Sleep is one of the most important things in the world. Why not have the agents work while you sleep?
itishappy 10 hours ago | parent
It was productive, but as you say, it's dangerous to gamble with sleep.
hackyhacky 10 hours ago | parent
Even better, why not have the agents sleep for you?
EDIT: for those who say this is not realistic, I've had Claude sleep for 10 hours in just 30 seconds. Saved me an entire night.
Freedom2 9 hours ago | parent
hackyhacky 9 hours ago | parent
[1] https://www.amazon.com/Million-Plus-Random-Digits-Symbols-Gu...
trog 6 hours ago | parent
cozzyd 1 hour ago | parent
thephyber 9 hours ago | parent
People in psychosis don't exactly weigh all of the options with a level head. He may not recognize that he has "cyber psychosis" or that his lack of sleep is a bad thing.
stego-tech 10 hours ago | parent
Not cloud costs, though; consumer costs. These agents must run on-device for privacy protections, because anything less will be a global non-starter. That means we need models that excel on phones, tablets, laptops, and desktops; we need home compute modules to run larger, “frontier”-class models for bigger tasks but without guzzling electricity (the Mac Mini’s power envelope is an ideal target); we need smart harnesses that can foist off inference to bigger models elsewhere on your private network of devices as needed without the user prompting for specific thinking modes or model names. All of this has to happen automatically, privately, securely, without leaking data to advertisers or surveillance companies.
It’s hard work, but it’s definitely the future of AI. I would argue the business case is solved with being able to build bespoke stacks of kit and run models through neocloud providers with ZDR policies. It’s the consumer angle that’s hard to crack, because everyone wants a repeat of Web 2.0 for ad-dollars instead of a privacy-centric modern tech stack that forces companies into lower revenue streams.
Dr_Birdbrain 10 hours ago | parent
The future of personal assistants is most likely akin to Muse Spark, and yes I expect Meta is training on all of those interactions and using them to target ads.
argee 10 hours ago | parent
I beg to differ.
"People just submitted it. I don't know why. They 'trust me.' Dumb fucks."
- Mark Zuckerbergmiltonlost 10 hours ago | parent
This is insane. He's turning the failure of his AI assistants to do what he wants every single time and to do it in a safe manner into a positive thing. Failure as a positive!
thephyber 9 hours ago | parent
That said, I approach AI with deep skepticism. I try to learn it, including its strengths and weaknesses. But I don't blindly trust it.
Coincidentally, my stock brokerage just yesterday sent an email reminding users that anything their agents do using the user's credentials is the responsibility of the user.
m3kw9 10 hours ago | parent
slopinthebag 10 hours ago | parent
lbrito 10 hours ago | parent
That's basically gstack
anoojb 9 hours ago | parent
Gary is rich. Let's assume now, he spends between $10-20K/month USD on tokens. Whether he gets overwhelming tangible value out of that token spend is immaterial.
What he's getting out of it is a mix of social signaling value and actual perceived productivity. I don't know, but I doubt he has measuring the ROI on the token investment.
Much like someone gets various kinds of value out of a a personal tutor for their child. Or a high powered executive who continues to request budget for a "Chief of Staff" and related personnel in 2026.
The question is whether this is signal, or noise. Will everyone who has the budget aspire to spend money on tokens as a subtle way of projecting value with some tangible benefit? How long of a runway does this have?
Much like a Chief of Staff office, there's more to manage...but you you get some tangible benefit by having people to whom you can [in theory] delegate tasks and trust they will be completed. To some degree none of this matters, value is in the eye of the beholder.
What a time to be alive. Rich people continue to spend money with abandon, just on different things.
Edit: I work at technology company. If I were spending $10-20K/month USD in tokens I would immediately get flagged by Finance and receive a note from my EVPs Chief of Staff/Business Admin. My usage and prompts would get audited and I would be asked to create a report justifying the business impact of the spend.
rcko 9 hours ago | parent
anoojb 8 hours ago | parent
Does it matter that he's spending this much money on tokens? What's the derived signal? Why isn't he spending more?! Spend on intelligence seems to have no limit, and he's rich after all right? What's the limiting rate of return on token spend for the rich? Does Gary represent an archetype of other rich people who also want to spend money on tokens at that rate? ...if not more?!
bix6 9 hours ago | parent
siva7 9 hours ago | parent
trog 6 hours ago | parent
It's pretty obvious $200k/yr in tokens is a ludicrously huge spend. Trying to pretend it's not to show how leet you are is weird. But the interesting topic buried here is what value he's creating with such a spend and how it benchmarks against alternatives.
Because that is the value prop of AI. If it doesn't stand up against options when measured clinically and objectively then what's the point of it
opengrass 9 hours ago | parent
jgalt212 1 hour ago | parent
git clone https://github.com/garrytan/gstack
cd gstack/
git ls-files | xargs wc -l_-_-__-_-_- 50 minutes ago | parent
ygjb 30 minutes ago | parent
Evaluate the original post and response and build a high level learning plan with citations and references that covers each of the topics in the original post. Start the learning plan with an overview of effective prompting techniques with specific examples to research individual topics.