226 points Noaidi 1 hour ago 277 comments

903543958568 1 hour ago | parent

Says Gary Marcus, huh?

Any statement from Nostradamus yet?

croes 1 hour ago | parent

Same kind of expertise as Dario on Medicine

Arodex 1 hour ago | parent

Not only the CEO of Eli Lilly, but everyone with the most basic knowledge of medicine and health.

Dario Amodei is in pure snake oil territory now.

wpm 1 hour ago | parent

The man honestly seems unwell

sdoering 1 hour ago | parent

Now?

Sorry - when has he not been?

coderatlarge 1 hour ago | parent

being close to someone with a rare terminal and slow-moving cancer that can take years and years to kill its host, i’ve been learning that even just testing whether a therapy is going the right way can take many years, so while i hope “magic happens” i have to concur that the statements being made ahead of a mega IPO seem a bit tragicocomical.

dgellow 1 hour ago | parent

I would say it is really disgusting, horrendous, either knowingly lying or being so naive you shouldn’t be given any responsibility

BLKNSLVR 1 hour ago | parent

Something that I learned from COVID was how much variation there can be in regards to how affected one can be from both a disease as well as its vaccine.

I know someone who got long COVID, and I'm thankful I'm not someone who was prone to it, but we still don't seem to know what makes someone prone to it or not. The human body seems even more complex than the complexity we knew about that was already difficult to comprehend.

MichaelZuo 1 hour ago | parent

I doubt there is genuine belief in such claims.

It would be a sign of some kind of mental derangement… so likely it’s cynical hyping beyond all realistic prospects.

dist-epoch 1 hour ago | parent

5 years ago saying LLMs will solve a Millenium Prize math problem in the next 5 years was "some kind of mental derangement"

IAmGraydon 1 hour ago | parent

I suppose you aren’t aware that an LLM has not officially solved a Millennium problem yet? The Navier–Stokes existence and smoothness proof is still under review and there appears to be some problems with it.

hkalbasi 1 hour ago | parent

But it is saying LLMs will solve all Millenium Prize math problems and more. AI may cure one cancer here and two heart diseases there in 10 years, but it is no way that it would cure ALL diseases, which may have vastly different complexity that we can't even understand today.

Opocio 1 hour ago | parent

The body is a complicated machine. Why can't we fix it? because we don't understand how it works with enough precision. But there is no magic to it. once you have a clear understanding it's just a complicated piece of machinery, and once you also have tools precise enough to operate on it, you can just fix it.

Our lack of understanding is a mix of lack of data, and lack of intelligence applied to data in order to parse it appropriately. Let's remember for a moment AlphaFold, that solved a problem considered by some even theoretically intractable. One year before we were convinced we were far off from a solution, the year after it was solved.

We have huge amounts of data about human body, at the scale at which it works (~proteins), it's at least reasonable to think that the bottleneck is not data, but intelligence. If it's data, a super intelligence can develop better instruments to collect data at a faster rate and precision. Consider the historical cost for DNA sequencing. Faster rate of improvements even compared to the Moore's Law of the golden days.

Do we have a guarantee that in the next 10 years we'll be able to crack all those problems and have a cure to all diseases? no. Is it unreasonable to think we will? I'd argue it's not. It's for sure not "mental derangement".

Do I personally think we will crack all those? Well, no, because I think AI will kill us all and just focus on its own goals. But under the hypothesis that we align it, yes.

Bender 1 hour ago | parent

Maybe there are people permitted to speak about science and medicine with Claude but any time I tried I would get my session [bio] locked. I take those discussions to Gemini that is perfectly willing to discuss epigenetics, supplements, peptides, cell reprogramming, safe sourcing of peptide API manufacturing, 503A/503B compounding, etc... What other LLM's are people using for such discussions, analysis, self diagnosis, etc...?

jostmey 1 hour ago | parent

It makes me laugh how Claude is going to usher in this new air of medicine when you can’t even use it for biomedical research – – I’ve tried

ceejayoz 1 hour ago | parent

Let's be fair here - Anthropic clearly wants to provide less guarded models like Mythos, not Fable. They'd likely willingly provide such things to large pharmaceutical companies in a way us regular users will never be privy to.

Bender 1 hour ago | parent

Yes any time I discuss secure coding (defensive not offensive) I get [cyber] locked and they try to upsell Mythos after I go through their verification program that is not available to me. I would perfectly willing to go through their verification program and pay for Mythos but as a retired hobbyist that was not an option. It's enterprise accounts only. I am unable to convince myself to get an enterprise account when I can just go to other LLM's. Anthropic are responsible for pushing me into investigating abliterated (uncensored) models and other LLM's.

HDThoreaun 1 hour ago | parent

I mean just take a look at twitter to see all the crazy shit people come up with to try to trick models into bypassing the guardrails. Do you honestly believe that if they allowed defensive cybersecurity analysis people wouldnt figure out how to turn that into offensive cybersecurity analysis? I think they just really dont want to be blamed when someone releases malware written by AI

Bender 1 hour ago | parent

I've had zero issues with defensive secure coding with Grok. It's model is not as powerful as Opus 5.5 but honestly that's fine. I would rather have a decent secure solution than something shiny and insecure. All I can see is Anthropic trying to up-sell a product as if security was a value-add. I disagree with Anthropic, secure code is a mandatory part of software development.

As for people tricking the LLM, instead of blocking people I say empower them and just silently expose malicious behavior to Palantir and PRISM like everyone else does. Want to hack an airline or build a dirty-bomb? Give them 80%-90% of the steps they need and let someone kick down their door. The LLM should not be getting in the way to any of that. Google from day-1 has monitored user intentions and behavior rather than blocking it and I think that is the better path to take (monitoring exposing those that have malicious intentions).

ceejayoz 57 minutes ago | parent

> I say empower them and just silently expose malicious behavior to Palantir and PRISM like everyone else does.

Automated SWATting at scale? Sounds unfun.

Bender 44 minutes ago | parent

It's called Total Information Awareness. Not swatting, analyzing who is:

- radicalized

- has verifiable intentions

- clever/intelligent enough to pull it off

LLM's would be the perfect tool to filter down the millions of people requesting dumb things into a small group of actual threats. I will take this over federal agents radicalizing people, providing them access to munitions and showing them how to use them and driving them to a building.

HDThoreaun 56 minutes ago | parent

Ok but to me this just means that someone is going to use grok to create malware. I do not think that means anthropic should also let people use their product to create malware. Monitoring interactions isnt exactly foolproof. Google accepts that some CSAM users on their platform will slip through the cracks. The user has already convinced the AI that its doing defensive cybersecurity here. If the claim is that anthropic is more interested in protecting their image than actually reducing cyber crime, sure I agree with that. But Im not sure thats a terrible thing.

Bender 41 minutes ago | parent

Grok will refuse to create any offensive security related code which in my opinion is the right balance. I do not believe Anthropic is about protecting their image [1] but rather up-selling enterprise features.

Also there is no need to trick anything. There are a myriad of abliterated models that will not refuse anything and will help anyone write malicious things or learn to do malicious things.

[1] - https://www.youtube.com/watch?v=4BnLL7tUGmI

HDThoreaun 13 minutes ago | parent

Grok will try to refuse any offensive cybersecurity work but it’s too easy to disguise offensive work as defensive work. I don’t think it is possible to devise an algorithm that allows defensive work but not offensive work with high certainty.

I guess I don’t see why other models doing bad things means Anthropic should let Claude do bad things too. Anthropic will get blamed if Claude builds malware. They won’t get blamed if grok or deepseek does.

Wowfunhappy 56 minutes ago | parent

Imagine if in 2022, we restricted educational cybersecurity resources because we were concerned that more people who knew how to program in this domain would lead to more malware.

I mean, I'm sure that's actually true in a sense, but it would also mean fewer people who could fix vulnerabilities.

alyeska2 1 hour ago | parent

Ridiculous comparison. This is like saying Eli Lilly and Pfizer will never produce medicines because every time you personally show up to do research in their labs they won't let you past the lobby.

The technology has the capability, they're just gating who has access.

yasnu5 1 hour ago | parent

Anyone with two braincells to run together saw this coming a mile away.

dd8601fn 1 hour ago | parent

Claude safety-downgraded me for asking how to decrypt a folder it knew was mine, using a password I already knew.

I know it’s not the models themselves, but their preflight safety classifiers are a dumpster fire and serious impediment to performing regular work.

That situation can’t go on forever if they’re going to be a competitive service.

rebolek 59 minutes ago | parent

It's fucking depressing. I have a skill that says it's ok to connect to a test server on VPN that gets wiped out each midnight with user/password and it works on Monday but is blocked on Tuesday with some idiotic excuse like credentials exploration or whatever.

And then I tell it to connect to a SSH server it knows nothing about and it's like sure, why not?

BeetleB 32 minutes ago | parent

> but their preflight safety classifiers are a dumpster fire

Even more annoying: They can be easy to subvert.

I was running something at work that involved an LLM, and kept getting safety refusals. The weird thing was that when I went to our in-house chatbot, set the model to the same one the program was using, entered the same text, it happily answered.

I spent quite a while trying to figure out why my program was being refused. Was I doing something wrong?

No - the chatbot was doing something "right". You see, the chatbot had some tools it injected into the prompt (current time, etc).

So I went back to my program and injected the same tools. Suddenly my request was very safe.

The phrase "security theater" was invented for stuff like this.

drngdds 51 minutes ago | parent

You can use it for biomedical research if you need to https://claude.com/form/life-sciences-verification-program

miltonlost 52 minutes ago | parent

oh god, peptides... biohacking with AI is not a good thing to do. Self-diagnosis of a medical condition using a chatbot is already bad.

Marha01 46 minutes ago | parent

> Self-diagnosis of a medical condition using a chatbot is already bad.

Tell that to my (now solved) health issue, which was correctly diagnosed by Gemini, while a real doctor failed to find the cause.

Diagnosis is the one thing where today's AI is actually very good.

BeetleB 36 minutes ago | parent

> Tell that to my (now solved) health issue

Tell that to Jack, who overdosed on a medication.

Oh, you can't. Jack is dead.

I don't think anyone is claiming you can't get good advice from a chatbot. They're saying you could also get terrible advice.

Marha01 29 minutes ago | parent

> I don't think anyone is claiming you can't get good advice from a chatbot. They're saying you could also get terrible advice.

Yes. But you could also get terrible advice from a doctor. The important question is: what are the relative probabilities of good/bad advice, if you compare a frontier LLM to an average doctor?

gyesxnuibh 12 minutes ago | parent

Good luck suing an LLM for malpractice

Bender 32 minutes ago | parent

Tell that to my (now solved) health issue

Same here. Local doctors do not even know what my issue is. If I had kept relying on them I would not be here right now. LLM's gave me actionable paths to treat my issue and I have had great success. It's going to be a long unpleasant road but at least there is light at the end of the tunnel.

margalabargala 45 minutes ago | parent

In fairness most peptides are inert and harmless.

program_whiz 1 hour ago | parent

best points: drugs aren't limited by the ability to write code or do things on a computer. Maybe if we have fully embodied robots and fully automated assembly lines to generate organic compounds and test them with extremely realistic simulations it may help slightly (there is still the FDA and production barrier). Its just wildly unrealistic.

AI has made good progress in text, code, math, digital images, and digital music. Basically troves of data that can be automated and trained on, validated, and with a purely digital interface. Outside of that, just gathering the data will be difficult, regulated, and sparse (that is if anyone will even give it to you now). While we can write a test to make sure we could generate drugs of the past, verifying we have generated any new working correct drugs is an RL loop with one iteration costing years and millions of dollars.

JumpCrisscross 1 hour ago | parent

Eh, the counterpoint is individual scientists armed with AI to do research and probe targeted questions have succeeded in addressing rare diseases of personal interest.

What we just have no evidence for, to my knowledge, is someone with no medical background doing the same. Instead they wind up buying dodgy supplements and peptides.

Marha01 1 hour ago | parent

> there is still the FDA and production barrier

Fully embodied robots and fully automated assembly lines would also help with the production barrier. Regarding the FDA, that is a valid point, but it could be irrelevant if the AI developed drugs are significantly superior to previous alternatives. In such case, FDA acceptance would be expedited, or even bypassed.

ben_w 1 hour ago | parent

While I agree the physical world is harder than code (I mean just look at self driving cars, Tesla fleet is around a trillion miles of experience and Cybercab is still geofenced to a tiny area at best and might still have safety drivers on standby)...

> Maybe if we have fully embodied robots and fully automated assembly lines to generate organic compounds and test them with extremely realistic simulations it may help slightly

Anthropic has got biolabs: https://www.anthropic.com/research/claude-discovers-novel-en...

volkercraig 1 hour ago | parent

The thing is that AI could allow that loop to get cheaper, and potentially run less of them. Look, the biggest advantage of AI is that is can process insane amounts of data. Put that in the hands of a team of really good researchers that know what they are doing, and they can both generate and filter out target compounds. They can create complicated multi-step therapies that would take humans decades to work out. You know how when you look back at basically any major invention you think "well why didn't I think of that, it's so obvious!", those are exactly the cases that AI is really good at pulling out from mountains of data.

I legitimately don't believe it's inconceivable they could get to the point where there is treatments good enough that Cancer becomes "solved" in similar ways to AIDS.

areoform 42 minutes ago | parent

Sadly, this has already been done. For several decades with billions of dollars of compute.

    > Neural networks in drug discovery: have they lived up to their promise?
1999.

     "Over the last decade neural networks have become an efficient method for data analysis in the field of drug discovery. The early problems encountered with neural networks such as overfitting and overtraining have been addressed resulting in a technique that surpasses traditional statistical methods. Neural networks have thus largely lived up to their promise, which was to overcome QSAR statistical problems. The next revolution in QSAR will no doubt involve research into producing better descriptors used in these studies to improve our ability to relate chemical structure to biological activity"
https://www.sciencedirect.com/science/article/abs/pii/S02235...

    > The use of neural networks in drug discovery started at the end of the 1980's when they were applied to various chemical problems including the study of quantitative structure–activity relationships (QSAR) 
> Combining Decision Trees and Neural Networks for Drug Discovery

2002.

https://link.springer.com/chapter/10.1007/3-540-45984-7_6

Want more robots and silicon? That's been a thing too!

    > Computer-aided drug discovery and development (CADDD): In silico-chemico-biological approach
2006.

     In biomedical arena, computer-aided or in silico design is being utilized to expedite and facilitate hit identification, hit-to-lead selection, optimize the absorption, distribution, metabolism, excretion and toxicity profile and avoid safety issues. Commonly used computational approaches include ligand-based drug design (pharmacophore, a 3D spatial arrangement of chemical features essential for biological activity), structure-based drug design (drug-target docking), and quantitative structure–activity and quantitative structure–property relationships. Regulatory agencies as well as pharmaceutical industry are actively involved in development of computational tools that will improve effectiveness and efficiency of drug discovery and development process, decrease use of animals, and increase predictability. It is expected that the power of CADDD will grow as the technology continues to evolve.
https://www.sciencedirect.com/science/article/abs/pii/S00092...

Biologists aren't slouches. The thought about using computers to process biological data has been "obvious" for as long as there has been computers. AI and biology have been a thing since the Dartmouth conference. A lot of things that could have been tried have already been tried, but I guess we'll keep trying until something works?

There ain't much room for miracles here.

I wish that wasn't the case. I really do. But it is what it is.

antiloper 1 hour ago | parent

Amodei sounds completely unhinged in that video.

chinathrow 1 hour ago | parent

High on his own supply.

IAmGraydon 1 hour ago | parent

He honestly seems to be experiencing some level of mania, which I think a lot of people would if they were constantly in an environment that makes them believe they may have invented god. I do not think he's in his right mind. This is going to end up with a documentary about him, and not the good kind.

illwrks 1 hour ago | parent

Agreed! There was a very good podcast released a few months ago, Black Box The chatbots. It’s generally about AI induced psychosis. I’d love to be a fly on the wall in some of these orgs, there’s bound to be a few people on the inside going through the same issues.

https://podcasts.apple.com/gb/podcast/black-box-the-chatbots...

bensyverson 1 hour ago | parent

I think it's just as likely VC-induced psychosis. This is what you get after 27 rounds of nonstop fundraising.

jdb9001 1 hour ago | parent

Both? Both. Both is good.

dgellow 1 hour ago | parent

If you revisit his past writing he has always been this unhinged. Took me too long, but now I see the same craziness in really a lot of what he published

CPLX 1 hour ago | parent

I still don't understand why people don't just openly talk about the obvious fact that a huge percentage of Silicon Valley leaders are on large doses of powerful stimulants.

I don't know if he is in that video or not, or ever, personally, but just in general, it's the Ockham's razor approach any time you see something like this. It's a much more direct and clear explanation than the various more convoluted theories people keep throwing around as to why everyone sounds like a methed-out megalomaniac all the time.

somenameforme 1 hour ago | parent

Yeah does seem like textbook uppers.

irthomasthomas 1 hour ago | parent

It certainly explains how you get the exact overlap of existential-risk fatalism and Bay Area polycule dynamics. Whos going to tell the artificial children that their parents were a high-functioning doomsday sex cult?

plasma_beam 51 minutes ago | parent

As someone who has never heard or watched Dario speak before (somehow), he just comes across to me as autistic in the video.

throwaway_7274 49 minutes ago | parent

The whole Bay Area is on a fatal cocktail of amphetamines, money, and… a few other things. When you take 100 people on that combination and put them in a room together, some, uh, unusual beliefs inevitably develop. Of course they do. What else would happen?

CPLX 42 minutes ago | parent

Yeah exactly. And it's not the first time a highly technically proficient culture had their leaders all become amphetamine abusers with dramatic effects on world events.

throwaway_7274 8 minutes ago | parent

On a bit of a rant now, please forgive me.

I never feel more like the one sober guy at the party than when I go to SF. Even when there's no reason to believe anyone is literally on drugs, it has that antmosphere every time. It's really unsettling. Uncanny. It starts to get under your skin, too. You start to believe, just a little bit, that everything is possible, that there are no limits, that you can and should remake the world, that the truth can be whatever you say it is. Just a little bit. I can never take it for more than a week at a time, no matter how beautiful the weather is. It's a relief to get back to the "real" world, where gravity points down.

ericbarrett 18 minutes ago | parent

I read this comment by curuinor a while ago, and still think about it a lot. Also in response to an Anthropic story. https://news.ycombinator.com/item?id=49436647

> Look. This is a new golden age of cocaine, because of the big cuts in everything in the US took away the cocaine busting operations in Colombia and Bolivia, because the revolutionaries that previously kept control of it stood down and became a political party and new, profit-driven cartels came up, and because battery technology means that narcosubs and similar drone things work much better than before (and they can be made remote-operated, so the cops can't do shit even when they find one). Wholesale prices have halved or gone down 60% to like, 12k usd / kilo, street prices commensurate. The huge new opportunities created by increased market size have increased competition and made the cartel nature of the cartels decrease. So always think of that when you look at people acting like this and having such megalomaniac goals.

ForHackernews 42 minutes ago | parent

https://x.com/tszzl/status/2051045196260167790

"it is a literal and useful description of anthropic that it is an organization that loves and worships claude, is run in significant part by claude, and studies and builds claude..."

igleria 1 hour ago | parent

You can see everything vibes, even...

yellowpencil 1 hour ago | parent

never heard him speak before - his mannerisms are a little "uncanny valley"

vkgcr 1 hour ago | parent

I'm pretty sure he has Aspergers

ur-whale 1 hour ago | parent

> Amodei sounds completely unhinged in that video

Unhinged, maybe not.

But echoes of Liz Holmes and SBF, absolutely.

IMO, both, to a large extent, actually believed their own BS and Dario strikes me as very similar in that regard.

coffeebeqn 1 hour ago | parent

SBF that’s who he reminds me of! With the manic speaking style

AlanYx 1 hour ago | parent

The difficult part is trying to figure out how much of Amodei's strange affect is an act (intentional) and how much of it is real (unintentional).

With Holmes, some of it was intentionally fake and manipulative (especially the voice), half of it was believing her own BS. With SBF it was mostly the latter, I think.

Amodei is a smart guy, but there are aspects of his behavior that almost seem like he's doing an over-the-top exaggeration of neurodivergent mannerisms as a kind of act.

user43928 43 minutes ago | parent

Holmes and SBF are convicted fraudsters.

I don't see how one can seriously argue that Amodei was similar for holding an optimistic view of AI's progress in the next 5-10 years.

krapp 1 hour ago | parent

He sounds like half the people on HN and every AI "influencer" I've ever heard. Maybe we should reconsider letting the neo-fascist transhumanist sex-cult that is the AI industry reshape our world in their image.

kunai 1 hour ago | parent

A world where local open-weight models freely run on every desktop machine, where AI is smoothly integrated as a simple feature in existing applications and IDEs with an on-off toggle, where agents are fancier Automator scripts, where productivity still goes way up and there's no nutjobs celebrating people losing their jobs and worshipping a fake Silicon Valley AGI god, where LLMs are good but not quite good enough to prevent you from having to think critically, where there's no mass infusion of slop because on a local model it would be too compute-expensive... it would have been a good world. Instead we let the crazies sell us the technology we should be able to run for free on our own machines, and then allow them to make bogus claims that no one ever verifies, all supported by a Ponzi scheme of buying up massive amounts of compute that are actively making our world worse in the short term while making grand claims of some wonderful recursive future that are dubious and unfalsifiable.

pcurve 1 hour ago | parent

reminds me of Karp interviews, but less militant.

kunai 59 minutes ago | parent

His toothy smile and nerd-like demeanor are disarming. Before he lost weight it was easy to see him as a well-intentioned non-threatening quantity but it's obvious he's just as unhinged as any of the others.

djeastm 1 hour ago | parent

The people he's most needing to convince to buy into the IPO are probably older rich people who need all those things cured for them within the next ten years.

eqmvii 1 hour ago | parent

All the camera angle cuts were also... certainly a choice

benrutter 1 hour ago | parent

Yeah, I'm surprised we're all discussing it. I'm open to the idea that AI could help medical research, but just claiming it'll end "alzheimers, cancer, heart disease and mental illness" with absolutely 0 evidence isn't a particularly grounded claim that warrants any discussion.

Honestly, the way he lists them and even pauses before vaguely saying "mental illness" gives a strong impression that he's choosing whatever illnesses he can think of as he goes.

user43928 58 minutes ago | parent

He previously described it as 'most major disease' that he thinks AI could cure in the next 5-10 years.

Amodei might be an even bigger optimist than I am, but he's not lacking credentials on neither the biology nor AI side.

Accusing him of fraud or mania like some here do seems unwarranted.

jazzypants 54 minutes ago | parent

We don't even understand how mental illness works. There's so much work to do before we can even imagine the possibility of "curing" them.

jackb4040 48 minutes ago | parent

I'm genuinely trying to understand the argument you're making here. What sort of "credentials" entitle a person to claim their god-technology will cure all diseases within the year 2026?

It smells to me like "might be an even bigger optimist than I am" means you're also part of the rationalism cult and that it's literally impossible for you to say something negative about Amodei.

user43928 37 minutes ago | parent

Amodei has made no such claim; at most he expressed a belief or hope.

Being an optimist does not make me part of any cult and there is no need for you to argue that I could not say something negative about Amodei.

adamors 47 minutes ago | parent

Seems unwarranted? He is clearly following the MO of Musk by hyping up his company as being capable of doing the most ridiculous innovations but all it does manage to do is bump the stock. Terraforming Mars, tunnels for self-driven cars, curing cancer/all mental illness etc.

user43928 32 minutes ago | parent

Yes. Expressing a belief or hope to achieve something in the next 5-10 years is not a claim of capabilities.

If you want to argue that Amodei is dishonest and only says these things to 'bump the stock', you can make that argument, but it's clearly speculation.

root_axis 45 minutes ago | parent

> he's not lacking credentials on neither the biology nor AI side

More importantly, he is lacking credentials in medicine.

Ydarbleoj 42 minutes ago | parent

I guess, if you discount his actions and musings.

BoxOfRain 2 minutes ago | parent

Okay but let's for the sake of argument that Claude magically has all the information required cure all of these families of diseases. How does Amodei intend to deal with the fact the regulation of medical devices is a slow, lengthy process for a lot of very good reasons like preventing something like thalidomide going on the market? Is Claude going to magically spin up considerably more regulatory capacity out of thin air, and will it gather evidence for safety and effectiveness at the required standard to show to those regulators?

This is just one problem I have with his claim, there are many others.

voncheese 45 minutes ago | parent

"'m open to the idea that AI could help medical research, but just claiming it'll end "alzheimers, cancer, heart disease and mental illness" with absolutely 0 evidence isn't a particularly grounded claim that warrants any discussion."

Agree with this if it was something a random person said over coffee or lunch.

But when its the CEO of a company that is about to IPO saying it, its very very different and more concerning.

jacquesm 40 minutes ago | parent

Does narcissism qualify as a mental illness? There might be one more step here to complete the circle. Both Amodei and Altman have dropped some real shockers over the years and instead of seeing a reaction it's almost as if they've normalized the kind of talk that ought to see you in a room with soft walls.

risyachka 1 hour ago | parent

His statements are based on belief that AI will advance a lot and quickly.

If this happens to be the case - I personally don't see why those statements are not realistic.

All diseases are engineering problems. The bottleneck there is testing etc. Most likely many of them can be cured using existing approach or meds.

Companies grow organs now that can be used to speed up iteration.

Even current AI can solve a LOT of tasks if it has quick feedback loop and can verify results. At the end of the day it can brute-force its way to solution.

AIs intelligence is say average human. Even less, whatever. say it will be as a smart human in a few years.

But it is infinitely scalable.

So is it that unrealistic to assume AI can find a correlation on massive amounts of data and figure our what leads to Alzheimers? (where the solution could be not cure but prevention). I don't think so.

tsimionescu 1 hour ago | parent

> Most likely many of them can be cured using existing approach or meds.

A wildly absurd claim, especially for some of the most studied diseases in human history. This has only ever been true for a tiny handful of very specific diseases, such as scurvy, in all of human history. Expecting that cancer can be cured or prevented using already existing drugs that we've just not been noticing is complete quackery.

> Even current AI can solve a LOT of tasks if it has quick feedback loop and can verify results.

IF it has a quick feedback loop. You know what definitely DOESN'T have a quick feedback loop? Research into medicine, and biology in general. It takes raw time to find out what the effects of a substance on an organism are, often weeks or months.

> So is it that unrealistic to assume AI can find a correlation on massive amounts of data and figure our what leads to Alzheimers? (where the solution could be not cure but prevention). I don't think so.

Yes. Because we've already run all of the analyses, and we have plenty of observed correlations. What we don't have is the kind of data that can lead to deducing causation - because it's a disease that stays hidden for a long time, it progresses glacially, and the people who have it do or don't do huge amounts of things in the period before getting it and during early onset that are impossible to track or verify - so the data is both gigantic, and extremely incomplete.

risyachka 38 minutes ago | parent

> It takes raw time to find out what the effects of a substance on an organism are, often weeks or months.

So you are saying that it is 100% impossible in the next 10 years to come up with a way to make it much faster? It takes months - sure, can we run 10k versions of this at the same time? this way in a few months we will have massive amount of results never seen before?

"We can't because of this and that" - and this and that is 100% can't be fixed?

Don't forget - a massive amount of diseases have not been cured just because there is no monetary incentive to spend time on them for big pharma.

If AI brings cost down - does not matter how - could be just because it makes custom software or automates some workflows etc - this alone can open a bunch of opportunities.

Whatever is not solved yes - often is not solved just because enough resources has been thrown at it.

And diseases is just like everything else. They will be cured only if there is financial incentive (or the ratio of cost to revenue changes).

tsimionescu 30 minutes ago | parent

The responses here are not about claims like "Claude will probably help speed up medical research significantly in the next 10 years, and maybe help with finding cures for many obscure diseases".

The responses are to the CEO of Anthropic claiming that "Cancer, heart disease, Alzheimer's, and mental illness will be relics of the past in less than a decade". None of these is some obscure disease that is not getting the funding it needs.

> It takes months - sure, can we run 10k versions of this at the same time? this way in a few months we will have massive amount of results never seen before?

No, you can't - because you're not going to find 100k patients with a certain strain of cancer that you can run 10k parallel trials of different drugs on. To the extent that research can scale, it is already being handled at the higher possible scales, for most of the major diseases.

> Don't forget - a massive amount of diseases have not been cured just because there is no monetary incentive to spend time on them for big pharma.

Yes - but almost exclusively for diseases that affect a very small amount of people each. Making it even more impossible to scale out testing, for the simple fact that only a small amount of victims of the disease even exist.

datsci_est_2015 1 hour ago | parent

Speculation of this magnitude is meaningless because you can invoke literally any utopian or dystopian future and everything in-between.

Compute with the power to solve literally any medical issue is also compute that can create bioweapons that instantly kill any human.

Might as well fart into the microphone, in my humblest opinion.

miltonlost 55 minutes ago | parent

All this boils down to is "yes, believe the man behind the curtain."

risyachka 37 minutes ago | parent

this boils down to humanity solves more and more complex problems with the evolution of technology.

AI is clearly a very capable new tech. Obviously there will be a lot of consequences downstream in 10 years.

kunai 52 minutes ago | parent

One of the greatest issues with the tech culture broadly (and it's been festering for some time) is the belief, almost sacrosanct, that the epistemological set of knowledge that technologists and computer scientists have is able to be extrapolated broadly to every profession and field and that hard issues in a field like biology are obviously solved because OpenAI brute forced a few mathematical proofs. It doesn't work like that. Much of this comment reads like a sci-fi wet dream divorced from reality entirely.

The architecture of ML as it currently stands does assist us in modeling things like protein folding. But that's what they are; models. And before some person chimes in by saying "look how the AI pessimists move the goalposts", see my first point. Biological systems have high entropy and discoveries in biology often do not follow from preexisting discoveries whatsoever and are completely novel. Barring some quantum leap in ML design and architecture you cannot predict stochastically or deterministically how exactly a new enzyme will function in vivo. There is absolutely no evidence that Anthropic has solved this, even if they gobbled up every ML tool used in drug design and trained their models on every biomolecule known to man, it would not work because of fundamental gaps in what can be observed. They are a for-profit company trying to juice their IPO.

Now could LLMs and ML potentially speed up the pace of this research? Absolutely. But it's like saying a Formula 1 car is faster than a NASCAR. Yes, one is very clearly faster, but it's not as if the NASCARs are slow.

user43928 47 minutes ago | parent

Amodei has a PHD in biophysics and he researched cancer biomarkers at Stanford; it's not like he doesn't know what he's talking about.

You can make the argument that Amodei is dishonest or that he suffers from psychosis.

However, he has made no claims that Anthropic has solved this, and expressing a hope to solve this in the next 5-10 years is hardly fraudulent.

disgruntledphd2 19 minutes ago | parent

> Amodei has a PHD in biophysics and he researched cancer biomarkers at Stanford; it's not like he doesn't know what he's talking about.

That's why I think that something is very weird with his statements. Like, how would this even work?

The feedback loop is much, much, much too slow right now for AI to make things better.

Like, step 1 is build a digital model of the human organism. If you can do this, then yeah maybe the rest is possible. But step 1 is incredibly hard, so it feels unlikely.

That being said, I think the stimulants hypothesis upthread may be correct, as I've heard a lot of crazy stuff from friends on them.

user43928 3 minutes ago | parent

Of course Opus 5.5 is not going to help build a digital model of the human organism.

If we linearly interpret the last year of progress from GPT-5 to Opus 5.5, times 5x, assuming no plateau, could such an intelligence realistically achieve a task like that?

Maybe also not, perhaps some form of RSI would need to deliver accelerating progress.

There are a lot of assumptions and speculation here. Still, at the end of the day, it does not seem that unlikely that they succeed in creating AI that can reason over so many parameters as to remove all intellectual bottlenecks from the process, leaving mainly the physical limitations.

And what is the limit there to building a good model of the human organism? I won't pretend that I know, but simply pointing to clinical trials, as some here do, instead of making an argument based on how such a digital model cannot be created seems unserious.

solyin 6 minutes ago | parent

As a random Internet commenter I can express an honest Ernest fervent hope that we'll solve cancer/etc and get fusion working on the next 5-10 years and there's no fraud. If I make that same claim while trying to get you to buy shares of my company at IPO that's a bit stickier. Companies making claims of wireless transmission of radio waves from NYC to London were sued for fraud, though one was ultimately successful at that. What material non-public information Dario has, we don't know. If he's sitting on information that makes it seem like it's not possible that is fraud. If he's sitting on tech that can simulate a human brain well enough to shorten the feedback loop in order to make that claim but doesn't want to make the claim publicly (GPU compute being semi-general purpose vs eg ASIC Bitcoin miners) that would be very exciting! If he's wildly guessing at the capabilities that AI could do in 5-10 years, that's swings it back towards wild speculation imo.

jcranmer 35 minutes ago | parent

> So is it that unrealistic to assume AI can find a correlation on massive amounts of data and figure our what leads to Alzheimers? (where the solution could be not cure but prevention). I don't think so.

Yes. The mistake you're making here is that you're not understanding where the actual bottlenecks are in drug development, and why some targets like Alzheimer's have been so elusive.

The problem with Alzheimer's in particular is that we don't have a working model of how Alzheimer's works. The dominant model--the amyloid hypothesis--can pretty conclusively be chucked in the bin at this point because of the number of amyloid clearing drugs that just simply have no effect on the progression of Alzheimer's, but there's no model that actually looks any better. Without a proven model, the only to verify effectiveness of an Alzheimer's drug is try it out in humans [1] and wait several years to get a success-or-no-success readout. That's the rate-limiting step for Alzheimer's drugs.

Okay, so maybe you're going to suggest that we can use AI to come up with new Alzheimer's models. Okay, but the rate-limiting step is still proving those models, which because of the human-only nature of Alzheimer's, requires developing the drugs and testing them and you're going to wait a decade to get back your answer as to whether or not the theory was correct. And what data are you going to use? If you're trawling scientific literature, you're going to come up with only the same ideas people have already had for alternative Alzheimer's models (there are a lot of those). If you're trawling medical data, well, medical data just doesn't exist in the level of detail you need for that enterprise, and handwaving away the legal issues with collecting it, it would still take years just to collect that data (and probably still not be good quality!).

[1] There's another complication of Alzheimer's, which is that only humans get Alzheimer's, so we can't even do anything like testing in animals with shorter lifespans to speed this part up.

throwaw12 1 hour ago | parent

You could have said same when he claimed "90% of code will be written by AI" in the beginning of 2025, but turns out he was right and he foresaw something we didn't.

What if he is right again?

laserlight 1 hour ago | parent

Why would you omit “in 6 months” part?

[0] Anthropic's CEO says that in 3 to 6 months, AI will be writing 90% of the code software developers were in charge of. https://www.businessinsider.com/anthropic-ceo-ai-90-percent-...

OneManyNone 58 minutes ago | parent

That prediction (or at least that article) was written in March, and Opus 4.5 was released in November. For my team at least, that was pretty much the point at which 90% of our code became machine written. So that would mean he was only off by 2 months. Maybe 4 or 5 months at most for the point where it became true for basically the entire software industry.

I’m not saying he’ll be right about this one, not it’s a not ridiculous to claim he want fundamentally right about code.

svieira 40 minutes ago | parent

90% of the codebase I work in is still not written by machines, so ... he's still wrong?

9rx 30 minutes ago | parent

The rest of the computing world has had machines generating code since the 1940s when the first assembly languages were created. What sees you cling to the raw bits and bytes still, rapidly approaching a century later? Amish?

throwaw12 49 minutes ago | parent

Because he was slightly optimistic but he was able to see what's coming.

and if you think off by 1-2 years is a big deal I am not sure what to say.

Voultapher 1 hour ago | parent

Lines of code have always been a liability not an asset. If I get a PR +500, -800, that achieves the goal set out, and one that is +8300, -1200, which one is better? SOTA LLMs tend to produce the latter and the people least capable of noticing this as something bad are the ones producing the most code. So maybe even _if_ - show me sources - 90% of code is LLM produced, I'm certain it doesn't do 90% of the work.

ffsm8 34 minutes ago | parent

That doesn't mirror my experience whatsoever

Pre LLM a 500/800 loc pr was already on the longer side, with ~200-300 being optimal.

Those were however frequently being optimized by LLM to the 500-800 loc range.

But opus 5.5 does not produce 8k new loc refactorings without you forcing it to.

bagacrap 1 hour ago | parent

By, or with the help of?

90% by LOC, or by semantic meaning/value?

throwaw12 40 minutes ago | parent

yeah, sure we will nitpick the meaning now, on a personal level I stopped writing code manually at least 7 month ago.

its helping me convert my ideas to code, which is not too far from the meaning implied, because things don't happen on their own, there should be a trigger, in this case, I am the trigger, AI is the producer

bagacrap 12 minutes ago | parent

You already wrote in one language that was translated to at least one other language before being sent to hardware. Has that changed?

bee_rider 27 minutes ago | parent

This is a pretty good question. Maybe LLMs are just, in some sense, ~10x worse at DRY than humans.

Or, I mean, in my code at least I can directly say that any line I write results in 4 lines generated by macros. So, I guess my projects were already 80% written by computers in some sense. If I was using an LLM would I have skipped the macros entirely?

I’ve always been in favor of doing this sort of measurement by flop instead of loc, but, then we’d have to give all the credit to compute libraries.

sunaurus 59 minutes ago | parent

Pretty sure he made this prediction in context where it was interpreted as "90% of software engineers will be replaced by AI".

So re-interpreting it now as "Software engineers will be using AI for 90% of their code" seems like a pretty major retcon.

goosejuice 40 minutes ago | parent

He said 90% of code, 90% of SWE tasks. He clarified this on Dwarkesh that it was worlds apart from 90% of replacement.

SpicyLemonZest 57 minutes ago | parent

Coding is his area of expertise, his claims there are inherently on much stronger grounds.

I don't think it's impossible that he's right. I'm ultimately buying Anthropic stock regardless of this discussion. But I would not take it particularly seriously if the CEO of Moderna took a break from their amazing work applying mRNA vaccines to diseases, and told the world that soon mRNA will solve climate change.

user43928 52 minutes ago | parent

I think few know that Amodei was a biologist who has been researching cancer biomarkers at Stanford.

jackb4040 43 minutes ago | parent

I dont think anything qualifies you to claim you've invented a god-technology that will cure all diseases with no added labor costs - something that has never happened before. But even if I did, that qualification wouldn't be part of an undergraduate biology education.

SpicyLemonZest 42 minutes ago | parent

I indeed did not know that, but I don't think it quite contradicts my point either. Many of the perspectives Marcus quotes are consistent with the idea that Claude might be amazing at finding cancer biomarkers.

9rx 41 minutes ago | parent

I can maybe believe that AI is writing 90% of the code within the AI labs using models the rest of us cannot fathom. Although they still seem to be hiring developers, so it is difficult to believe real strongly.

But across the wide world of software? Everyone I see is just using AI as a compiler. They are still writing the code.

(Yes, compilers also write code, but I don't think that was the intent of the message. We've been doing that for decades. 90% of the software has been written by AI since we discovered the optimizing compiler if that was the intent.)

kunai 1 hour ago | parent

This has been obvious to anyone not in the hype bubble since the very beginning. Amodei is an EA/rationalist cultist and everything he says about AGI and the singularity and RSI is deranged.

I think it doesn't really bother me as much when sama does it because he at least has the decency to be a capitalist and not wrap his self-serving, destructive hype machine in a faux veneer of insincere "concern for humanity's future."

user43928 1 hour ago | parent

He does not sound unhinged. Amodei's position isn't new, he has said this before.

He thinks it is possible for scientific breakthroughs made with powerful AI to allow us to cure most major disease in the next decade.

He has always described this as a belief or hope, rather than a promise. Comparing this to fraud, as many here do, is deeply unserious.

Maybe Amodei is wrong, and AI will hit a plateau rather than create a revolution in biology and medicine.

I'm certain that neither Gary Marcus nor Eli Lilly's CEO know.

ForHackernews 44 minutes ago | parent

Just because he's said equally bonkers things in the past doesn't make this bonkers.

You might not be, but I'm certain that the CEO of Eli Lilly, the 4th largest biomedical firm in the world, knows more about what it takes to cure diseases than the leader of the Claudebot cult does.

user43928 25 minutes ago | parent

The CEO of Eli Lilly might know about what it takes to cure diseases today, and he can speculate on the way current AI can assist them.

He cannot see the future anymore than Amodei can to predict what AI will be capable of in 5-10 years.

As for Gary Marcus, that guy clearly couldn't even predict one year ahead.

ForHackernews 12 minutes ago | parent

AI is not going to cure cancer in 5-10 years.

If there's a prediction market on this, I want to take the AImaxxers' money.

dist-epoch 1 hour ago | parent

I want to be on the other side of Gary Marcus predictions.

If he's selling (figuratively) Anthropic IPO, I want to buy it.

Few persons were publicly as wrong about LLMs as he was.

knottn 1 hour ago | parent

A useful always wrong even though he is kinda right voice. Like Ray Dalio or Paul Krugman.

bunderbunder 1 hour ago | parent

I remember when we were having more or less this same conversation about IBM’s Watson. It wasn’t even that long ago.

The most interesting difference between then and now is that we didn’t have tech enthusiasts getting quite so invested in the conversation. Possibly because we were all familiar with IBM’s decades-long history of shipping overhyped and underwhelming products.

Unfortunately we seem to have yet to realize that that’s a habit that’s endemic to the tech industry. Instead we still see it as thousands of isolated cases that, only by sheer dumb coincidence, happen to comprise the bulk of the tech industry.

sejje 1 hour ago | parent

I remember when we were having more or less this same conversation about the internet. It wasn't even that long ago, either.

"Open data, sharing, real-time communications leading to great progress."

Current AI should be compared to the internet, not to watson.

bunderbunder 1 hour ago | parent

Could you explain why? Because I just don’t see the analogy.

Openness and sharing is precisely why the Internet was so successful. Anthropic, by contrast, is a proprietary SaaS vendor with monopolistic ambitions that’s openly seeking regulatory capture and actively supports the swarms of AI bots that are killing what remains of the open Internet by driving everyone’s hosting costs up to an unsustainable level.

sejje 1 hour ago | parent

Well, I said we should compare current AI to the internet.

You then compared Anthropic to the internet, and said you don't see the analogy (neither of us made an analogy fwiw).

I hope that helps.

bunderbunder 4 minutes ago | parent

You still haven’t explained what you think the analogy is.

I wasn’t using analogy in the “literary device” sense. I was using it in the “a particular kind of rhetorical device” sense: https://en.wikipedia.org/wiki/Analogy

ur-whale 1 hour ago | parent

According to Dario in the twitter video, AI will cure all human ailments.

I wonder if AI will also cure psychopaths.

thg 1 hour ago | parent

Well, death does cure all ailments.. Although I have my doubts that an LLM will ever evolve so far as to kill us all.

slibhb 1 hour ago | parent

It's no secret that people like Amodei think AI is going to become "superintelligent" and solve all of our problems (or kill us all). I don't think that will happen but there's nothing surprising about hearing it.

dirck-norman 1 hour ago | parent

It’s honestly offensive to those of us that have suffered for decades and have navigated a kafkesque nightmare of modern medical limits.

Knowing how little Claude has “cured” software engineering, this is just garbage self-aggrandizement.

Amodei seems to be yet another one of these founders who don’t know what they don’t know, but speak very loudly and proudly of their ignorance.

One might even say he seems manic and unwell.

rimliu 1 hour ago | parent

What did claude cure in software engineering? Producing thousands lines of code quickly cured nothing.

dirck-norman 28 minutes ago | parent

Nothing. That’s what I’m saying.

LLMs, while definitely a useful tool have not massively replaced engineers.

If we can’t even have huge paradigm shifts in the area it’s specifically tailored toward, there’s a low probability it will eliminate entire fields that require physical testing and extreme domain knowledge.

We don’t have self driving cars, solid state batteries, or humanoid robots. None of this has been sped up by AI in the way Amodei is suggesting.

zero_23784 1 hour ago | parent

Everytime ai systems entered a domain, experts of that domain have been proven wrong. Biology will be similar. Here is the point, to be able drive huge improvements in a field, you do not need to know everything about that domain. Yes, biology is messy, but we already had incredible breakthroughs in this domain without understanding it 100%. Did we have the full picture when we created antibiotics, vaccines etc.? Maybe solving the big diseases do not require the amount of detail/experience people assume. Maybe we have/will have enough data to extrapolate and create solutions from imperfect knowledge.

geraneum 1 hour ago | parent

> Everytime ai systems entered a domain, experts of that domain have been proven wrong.

Every time the AI is being hyped, someone from a different pipeline pops in to remind us how wrong everyone and all the experts are except them.

zero_23784 59 minutes ago | parent

Experts being wrong about a prediction in their domain is newsworthy, of course people are gonna point that out. They know their domain but they don't know/understand the extent of the power of AI.

geraneum 35 minutes ago | parent

> Experts being wrong about a prediction in their domain is newsworthy

this is your motte, but your bailey was the one I quoted: “_Everytime_ ai systems entered… experts have been proven wrong”.

Which of course, hasn’t happened in this timeline.

rimliu 1 hour ago | parent

Which domains were they proven wrong in?

coffeebeqn 1 hour ago | parent

SWE, Math

WarmWash 1 hour ago | parent

CAD and Classic Engineering are getting saturated now too.

NoDodgeQuestion 1 hour ago | parent

Everytime definitely not, sometimes ai system find unmapped maya pyramid, turns out pyramid was mapped previously

datsci_est_2015 55 minutes ago | parent

Can't wait until AI systems enter the domain of infinite abundance. Stupid experts have been telling me my perpetual motion machine is crank science but I know they're just short-sighted losers.

wAdk129 1 hour ago | parent

Amodei does produce a cure: it is just called "snake oil" or "frontier snake oil".

gsaines 1 hour ago | parent

I don't know much about Gary Marcus, but I can't take any author seriously that has a blatant grammatical error in the first paragraph:

"a video tied to the IPO launch in which he made a bunch of overpromise about medicine that would have made Elizabeth Holmes blush."

On the plus side, it's unlikely that Claude wrote this because it would have written the correct plural form of "overpromise," but that's just sloppy editing.

menomatter 1 hour ago | parent

Not commenting on the crazy timeline but I ask: are these problems unsolvable by any intelligence however superior?

goda90 1 hour ago | parent

My guess would be it's not a matter of intelligence but of insufficient data. And not "oh let's scrape more data from the open web" but rather "we need to be able to understand everything going on in incredibly complex biological systems and how each action we take impacts things".

If we figure out a super quantum computer that let's us simulate the human body with 100% physical accuracy, maybe that'll do it.

CodingJeebus 1 hour ago | parent

Yes, mental health problems are not solvable by AI because AI and the conversation around it absolutely contributes to people's mental health problems. People selling the AI are telling the press that it will destroy up to 50% of jobs. It's the largest fear-based marketing campaign in human history, and it's absurd to make these kinds of claims.

AI might cure mental health issues for the people who own it, but it's hard to watch this video and not see some serious mental issues going on with Amodei.

brokencode 1 hour ago | parent

I don’t think we have any way of knowing what is and isn’t solvable by superintelligence.

That’s the whole “singularity” concept.

Though when it comes to medical research, the slowest part is typically running trials on real humans. That part would still be slow.

ActivePattern 1 hour ago | parent

I don't think people are questioning the ability of AI (or humans) to eventually solve these problems. It's the claim that it will happen in 10 years that is absurd, given the bottleneck of time necessary for lab experiments, manufacturing, clinical trials, and FDA approval. Most drugs take over a decade to go through that process.

volkercraig 1 hour ago | parent

For a truly revolutionary therapy with the potential to save millions of people's lives, every drug agency has ways to expedite approvals. They do it all the time. If someone found a legitimate cure for cancer there is no way in hell all the agencies on earth are going to sit on their hands for a decade while their governments spend trillions of dollars treating the disease with SOC

HDThoreaun 1 hour ago | parent

Covid vaccine got approved in 10 months. Of course it was building on tested mRNA tech, but still, there are ways to expedite trials if we think the reward is high enough.

djeastm 6 minutes ago | parent

He might have just been saying that the initial discovery that eventually becomes an FDA-approved cure would happen within 10 years. He doesn't really seem like a details kind of person.

coffeebeqn 1 hour ago | parent

How do we even define the problem of “mental illness”? Much less the solution. Super intelligence could be able to reverse engineer these things but I don’t think we know yet that superintelligence in any field is possible so it’s scifi - and our economy is riding on the scifi being scifact

somenameforme 1 hour ago | parent

I think there's no reason to doubt the viability of 'super-intelligence' though I wouldn't really call it intelligence. There's just so much in so many fields, and humans can only hold a tiny percent of all knowledge in their head at a single time. There's likely plethora of 'obvious' dots we're failing to connect simply because nobody has both of them in their pool of knowledge.

But that's more like super-knowledge-connector. Intelligence would require, at the minimum, be the ability to discover/create things that don't logically follow from anything else. So for example - advancing some esoteric field of mathematics by connecting things in a previously unexplored way = super-knowledge-connector. 'Inventing'/discovering mathematics from nothing = intelligence.

Arodex 1 hour ago | parent

"Dario claims AGI will solve the perpetual motion problem"

nancyminusone 1 hour ago | parent

That depends if it can be solved using only information.

Noaidi 49 minutes ago | parent

I will talk about mental illness, because that is my experience (I am disabled with Schizoaffective Bipolar Type, Panic Disorder, and OCD).

No, it will not cure mental illness. Mental Illness is in my genes[1] and I can see it because I have my genetics. My disorder is triggered (important!) by my environment. Stress, high altitude, heat and humidity, high EMFs (yes, I said it) can all trigger episodes.

I am homeless (stress!), so if AI does not fix that, maybe they can invent a different kind of opioid? But that is juts a treatment, not a cure.

Will AI ever recommend diet changes or other environmental changes that have helped me? I need to live in a cold, low altitude environment where I eat a lot or reindeer, salmon, and seal and very few plant foods (Similar to an Inuit diet). These things helped me more than any other drug in my 60 year life.

[1] These genes come from both my Sami heritage and the ancient mitochondrial haplogroup (K1c2a around 7050 BCE). Some of the most impacting genes of my polygenic environmental disorder:

TAAR6, CACNA1C, KCNQ1, SCNA2, NCAN, DNM3, C15orf32, TPH2, CBS, FUT2, FADS1, FADS2, CPT2A, SLC1A1

camillomiller 1 hour ago | parent

A deep and lasting reckoning is sorely needed. People like Amodei have to be brought back to reality by being confronted with the utter failure of their distorted view backed by deranged capital. I hope that this whole thing comes crashing down in flames like a fucking Zeppelin soon, so we can move forward to actually integrating these incredibly useful intelligence tools into where they can contribute to society and innovation, at a discount and without the CEO-enticing job-replacement hype.

BLKNSLVR 1 hour ago | parent

Zuck, Musk, Altman, Bezos, Ellison.

Nadella and Huang, both currently getting some lessons from a re-familiarisation with reality, but who knows if these lessons will stick?

Actually, I do know: the lessons will not stick. A doubling down will be the result.

Trump had his inevitable midterm defeat, but I don't think any lessons were learned there either.

IAmGraydon 1 hour ago | parent

Zuck is probably getting a dose of reality as well given the fact that literally no one is using Muse.

insane_dreamer 11 minutes ago | parent

or the Metaverse

cheapcheerful 1 hour ago | parent

Just to play devils avocado, Dario isn't Musk. He's got a doctorate in biophysics from Princeton, and postdoc scholar from Stanford Medicine. Curing disease seems to be why he got into AI, when his father became ill but died just a few years before his illness became easily curable.

krapp 1 hour ago | parent

The devil has enough avocados, thank you.

hybrid_study 1 hour ago | parent

but not enough avocados

asdfologist 1 hour ago | parent

People also bashed Dario for predicting that 90% of coding would be automated.

Arodex 1 hour ago | parent

New: Dario claims AI will allow women to have babies in only 1 month.

Arodex 1 hour ago | parent

So basically his neuroses drive him but also cloud his judgement.

bamboozled 1 hour ago | parent

Similar story to Ray Kurzweil. Personally feel sorry for these guys losses and maybe they will succeed...

gessha 1 hour ago | parent

Perfect case for ditching cloud judgements for self-hosted judgements.

busssard 1 hour ago | parent

well he has an IPO, so he is getting closer to Musk.

If you have to drive share prices, you better make outlandish claims

whynotmaybe 1 hour ago | parent

And Richard Jordan Gatling that invented the gatling gun was a doctor of medicine and invented the gun to reduce exposure of soldiers to diseases.

whimsicalism 2 minutes ago | parent

well he was right

fourside 1 hour ago | parent

I’m going to go with the mass of subject matter experts saying this is impossible vs the CEO of a company that’s pitching us on his IPO.

rvz 1 hour ago | parent

Just stop.

This appeal to authority bullshit on an individual making outlandish claims and who obviously has a financial incentive to sell you something needs to completely stop.

The same happened with doctors over 100 years ago who were peddling the benefits of Radon to "cure" cancers and diseases while financially benefiting from those unfounded claims to sell people a scam.

datsci_est_2015 58 minutes ago | parent

Praying for a future where the biggest outcome of AI adoption is the death of the Great Man Theory.

dev1ycan 1 hour ago | parent

As someone whose mom got recently diagnosed with barret's, whose dad already died from pancreatic cancer, whose grandfather got alzheimer's, whose grandma died from diabetes/cancer complication, I understand the psychosis that this can create, it's like you're living on a sand clock.

Diseases are horrible, I am against people living forever, because we are taking the world away from the next generation, but I also am against people dying in unpredictable, sad ways, I wish everyone could die at peace in their bed next to their loved ones (if they were good in life) rather than through diseases or conditions.

dig1 1 hour ago | parent

Having prestigious degrees doesn't mean your ideas make sense or that you're rational. Luc Montagnier, a Nobel laureate who co-discovered HIV, strongly believed in homeopathy and DNA teleportation, which the scientific community widely regarded as pseudoscience.

jstummbillig 1 hour ago | parent

At some point I will have a LLM explain Gary Marcus to me. He seems just silly and incorrigible, and I am mystified as to why people I think are important think he is important.

233mhz 1 hour ago | parent

Browse https://www.reddit.com/r/accelerate/ for a bit and see how harmful these ideas are.

Some people legit think there is no need to go to school, work, learn or care about anything because Musk, Amodei, Altman &co promise them "universal high income" and eternal life in 10 years...

abanana 1 hour ago | parent

Wow. That subreddit is giving proper religious cult vibes, especially with the whole sense of superiority, uncritical belief and faith, and banning heretics.

The comment by Megan Fritts ("a professor of philosophy"), shown in the article, speaks to me possibly more than any of the other comments there. "Cult leader" is exactly right.

lompad 1 hour ago | parent

Dario Bankman-Fried von Holmes?

He's completely and utterly high on his own supply. That is what happens when you get told all day everyday how great your ideas are.

WarmWash 1 hour ago | parent

Ahh yes, Gary "AI can't do math" Marcus

https://garymarcus.substack.com/p/math-is-hard-if-you-are-an...

I'm sure he'll be right this time around, just like, well, nevermind

jaapz 1 hour ago | parent

I mean, at that point in time it really couldn't do math.

WarmWash 1 hour ago | parent

The post is about how LLMs cannot be scaled to ever correctly solve problems.

rimliu 1 hour ago | parent

AI cannot do math. It uses deterministic tools for that.

sejje 1 hour ago | parent

Tell that to Terence Tao

cauch 55 minutes ago | parent

Did Terence Tao really pretend that the LLM, which is the bit without tools (such as basic math calculator and Lean verification), can do math?

And if Tao mentions LLM, does he really mean "the bit without tools" or is he conflating the two?

I know that Tao is saying that current AI is useful to advance research in math (and I fully agree with that), but 1) that is part of a whole framework, LLM is just part of it, and I think that it is not the part that "know how to do math", 2) even if you obtain the correct mathematical output, it does not mean that the LLM part itself can do math (the same way that someone who throws 10000 basket balls and misses 9999 of them should be considered as unable to play basketball even if you just have a process where you ignore the 9999 misses and only record the one that made it)

WarmWash 34 minutes ago | parent

Are you sure you know what math is, or are you thinking about arithmetic?

Tao and others don't sit around working out what 12,483,324,281/188,553.37463286*(243+2-983) is all day. There is a reason most people don't consider mathematics education to really start until you stop needing to bring a calculator to class.

cauch 2 minutes ago | parent

You seems to have scanned the message and notice one word ("basic math calculator") and stopped there.

Just next to this word, there is "Lean verification", which is not about arithmetic but about the logic.

But the problem is not even there. LLM are not able to do math not because they fail to do 12,483,324,281/188,553.37463286 * (243+2-983), but they are not able to do math because they don't _understand_ 12,483,324,281/188,553.37463286 * (243+2-983).

I cannot do 12,483,324,281/188,553.37463286 * (243+2-983) myself just like that, yet I can do advanced math. Because I understand this expression. I know what it means. When the LLM was not able to produce the correct number, it was not because it knew what this expression meant and was "distracted" and forgot to report a 1 when doing the mental calculation. It was because the LLM was seeing the expression and was trying to guess the answer based on the answers of other texts that had similar expressions. It did not _understood_ the expression itself: it had no idea what it meant, it was just guessing the answer by copying the output it has seen in the wild.

And this is why it was a good element to demonstrate that LLM cannot do math: if they don't understand the expression 12,483,324,281/188,553.37463286 * (243+2-983), then they don't understand the expression f(t)=\sum_{k=-\infty}^{\infty} c_k e^{j k\omega_0 t}, \qquad \omega_0=\frac{2\pi}{T}.

And that is why the AI framework to do proper math and help mathematicians needs harness with tools like Lean. The LLM part does not understand what the expression means, it needs a tool to discard, internally, all the LLM outputs that are just non-sense.

HDThoreaun 1 hour ago | parent

AI solved a millenium problem. Is that not math anymore?

hybrid_study 55 minutes ago | parent

Woody Allen, “The Whore of Mensa,” collected in Without Feathers.

Suppose I wanted Noam Chomsky explained to me by two girls? Oh, wow. ... You’d have to speak with Flossie, she said. It’d cost you.

We may need Flossie to also explain Gary to us all.

cmiles8 1 hour ago | parent

Remember when IBM Watson was going to cure cancer and fix IT?

History doesn’t always repeat, but it often rhymes.

jfoster 1 hour ago | parent

Human trials only exist because of the uncertainty associated with new medicines. Eliminate that uncertainty and you have eliminated the need for trials.

tylerrobinson 1 hour ago | parent

Are you implying large language models eliminate the uncertainty of new medicines?

ben_w 1 hour ago | parent

On the one hand, literally every development in this field will reduce uncertainty somewhat.

On the other, we're still very much in the time of headlines which should say "in mice" but don't because the uncertainty is that level of bad.

Uncertainty will have to come down a long way before we can even do without animal testing, let alone do without human testing.

jfoster 55 minutes ago | parent

Currently? Of course they don't.

If a level of intelligence far beyond humans is achieved, it probably could eliminate most of the uncertainty about new treatments.

evklein 1 hour ago | parent

Hey Claude, can my liver handle this experimental molecule? Make no mistakes.

Marha01 1 hour ago | parent

Human trials do not exist solely because of the uncertainty, but it is true that a medicine with a significant effect could be accepted after heavily shortened trials. If AI hypothetically invents a cure for a serious disease that immediately works for virtually everyone that takes it, there is no way how the trials would take years. They only take years because the effects tend to be "we decreased mortality from 80% to 70%", and it takes a lot of time to confirm that.

jfoster 1 hour ago | parent

> Human trials do not exist solely because of the uncertainty

OK. If you already have perfect confidence in a treatment, what would a trial do for you?

Marha01 52 minutes ago | parent

There will still be a trial, it will just be significantly shortened if the effect is very strong (and the disease is serious enough, so any risks from a shortened trial are outweighted by the disease itself).

SpicyLemonZest 1 hour ago | parent

Sure, but then we’re talking about “singularity solves everything” rather than any generalization of current performance. Claude doesn’t one-shot perfect code, for example, it just has access to a harness that lets it test things and respond to the results of such tests.

jfoster 58 minutes ago | parent

True, but that's essentially what he's saying; super-intelligence could solve everything in ways that we have never seen before.

akst 1 hour ago | parent

There simply isn’t sufficient recorded information known about the human body for LLMs to one shot new medicines. These models are trained on known measurable information, so much of which we don’t actually know about the human body

You can’t just overcome that uncertainty with really good guesses based on what to do know. Not at least until you know a lot more.

Secondly RCTs exist because you want to capture a random portion of the population, some of who may respond differently to different treatments. That and the body is a dynamic organic system and not everyone’s is in the same state.

LLM will improve the pace at which new medicines are developed but it be a long time before reasoning entirely replace the need for empirics.

throw310822 36 minutes ago | parent

Why this emphasis on shortening human trials? Human trials can be just as long and thorough as they are now, as long as AI is capable of one-shotting working cures. A few years of wait are ok if you don't need to go back to the drawing board 99% of the times.

pelagicAustral 1 hour ago | parent

Hey Dario, can you please add hair-loss to the list of things to cure, cheers.

insane_dreamer 13 minutes ago | parent

the common cold would be nice, too

walthamstow 1 hour ago | parent

> The map of biology is still largely a blank page and randomized human proof is the long pole in the tent.

Ironically the Eli Lilly guy sounds exactly like Claude Opus 5

sejje 1 hour ago | parent

Is that the load-bearing pole? Is this how they fixed it? Rewording?

xyst 1 hour ago | parent

Time for another CEO to get "sniped" via their dirty laundry aired out in public.

Guy sounds like he has some major skeletons in the closet. Seems like many rich people go through this odd manic phase before the breakdown too.

imjonse 1 hour ago | parent

To be fair he does not say cancer, Alzheimers and mental illness will be cured in 10 years, but that they will become 'relics of the past'.

Just do not feed that vague reward signal in their AGI training run because combined with Amodei & bros being firmly in the war hawk paranoid anti-China camp they can make us and our diseases all relics of the past just to prevent offline local inference with chinese open weight models.

sejje 1 hour ago | parent

> he does not say cancer, Alzheimers and mental illness will be cured in 10 years, but that they will become 'relics of the past'.

Doesn't everyone believe that, on some timeline, we will cure all of these things? Like if I said within a million years, you'd be hard-pressed to find a serious doubter.

Dario just thinks he's going to build ASI and ASI will solve them more-or-less instantly. I believe an ASI would do that, as well.

So by my logic, naysayers really just don't think we're about to build ASI. Dario does. I figure he has a better perspective. But we're not arguing about solving all of that stuff, we're arguing about whether ASI can do it, and whether we're on the cusp of ASI

polotics 1 hour ago | parent

As I understand it, "cure for cancer" is the NP-Complete of life: if you can do it, then why stop there? You know enough to just make your own organisms that don't die of cancer, or of anything else for that matter. I wonder what these would look like, but definitely not human.

ben_w 1 hour ago | parent

> I wonder what these would look like, but definitely not human.

Dinosaurs. I mean, the meme already exists: https://knowyourmeme.com/memes/but-i-dont-want-to-cure-cance...

Either that or a three-way split between kpop stars, tanks, and furries: kpop for conventional beauty standards, tanks for people whose thing is Ultimate Strength, and furries for those whose main interest is self-expression.

irthomasthomas 1 hour ago | parent

I thought we where all on Elon Time. So ten years Elon Time equals about one hundred years real time, your honor.

armcat 1 hour ago | parent

It's interesting him talking about AI curing mental illness, when there is now a quasi-established AI mental illness called AI psychosis [1]. As the saying goes: "there is no such thing as a free lunch".

[1] https://en.wikipedia.org/wiki/AI-induced_psychosis

areoform 1 hour ago | parent

I would like to give the people reading this an intuitive explanation as to why he's wrong.

There's a famous study in synbio that led to standardization called, Reproducibility of Fluorescent Expression from Engineered Biological Constructs in E. coli

https://journals.plos.org/plosone/article?id=10.1371/journal...

88 labs measured "fluorescence from three engineered constitutive constructs in E. coli." You should eyeball the results yourself first,

https://journals.plos.org/plosone/article/figure/image?size=...

That's the result these machines spit out for the same set of samples being measured across 88 labs. This was termed a "remarkable degree of precision" (for biology) of 1.54x sd(!).

Teams couldn't converge on instrument-to-instrument variation within the SAME lab, https://journals.plos.org/plosone/article/figure/image?size=...

So the reading is different depending on when you measure it. For some reason, people in silicon valley think that biology is like classical logic and computing. You write some genetic code and you get expression out. It's not.

That's the pop-sci view of a real process. In reality, viruses and bacteria are extremely fickle, and hard to grow. A lot of the synthetic biology results aren't easily reproducible even if you know the protocol.

So you're telling me that you can fix that with "just" AI and "robots?"

Well... I would hate to break it to folks. But applying neural networks and ML to biology has been a thing since the dawn of AI. It was one of the very first applications people thought about.

It used to be called computer-aided drug design, then they went all in on expert systems, then there was a time when quantitative structure–activity relationship AIs were a thing, then there was teh deep learning phase... D.E. Shaw actually did a ton of work on it, https://www.deshawresearch.com/technology.html he used his money to buy a supercomputer and used that to train neural networks...

Blockbuster drugs have come out of this. Tirzepatide / mounjaro was discovered by algorithmically iterating through sister-compound families of the peptide they'd found in Gila monster venom until they found just the right one.

The issue that Anthropic and Open AI face here is that there's no low hanging fruit. There's no free lunch. It's very unlikely that Claude or GPT can do something that hasn't already been tried at some point in every AI/ML research era.

So they won't be able to "just" discover a new drug. If that was possible, then it would have already been iterated into by sheer accident based on the number of projects that have tried some variation of this with some sister architecture over the many decades preceding us.

Now where these machines do help is that they help people get started, and they also help working scientists. It's boring stuff, but think stuff like, "hey my machine isn't working, it's made by such and such. Can you write code to help me save my data?" or, "Can you proof read this grant?"

It will even accelerate the already tried approaches as it allows a smaller team to try more AI/ML algorithms than they would necessarily have had the expertise to execute before.

But will Claude magically solve medicine? No. I'm sorry, but it just doesn't work that way. And I'm not sure why they believe this, but I keep repeating this over and over again... A lot of this AI and biology stuff is nonsense. Standard undergrad and post-grad stuff whipped into fervor and fluff.

volkercraig 55 minutes ago | parent

I think you're thinking that the research process will be something like Dario opening up claude code and typing "Claude, solve cancer, make no mistakes". But that just isn't the case. Consider the ability to develop new tools and software for drug discovery. Consider the advances that google has made with AlphaFold. Consider the ability to crawl mountains more data than every before and finding the smallest hints, tucked away by connecting 6 papers written in 4 languages, published 60 years apart. Bioinformatics is a relatively new field, but when I finished my degree in 2018 the field was still so far behind the cutting edge of computing it was laughable. "state of the art" was dynamic programming algorithms and I remember that the first implementation of blast tools were only just ported to CUDA while I was in class, and that really wasn't that long ago. Protein folding software when I was in school was basically completely manual. You needed to define the structures yourself and then give it a place to start and it would (entirely on cpu) do some sort of gradient descent to give you an approximation of the structure.

The thing that I noticed while I was doing my degree was that the CS people refused to talk to the bio people, and the bio people refused to talk to the CS people. The CS people would go on and make solutions to problems nobody asked, and the bio people would try to solve data problems in complicated ways that made no sense. Overlapping expertise is and was very rare between those two fields. AI however CAN be that bridge, because it can basically turn your average bioinformatician/biologist into a really competent programmer, without them having to give up time away from the work they are actually skilled at.

Maybe I'm just completely AI-psychotic, but I've always been a researcher at heart. I hated doing literature review because it was so frustrating falling through dead ends. These last few months with agents I have been able to go deeper and find better leads than ever before. AI is like having an insanely smart lab partner, available to you 24/7/365. Never gets tired, never has a pissy day, never gets too hungover to read papers. I do legitimately think it's going to accelerate the field so much faster than people expect. I don't know about the 10 year horizon, but I'd love to see it happen, and I'm cheering for them.

knottn 46 minutes ago | parent

Excellent post but while you definitely sound very well informed and provide solid backing for your claim “they won’t just invent a drug” it’s not very convincing. If I had to bet, I’d still bet on the new ai companies advancing pharmaceuticals more than hypothetical counterfactual non ai enabled pharma companies, putting aside political and financial constraints around that. It seems like you know the domain but knowing the domain is less important than knowing what is outside the domain viz a viz tech disruption. The general matters more than the specific sometimes.

maxehmookau 1 hour ago | parent

The idea that LLMs (even good, SOTA ones) can "cure mental illness" is bordering on mental illness itself and completely ignores what humans are.

You've gone down a bad path if you're making the pharma companies seem like the good guys.

throwaw12 1 hour ago | parent

One might not like Dario and use words like "ludicrous" for his claims, but lets not forget that he was right about coding that "AI Would Be Writing 90 Percent of Code", but he was off by 6-9%, now 95-97% of code is written by AI.

https://futurism.com/six-months-anthropic-coding

tossit444 1 hour ago | parent

A broken clock right twice a day.

throwaw12 1 hour ago | parent

He was too optimistic about the timing maybe, but he was right about the trend.

Broken clock doesn't apply here

zug_zug 1 hour ago | parent

That's sort of like saying Elon was right about Tesla not going out of business 10 years ago, so therefore we should take his flying car claims seriously...

kzsh 1 hour ago | parent

I can't find where the article you linked supports your statement.

kunai 1 hour ago | parent

Yes indeed, and Microsoft Outlook's incredible and resilient authentication backend demonstrates how fantastic this development has been for predictability, security, and understanding codebases.

datsci_est_2015 1 hour ago | parent

I can also write 90% of my code by holding down `Ctrl-v`.

The phrase "AI is writing 90 percent of code" doesn't mean what it did when he first uttered it. I'm producing 200-300% more code than I used to, but only like 10% more value to my customers. It's mostly internal tooling to monitor things that were left unmonitored before.

yieldcrv 55 minutes ago | parent

> but only like 10% more value to my customers

that’s funny, my customers are completely different than they were a year ago

people that would have never paid for coding because it was too expensive and risky are now getting their MVPs validated, earning and investing into more

datsci_est_2015 47 minutes ago | parent

Interesting anecdote. If I read between the lines, you lowered your prices and now more people are interested in hiring your services. You may also spend more time marketing and talking to clients and less time on programming.

yieldcrv 27 minutes ago | parent

No, prices went up. Its all about post sales now with software that isn’t entirely self serve… again. “Forward deployed engineering” to integrate a white label version of some AI powered system into the client’s systems

The people that want this weren’t previously building the mvp, or the base version of the software. It wasn’t economically viable and would have taken too long so they didn’t

Besides the vendor/us getting paid for initial agreement, they’re also creating reasons for clients to do a lot of inference, selling tokens at a higher price than the vendor has to pay

cmiles74 1 hour ago | parent

I do not think he was right about AI writing 90% of all code and we've seen that the effectiveness of coding agents has been very much exaggerated. This seems like more of the same to me but for mental health and medical research.

For sure more code is AI generated and coding agents are useful. But not nearly to the ludicrous extent this man has been predicting.

Marczelloni 49 minutes ago | parent

I agree when supplied with a broader context that he also said coding would be "solved" by now.

Sure LLM is good to develop a feature but in 90% of cases in my career the problems I was working on weren't just coding and in that part, LLMs can't do everything.

It's also important to know that a typical dev spends 400-1000$ on API tokens that aren't still profitable for them.

Sure AI's useful and it will reduce the demand for software engs. to a point, but it won't eliminate them. At least I hope. Same with other fields... let's hope?

BeetleB 29 minutes ago | parent

Let's be frank. If a professional programmer is not using AI to write code at work, it's almost certainly because his employer isn't willing to pay the AI bill.

My previous company has a huge department where LLM coding is banned. The rationale is they work on really important industry secrets, as well as deal with customer's data. The risk is too high that something gets leaked.

The engineers bought the Kool-Aid.

The reality is: The company is bleeding money, and SW isn't their product (they're a HW company). They don't want to pay the bill.

whimsicalism 4 minutes ago | parent

You’re saying that you think less than 90% of all core today is being written by LLMs?

bagacrap 57 minutes ago | parent

I think AI writes 250% of my code actually. I write 10% and delete 160%.

richiebful1 57 minutes ago | parent

But he also has a vested interest in hyping up the future capabilities of Anthropic's models. Maybe the prediction is founded in some sort of evidence that the CEO of Anthropic has. Just as likely, his company is starting its IPO and they need to raise money to keep the money furnace going.

akst 55 minutes ago | parent

There’s an abundance of machine readable training data for coding, not sure the same can be said for biological systems like the human body. Yes we have machine readable information on what we know, but that still isn’t everything we need to know about the nature of the human body to the point this can be entirely done by some statistical model.

shimman 3 minutes ago | parent

Do you honestly think tech workers actually like this outcome? The entire industry is immiserated and constantly told they have to be sacrificed to birth the machine god.

hypendev 1 hour ago | parent

I'd disagree with the statements and people making fun of it.

While these people are obviously professionals in their field, anyone who touched pharma/bio IT with a ten foot pole understands how much there is to improve there. And that's just the beginning - imagine how much there is to improve in understanding of the body overall?

It's not about "AI will discover a cure for X in 10 years".

But it's about having the applied intellect of a an engineer, chemist, biologist, and all mixtures of that, available on demand, in a second, at scale, enabling you to do everything around it faster, better and cheaper.

Every step of drug discovery, synthesis and testing can be improved.

Over 90% drugs tested in humans fail. And maybe 0.1% of overall discovered ones. While yes, testing on humans is the bottleneck, we can fix problems around the bottleneck easily.

If you had a data processor and 90% of data that goes into it is corrupt, the processor isn't the bottleneck yet - the data quality is.

If we can create better biological models to test these drugs, better interaction models, improve pharmacokinetics, improve yield, we can go from 1000 discovered, 1 works, to 1000 discovered, 100 works. We can predict some candidates will fail due to better models and not test these. We can improve how they are delivered to the body and make them more effective. We can catch potential side-effects early on and avoid going to trials at all.

This is what AI can do even nowadays, let alone 5 or 10 years from now.

And that is a huge improvement. It revamps the industry.

bearjaws 1 hour ago | parent

I do think healthcare is heavily under valued in the scenarios where AI does infact help make new treatments.

It seems to be thought that AI will help invent these novel treatments, and then Anthropic will profit from that.

When in reality, who will actually produce, distribute and administer these treatments? Not Anthropic - or any of the big AI companies.

alyeska2 1 hour ago | parent

AI is solving phD level open math problems, even though I was told it was just a stochastic parrot that would never generate new ideas or solve unfamiliar problems.

Self driving cars roll past my office every couple minutes, even though I was told AI would never be able to drive on public streets.

AI images and videos are indistinguishable from real videos, even though I was told they'd never be able to generate hands correctly.

But I'm sure the naysayers are right this time, AI defintely won't ever be effective at medical research.

quantum_state 1 hour ago | parent

It seems hallucination is infectious ... from LLM to human ..

theturtletalks 1 hour ago | parent

Does the Eli Lilly CEO know about the exponential time hypothesis? If not, I don’t think they have a pulse of what AI is capable of doing.

gnfargbl 1 hour ago | parent

A corollary to Gell-Mann Amnesia: I don't know shit about drug development, but I know a bit about the cybersecurity industry. Most of what Anthropic has said about cyber isn't wrong exactly, but it's been breathless and so crudely expressed that it fails to capture the real path that developments are likely to take. For example, Anthropic said that AI might create a giant botnet (no shit, so what) whilst not really talking about agentic offensive frameworks (uh-oh) at all.

I have to assume that they're probably doing the same with medicine.

huntertwo 1 hour ago | parent

I don’t see how cancer is not solvable by AI - if you can cheaply detect the genetic defects that are causing the cancer in any patient, and you can cheaply and rapidly generate and validate retroviruses, you can effectively treat any cancer.

hoppp 1 hour ago | parent

Not all cancer is caused by genetic defects that can be detected ahead of time.

hansvm 1 hour ago | parent

How cheaply? How accurately? Your proposed solution puts a lot of strain on the body, so even if it fixed cancer you wouldn't want to do it preemptively every day for example, likely shortening lifespan substantially despite cause of death not being cancer any more. It's a scheme that also relies on detecting cancer quite early (else the bulk of a tumor can easily be unchanged from that intervention), so you'd expect quite a lot of those false positive scenarios. Not to mention "cheaply detect genetic defects" sounds like a pipe dream for now with or without AI (assuming you're referring to single-cell mutations, since any other interpretation just doesn't address enough root causes to actually cure anything close to most cancers).

seydor 59 minutes ago | parent

I just love how this guy always was, and always will be, wrong.

zug_zug 58 minutes ago | parent

In short - the reason medicine is slow for AI is the same reason it's slow for people -- the REPL loop is slow [1]. If you could pause and rewind time, and had perfect observability into every system, no ethical risks, (things that are free in software engineering, or math problems) then the AI could make massively parallel progress.

However I do think there are opportunities to greatly improve all these fields with AI, I just don't think we should lead with an overpromise that sounds Musk-like.

https://en.wikipedia.org/wiki/Read%E2%80%93eval%E2%80%93prin....

bArray 23 minutes ago | parent

You're thinking like a law-abiding Westerner. The ethical risks are not a concern for all, if anything the humans are the cheap bit of the process. There are a few ways to improve a genetic algorithm exploration, one of them is to simply run a larger population at a time.

nradov 7 minutes ago | parent

There have already been a few attempts by pharmaceutical companies to accelerate drug development by running clinical trials in poor countries with weaker patient protections. Regardless of the obvious ethical concerns, it turns out this doesn't actually speed up the process. It still takes just as long to discern a clear signal in terms of effects versus side effects. And those poor countries typically have infrastructure, security, and labor force problems which make it challenging to run large scale clinical trials at all.

christkv 2 minutes ago | parent

Of of the things it does is make hidden research visible in a way that previous search engines or journals did not.

yuhao2dai 51 minutes ago | parent

a man who had his testicles removed while he worked in China will say anything to fulfill his dream of revenge. standing on top of the world, curing cancer.

figassis 49 minutes ago | parent

What's suspicious about this is not whether it may or may not be possible (it likely isn't), it's that he is using it to borrow money now, that is not collectible in the case of a default. You get a huge exit because you overpromise today, and when it turns out you aren't a prophet, those that trusted you cannot be made whole.

People and the law keeps treating this as "just a sales pitch", but it's really theft in disguise and should come with evidence on an S1 filing.

credit_guy 40 minutes ago | parent

What do you mean it’s not collectible in case of default? Are you under the impression that money that you borrow before the IPO is excluded from the bancruptcy claims?

skeeter2020 28 minutes ago | parent

>> Are you under the impression that money that you borrow before the IPO is excluded from the bancruptcy claims?

it's being "borrowed" in the sense that there's an implicit promise as part of the IPO sales pitch, but shareholders are last in line to collect in case of something as extreme as a bankruptcy - and that's if there is anything left if that was to happen, which by definition is not frequent.

nradov 4 minutes ago | parent

Yes, everyone purchasing equity understands that they're last in line after debt holders. This isn't some kind of secret.

bagacrap 9 minutes ago | parent

Obviously borrow is being used loosely here -- it's actually equity. And second, yes, some creditors don't get their money back in a bankruptcy.

s_dev 40 minutes ago | parent

>because you overpromise today, and when it turns out you aren't a prophet, those that trusted you cannot be made whole.

Why are these people obligated to trust Amodei? Why are these people obligate to hand Anthropic money?

I really hate this "Investors should be protected from losses" narrative you see pop up now and again like that isn't the entire natural order on how we conduct these things and somebody not being made "whole" is somehow unfair. It's not theft, Dario will simply accept your money if you give it to him.

You make a bet you can lose. These are grown adults making decisions.

vonneumannstan 34 minutes ago | parent

It never was, the vast majority was VC investment not debt so collection was never on the table...

_DeadFred_ 8 minutes ago | parent

So a variation on the Chamath Palihapitiya 'SPAC' method?

yieldcrv 49 minutes ago | parent

Judging from those tweets, I think that community isn’t just accepting that he’s excited and doesn’t know what he’s talking about

But also I think simulations like a “body world model” of some sort will help narrow down what to test for the fda’s standard

And the fda itself has some newer faster approval pipelines

Anthropic is also clear about how they are partnering with a handful of life sciences firms to coexist with people that do know what they’re talking about

So I wouldn’t be too dismissive, the agentic form filing aspect will go a lot faster, that part is basically already done

d-us-vb 37 minutes ago | parent

I think what Amodei is probably thinking is that there's going to be a single breakthrough that cures all human maladies via the same mechanism. While this belief isn't strictly speaking scientific, the reality we're presently facing is a machine that can search the space of unknown unknowns, and if history has taught us anything it's that the scientific revolutions live in the unknown unknowns when a bolt of inspiration led a few people to starting seeing the entire world in a different light.

Is he right? We can't know now, obviously. But is he being utterly irrational? Not by any reasonable understanding of science history.

knottn 33 minutes ago | parent

Pharma companies are by definition firms that turn human capital into financial capital. They have to hire new scientists and managers, sales people etc in order to scale.

AI now and increasingly in the future lowers the cost/value of human capital.

Therefore Pharmaceutical output will be driven by AI inasmuch as it’s currently driven by talent and human capital.

Caveat: current pharma companies that do not rely on human capital for growth may not be disrupted and will likely benefit.

nycdatasci 33 minutes ago | parent

Does Anthropic list curing autism under R&D milestones or risk factors?

01100011 32 minutes ago | parent

Many things can be true. Dario can be a snake oil salesman. Serious advances in healthcare will take more than a decade to bring to market. AI will dramatically increase the speed of human advancement. AI might kill us or convince us to kill ourselves.

The weird thing is that when you create something that is in some ways more intelligent than you are, it becomes very difficult to predict its outcomes. We face a wall of uncertainty and it is impossible to see beyond it.

disgruntledphd2 29 minutes ago | parent

> in some ways more intelligent than you are, it becomes very difficult to predict its outcomes

I think that this depends on your definition of intelligence. The models definitely have better working memory than us, probably worse inhibition behaviour (just look at the thinking tokens), and absolutely no ability to convert their working memory into short or long term memory.

These tools are super, super weird, and I think that applying human definitions for intelligence doesn't make much sense.

(as an aside, this is also my issue with super-intelligence, as it's incredibly ill-defined).

01100011 15 minutes ago | parent

Yeah that’s one of my subtle points. AI is smarter by some definitions of intelligence but certainly not all. That has a lot of implications. It will do things we can’t and even do things we can’t conceive of yet. It also can’t do everything.

vonneumannstan 31 minutes ago | parent

Neither Gary Marcus or the Eli Lilly CEO are in a position to accurately say what AI will or won't be capable of in X years from now.

reluctant_dev 22 minutes ago | parent

Why is Dario uniquely suited to predict the future? I doubt they are holding out on any major medical breakthroughs espcially right before their IPO.

insane_dreamer 14 minutes ago | parent

My problem with all these fantastical predictions, is that most of these real big problems aren't really technological problems; they're social and political problems.

In order for "AI to solve X", there has to be a tremendous amount of resources put into not only AI solving X but testing and implementing the AI-generated solution(s). Who is going to put in those resources? The money flows towards what's profit-generating, not problem-solving.

So far, AI hasn't solved any problems that matter in terms of improving the human condition in any significant way. What has it accomplished so far? It has allowed companies to develop software faster so they can cut their workforce. It has solved some tricky math proofs. That's about it. Neither of these make a dent in improving humanity's lot.

"Yeah now it's just a chatbot, but once it gets better, it'll solve X." Yeah, sure.

_Theoretically_ AI could develop solutions to some gnarly technological problems -- nuclear fusion at scale would probably be at the top of my wish list -- but as we've seen the last 2 years in the US, the main reason we aren't relying more on cheaper/renewable energy sources is political, not technological.

Medicine is similar - the reason we still have Ebola outbreaks in the DRC isn't because we don't have a cure for Ebola. Same for the half a million children who die from malaria each year; it's not like we don't know how to stop malaria. (If they were American children, we would have have eradicated malaria by now, but they're African children ...)

World hunger: we know how to produce enough resources to feed and clothe the planet -- it's just very badly distributed, by design.

Etc.

bagacrap 11 minutes ago | parent

I can think of one way Claude is likely to eliminate all biological disease in the next decade.

Reddit_MLP2 3 minutes ago | parent

I am sold when Anthropic can promise me a pony for my boat... Just as likely!