YHK - yet another hacker news clone

OpenAI and Anthropic oversold AI security breaches

26 points hei-lima 1 hour ago 10 comments

gustavus 1 hour ago | parent

> OpenAI and Anthropic oversold “rogue AI” hacks to pressure the feds into regulating the industry which would effectively lock out future competition, tech insiders told The Post.

The only substantiative comment to address the claim in the title, and it is from a nebulous "Tech industry insider". The other comments are by guys that run various "AI" Startups.

I don't buy a lot of the hype either but trying to present their claim as some revelation or news should have something to add.

The entire article is "Some tech people say the agents just had a bad sandbox and proper controls would've prevented this. Politicians are introducing bills to 'ban AI research '."

There saved you a click or a commanding your AI agent summarizing it.

JSR_FDED 59 minutes ago | parent

I always turn to the NY Post for nuanced tech reporting.

spacephysics 57 minutes ago | parent

Though in general I agree, i think in HN world this seems more or less old news/obvious, while mainstream still doesn’t know (or maybe care to understand) thats what likely is going on.

I had a friend reach out in a slight panic after the Anthropic employee publically left, asking sole quite apocalyptic questions around AI given the sandbox “break out” and the Anthropic affiliated employee(s) saying theres something like > 10% chance AI kills all humans in the next decade.

This fear mongering needs to be exposed, so we can (hopefully) have more measured discussions around next steps. Stop all progress for regulatory capture? I’d rather not. Hold companies who commit crimes like hacking huggingface or Ruby dependencies liable (not to mention all the copyright issues)? Seems more measured to me. But i digress.

hei-lima 54 minutes ago | parent

Hard agree on that one.

himata4113 50 minutes ago | parent

I've always taken the example that at any given moment openai and anthropic have models that are "far better and exceed any expectations", yet their coding tools suck ass and are outperformed by random people on the internet.

bigyabai 51 minutes ago | parent

HN had a good thread discussing the original scoop: https://news.ycombinator.com/item?id=49704132

sajithdilshan 47 minutes ago | parent

This kinda have a point, if Chinese companies can distill US models and offer it at a competitive price, what prevents another US startup doing the same? OpenAI and Anthropic can actually influence the regulations to be a barrier for entry.

Also regarding all the hacks, I always wonder why are they so boring, like agents posting to some wiki or using a bug in documentation to execute some code in a sandbox remote server, like if AI is so dangerous, how come they haven’t hacked into banks and stolen money or hacked into North Korean nuclear program and shut it down or any other major disruptive incident.

einpoklum 46 minutes ago | parent

... like they oversell everything about their LLMs. To the tunes of hundreds of Billions of USD.

OptionOfT 42 minutes ago | parent

The value of AI is built on top of the idea that it can erase the cost of labor in a wide range of professions.

They're all racing for this, hoping to make money first, because once that erasure really sets in, there is no-one out there to buy products anymore, which means all those companies who replaced human labor by AI don't have anybody to sell their products to anymore.

And once that happens who is going to be needing all of these tokens?

kentonv 2 minutes ago | parent

This is reporting an opinion held by outside observers as if it is a leaked internal secret.

It's a perfectly valid opinion but not any kind of secret.