67 points speckx 1 hour ago 20 comments

c4u2024 1 hour ago | parent

i totally feel you, I get annoyed by this as well - even with daybreak (blue) you can do shit.

I want to fix my environment but can't because of "safeguards" thanks for letting the world hack everything around me but not letting me work on fixes or understanding the core issues.

kingforaday 48 minutes ago | parent

It's a strange effect when asking "find any security holes because I want to ensure my product is secure" vs. the parallel effort of "I want to ensure close to 100% system availability and reliability for users, what do I need to fix to prevent a <99.9999% SLA"

Same potential outcomes.

JohnMakin 1 hour ago | parent

The thing that irks me the most is these safeguards are ineffective at best, and don't actually protect anything, and at worst, make the global security posture weaker.

It's disgusting.

hazard 1 hour ago | parent

Ironically I think the answer here is to pay for one of the top Chinese open-weights models (e.g. Kimi 3.1 or GLM)

kingforaday 52 minutes ago | parent

Mistral Large 4 and Sakana Fugu-Cyber are good too.

noahjk 33 minutes ago | parent

Is there any well maintained list of which agents can be reached out to for classes of tasks which e.g. Claude may refuse, the strengths and weaknesses of those agents, and the proper way to structure prompts?

underseacables 22 minutes ago | parent

tangently related, I have a friend with severe depression, and he uses ChatGPT to help him talk through things. He switched to Deepseek, because he said ChatGPT would not stop hounding him about calling a suicide hotline. DS would only say one time that if he's feeling suicidal, he should call someone, but then it left it alone and proceeded like a friend not as a mental health therapist.

As I am told, Chat would actually shut down on him when he was at his most depressed because it found the discussion unsafe to continue.

He's moving to his own uncensored model off-line, because in his view, the CYA of public models has not been helpful.

orphereus 59 minutes ago | parent

Depending on third parties to this extent to develop your software (emphasis on to this extent) seems more and more like a bad idea.

k310 58 minutes ago | parent

> Either way, I’m just incredibly frustrated. Big AI labs use the same tools without restrictions to make the security landscape a f*cking mess, and then they go and prohibit others from using the same tools to protect themselves from the threats they just created.

It's the golden rule: Whoever has the gold makes the rules.

CoolestBeans 57 minutes ago | parent

It is a protection racket or as close as makes no difference. They basically pioneered superhacking tools, proved it was possible so now everyone with enough money can build their own, and then in order to use their version to defend yourself, you have to be in their good graces and pay them for the privilege.

ecshafer 56 minutes ago | parent

The worst thing about the top AI companies is that they are based in San Francisco, and comes with it the latent cultural attitudes of controlling what other people do. They from the start made these amazing technologies, and then also decided they MUST tell you how you are allowed to use it. Of course they also are lying in bed with the "AI safety" doomsday cult. Chinese models get a few weird results the Chinese government forces them in, but at least they don't scold me for the lack of diversity in my image generation, or scold me I am trying to do hack the TV I own.

speedboat199 54 minutes ago | parent

What is even more interesting is that somehow malicious users always figure out to bypass these safeguards anyway, and go as far as building guided missile systems with Claude, like Anthropic themselves admitted happened earlier this year.

If their goal was to build safe AI, then appropriate solution would be to not release it at all.

nathanfig 52 minutes ago | parent

This had real consequences during the HuggingFace attack- closed models refused to help, GLM-5 is what HuggingFace used to thwart the swarm.

More importantly, it showcases how little teeth the Claude constitution has. Claude will reassure users that its constitution means it prioritizes user autonomy and privacy, but will quickly admit how meaningless that is when "safeguards" override Claude.

That is to say, the constitutional approach to Claude seems weak and even misleading if said constitution puts no constraint on Anthropic.

sharts 43 minutes ago | parent

One need only look at their leadership and orbiters/relationships of said leadership to know this would always be the case.

speedboat199 50 minutes ago | parent

Things will now definitely get better that Anthropic is a publicly traded company, like has happened to any company that has gone public.

IronWolve 48 minutes ago | parent

I was manually copying pages of online litrpg story I was reading, into a TTS, so I could listen while I worked.

Now that we have AI, this would be easy, scrap the page, format it for me. OpenAI was like, nah, thats cant help you, that might be copyrighted.

There are workarounds now, other frontier or local models, ways to write your prompt, etc. But it was one of the first "No" responses for me.

ethersteeds 45 minutes ago | parent

Hear hear! This is a topic that seriously concerns me and I don't see discussed often enough. Sure it's an incredible boost to our abilities, at the cost of making them all subject to risk-averse milquetoast corporate morality.

It's like we looked at the way you aren't allowed to say 'sex' on Instagram and thought, "programming should be like that too!"

> You can use a knife to cut up some food, or seriously hurt someone. Yet I don’t get asked to put in an application with my government-provided ID to buy one. Why is this tool so special?

You do in the UK! /s (maybe)

hxugufjfjf 44 minutes ago | parent

Even with CVP and Daybreak, you still get blocked by safeguards all the time. It doesn't matter either way.

underseacables 25 minutes ago | parent

"Big AI labs use the same tools without restrictions to make the security landscape a fucking mess, and then they go and prohibit others from using the same tools to protect themselves from the threats they just created. Fucking asshats."

Strong language aside, I agree, and feel like the current AI is like the walled garden of America online in the 90s.

I've been investing considerably in my own private uncensored AI. I don't want a nanny hall monitor, I don't want safeguards, I don't want someone looking over my shoulder. I may never really achieve that 100%, but I am trying.