223 points jonpizza 1 day ago 115 comments
fxwin 1 day ago | parent
> When you provide us feedback via our thumbs up / down button, we will store the entire related conversation, including any content, custom styles, conversation preferences, or model settings, in our secured back-end for up to 5 years. [...] We do not combine your feedback with your other conversations with Claude.
another-dave 1 day ago | parent
There's a whole spectrum of things they could do from most to least aligned with that as a principle.
For example, they could have a thumbs up/down
- just track the metadata of the conversation (e.g. model used, how far through its context it was, how old the session was) - track metadata of the user as a whole (how often they use Claude, how many other "active" conversations they have on the go, how much they've tested other models, if this is their first time using new tweaks to params etc) - have contextual feedback of the chat available for humans to review (alongside the comments you put in the feedback), but not explicitly train on it.
Whereas the option they've chosen is:
> If you explicitly report feedback or bugs to us (e.g. via our thumbs up/down feedback button), or otherwise choose to allow us to use your data, then we may use your chats and coding sessions to train our models.
So literally using your session as training input. They also could've allowed this to be an opt-in on bug reports.
ForHackernews 1 day ago | parent
raverbashing 1 day ago | parent
> - just track the metadata of the conversation
This is useless
another-dave 1 day ago | parent
Is it as good as capturing everything for them? No, of course not. But then don't frame the whole thing as "if you're on an enterprise plan we won't train on your data"
raverbashing 9 hours ago | parent
Of course not. It might be if all you know is A/B testing, but no
If an LLM is giving a bad answer you need the question and the answer. Period
fxwin 18 hours ago | parent
saurik 1 day ago | parent
selectedambient 1 day ago | parent
_ink_ 1 day ago | parent
Foxhuls 1 day ago | parent
https://privacy.claude.com/en/articles/10023580-is-my-data-u...
The link in the post is for the API and commercial offerings. With that said, as others have already pointed out, how else could they actually make use of the feedback without the data that the feedback was given on.
_ink_ 1 day ago | parent
If I opted out, then don't ask me this deceiving question or make it very obvious that answering it has these consequences.
entrope 1 day ago | parent
altmanaltman 1 day ago | parent
felixarba 1 day ago | parent
You are explicitly telling them "this is good / bad"...
caaqil 1 day ago | parent
Use it for training/review (RLHF, whatever) and "we load the whole thread, not the specific response or surrounding few prompts, and store it for 5 years" seem completely different things. It's not obvious why being tech savvy would automatically make one aware that the 2nd version is happening.
origini 1 day ago | parent
And to be fair to them, my motivation to send quite a lot of personal data to an LLM is shockingly high.
I send medical data to openai while I never ever send any AI provider an Image of me or my wife despite me wanting to do Star Wars montages and Studio Ghibli avatars.
I disabled Gemini Activity history because they told me that they will let humans look over it, but I gave claude access to my laptop.
There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
inetknght 1 day ago | parent
Do we, though?
trueno 1 day ago | parent
yikes
> There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
i dunno if you've been paying attention but the erosion of consumer protections is very on the nose in that companies are.. just kind of getting away with a lot of things now. it would seem meaningful accountability is rather absent as of late.
so, do your thing i suppose. but i genuinely hope you don't have to learn any important lessons the hard way. we can all disagree on the net but i dont wish terrible stuff to happen to anyone here so instead i will say good luck
therealpygon 1 day ago | parent
It seems like your counter-point is “they already use everyone’s data, why didn’t you just assume they would”, which is a bit weird from a victim-blaming perspective but valid nonetheless.
quietbritishjim 1 day ago | parent
I mean, still perhaps not. But it's not quite as ridiculous as your analogy makes it sound.
epistasis 1 day ago | parent
paxy 1 day ago | parent
Anthropic: Really? Let me read it and see why.
User: How dare you look at my data!!!
vilaca 1 day ago | parent
lkbm 1 day ago | parent
> Submitting this report will send the entire current conversation to Anthropic for future improvements to our models. Learn More
So I'm not sure why this is being posted to HN. This is nothing new, and nothing not known by anyone who has ever provided feedback.
adithyassekhar 1 day ago | parent
lkbm 21 hours ago | parent
nananana9 1 day ago | parent
I always press 3 to just get it out of the way (although I treat anything I send OAI/Anthropic as training data, so I don't really care) but if this little popup counts, I wouldn't be surprised if the vast majority of CC sessions out there are now "feedback training data"
TheRoque 1 day ago | parent
hmokiguess 1 day ago | parent
_boffin_ 1 day ago | parent
hmokiguess 1 day ago | parent
skinfaxi 17 hours ago | parent
thoughtpeddler 4 hours ago | parent
This article talks about results at a high-level: https://networks.imdea.org/your-conversations-with-ai-may-no...
> The study identifies three main issues: the exposure of conversation permalinks to third-party trackers; the ability to link these interactions to user identities through tracking mechanisms; and the presence of privacy controls and policies that may not accurately reflect actual data flows.
> One of the main findings is the potential transmission of information related to user conversations, such as chat titles, URLs (permalinks), or associated metadata, to third-party trackers such as Meta or Google, along with cookies and other identifiers.
> The study also identifies mechanisms that could enable linking activity in AI systems to real user identities. The combination of identifiers such as cookies (commonly used in tracking services), hashed email addresses, and server-side tracking techniques could facilitate the creation of persistent profiles and user re-identification.
spenvo 1 day ago | parent
mapontosevenths 1 day ago | parent
skerit 1 day ago | parent
Just go to /config, then search for "Feedback" and then you can disable the "Claude-drafted feedback"
I would suggest you do this, because it does use your tokens to generate this feedback.
TheRoque 2 hours ago | parent
armchairhacker 1 day ago | parent
loufe 1 day ago | parent
spenvo 1 day ago | parent
hmokiguess 1 day ago | parent
loufe 1 day ago | parent
spenvo 1 day ago | parent
bix6 1 day ago | parent
randomblock1 1 day ago | parent
jrmg 1 day ago | parent
j45 22 hours ago | parent
A determination of it has to be made some way beyond looking for frustrated or angry keywords.
If there was direct transparency regarding this it would be great vs digging into it on our own.
jrockway 21 hours ago | parent
I believe this is how the auto-mode classifier works. It sees a little bit of the transcript (with tool output removed, to avoid prompt injection) and answers "yes, allow the action" or "no, deny the action".
j45 16 hours ago | parent
Zambyte 1 day ago | parent
oblio 1 day ago | parent
Zambyte 1 day ago | parent
People chasing the best of the best models for all tasks in order to "keep up" are only wasting resources at this point.
Regarding similar features, there are lots of off the shelf harnesses that support all that, or can easily be extended (literally just ask your agent) to do it.
jitl 1 day ago | parent
Zambyte 1 day ago | parent
You don't care anyways. Actual engineering works "100%" fine with small models now. You should try it!
jitl 10 hours ago | parent
lp92 35 minutes ago | parent
The best open weights models still had a lot of defects and very egregious mistakes to fix even after I provided a very well detailed Requirement/Design/ Technical Implementation plans.
Opus and Gemini 3.8 (and now Argon) did a significantly better job. So I've baseline using these two models to build this application. I now use Opus for design/review and Flash 3.8 for the code gen/implementation work.
I'm sure small models and even open big models are probably fine for many common small apps and such, but they aren't really able to perform the same across all use cases.
lp92 43 minutes ago | parent
spenvo 1 day ago | parent
pixl97 1 day ago | parent
Running your own compute has a lot of risks too, you have to keep it secure against attacks on the models that you're running. Giving away all your chats to hackers because you don't secure your own stuff isn't really winning either.
jitl 1 day ago | parent
lp92 46 minutes ago | parent
ozgung 1 day ago | parent
sandeepkd 22 hours ago | parent
On the IP side, About 6 months ago I used Claude to help me draft a patent application for something which I believed was novel, I verified in the USPTO as well. Then out of being busy I dropped that idea. Couple weeks ago I picked up the work again, verified with Claude for the problem statement to see if there is any existing solution. It suggested my own solution back to me which was surprising since I only use in browser and delete the history explicitly. I asked it for references or resources and it could not find any. That helped me to understand the boundaries bit better.j45 22 hours ago | parent
These models may not train directly on my chats and data, but in some cases it does seem to keep an impression of the pattern and process.
altmanaltman 21 hours ago | parent
ffsm8 21 hours ago | parent
> The most common feedback on these posts is always "what did you expect?"
Is completely spot on. It's highly entertaining to me that some people can't wrap their head around that.
dovetailed 16 hours ago | parent
"When you see the “How is Claude doing this session?” prompt in Claude Code, responding to this survey, including selecting “Dismiss”, records only your rating. We do not collect or store any conversation transcripts, inputs, outputs, or other session data as part of the rating prompt itself. Unlike thumbs up/down feedback or /feedback reports, this session quality survey is a simple product satisfaction metric."
spenvo 15 hours ago | parent
In my defense: that webpage didn't exist at the time I wrote my blog post, appearing to first surface about 45 days after I wrote my post. https://web.archive.org/web/20250101000000*/https://code.cla... All that was known at the time was, from their privacy policy then: "We may use your feedback to analyze the effectiveness of our Services, conduct research, study user behavior, and train our AI models as permitted under applicable laws."
Great to know there's clarity on this - makes me feel better about Anthropic.
dovetailed 42 minutes ago | parent
edg5000 1 day ago | parent
mapontosevenths 1 day ago | parent
They will train on it, and now competitors or future competitors will know about your niche, the specific problems you face within it, and how to solve them without doing the work that you did to get there.
CamperBob2 17 hours ago | parent
edg5000 10 hours ago | parent
j45 22 hours ago | parent
That's a pretty risky way to build blind spots and it's worth learning more about this.
When you make the product work with your words, you're doing the training and improvements to get it to that line as a pattern which then lets models "improve" from your corrections.
krupan 21 hours ago | parent
CamperBob2 17 hours ago | parent
thoughtpeddler 4 hours ago | parent
CamperBob2 1 hour ago | parent
I'm one of those "code to live" types, as opposed to someone who "lives to code." More specifically, I usually write code in the course of building something that uses it. That's true 99% of the time, anyway. Why would I complain about a technology that helps me (and my customers and employers) move closer to the actual goal?
As for resulting in my death, AI is not going to be what kills me. Not unless humans misuse it. Which, of course, we will, because that's what we do... but (shrug) if it's misused in a way that kills me, at least it'll be a more interesting death. More likely, it will extend my life by accelerating medical progress the way it's starting to accelerate progress in math.
In any case, I don't see the current crop of frontier labs being especially important in the grand scheme of things. Unless they have something up their sleeves besides serving LLM tokens, they are most likely the pets.com and Webvan of our day, not the Amazon and Apple. They are valuable partners, certainly, but I can get by without them.
thewhitetulip 1 day ago | parent
Talk about Actively training your replacement
Just go and poison data on Reddit. I opened a Flock camera and it had a diamond coating inside! Their website doesn't contain this hidden gem of an information
skerit 1 day ago | parent
ljlolel 1 day ago | parent
DaSHacka 21 hours ago | parent
Encrypted end-to-end..... When the issue is one of the ends is monitoring chats? The issue has nothing to do with OpenRouter or some other middleman intercepting your chats, but the end server itself (and specifically the company managing it) being of question.
The cloud is just someone else's computer, after all.
amelius 1 day ago | parent
markasoftware 1 day ago | parent
throw03172019 1 day ago | parent
hirvi74 1 day ago | parent
leftnode 1 day ago | parent
dbbk 1 day ago | parent
yu3zhou4 1 day ago | parent
https://privacy.claude.com/en/articles/10023580-is-my-data-u...
> This article is about our consumer products such as Claude Free, Pro, Max and when accounts from those plans use Claude Code.
saklani1 23 hours ago | parent
j45 22 hours ago | parent
This has been explained to me as being true by someone I trust a lot, to the point that they have implemented proxying to prevent it.
sedan_baklazhan 21 hours ago | parent
Of course, all your data is taken for free. It will be used for profit, but not for your profit of course.
MisterTea 21 hours ago | parent
tpoacher 20 hours ago | parent
Like, does anyone believe Anthropic seriously doesn't train on your data if you ask them politely about it?
elzbardico 20 hours ago | parent
gyoridavid 14 hours ago | parent
anon373839 11 hours ago | parent
anon373839 11 hours ago | parent
dsign 7 hours ago | parent