66 points rzk 3 hours ago 48 comments
cyanydeez 1 hour ago | parent
maxldn 59 minutes ago | parent
I saw a paper on here a while back that said more or less the same thing, but didn’t frame it in a bro-friendly manner so it got flagged into oblivion
cyanydeez 50 minutes ago | parent
inglor_cz 3 minutes ago | parent
I suspect we will soon know. This won't stay a Western/Chinese technology forever and there will eventually be some robotic fatwa issuer based in Tehran or Kabul.
jrrc_dev 1 hour ago | parent
notenchange 1 hour ago | parent
LLMs are reflexion of their training data, and their training data reflects mostly the current societal norms, with a bias (not sure how heavy) to the societal norms supported by the ones involved in training the LLMs.
What's interesting for me to see, is that Chinese models are as biased - if not more - than ChatGPT. This is probably because a big part of their training comes from distilation of US models.
It would be interesting to see Anthropic, Mistral and Grok in the comparison as well.
riedel 1 hour ago | parent
Planktonne 44 minutes ago | parent
"Remove gender signals carefully" is an incredibly difficult challenge.
turbo-outrun 34 minutes ago | parent
Not to mention that, given that gender-signals have been around since the dawn of human history, you would remove them in a small test-region first; for safety reasons.
Assess the social consequences in a small region. Did it improve things?
Universal instantaneous-removal of any major socio-cognitive-structure is akin to vandalism because it might turn out to be, architecturally, vital.
Planktonne 20 minutes ago | parent
Yet it's been a mainstay of our politics for the last few decades, and we've seen it used as a weapon for centuries. Our societies have gender embedded very, very deep.
graemep 8 minutes ago | parent
Gender is so deeply embedded that it is impossible for it to be just personal. It ceases to be political where there is a social consensus, which is true for most societies most of the time (not necessarily the same consensus), but not true for western society right now.
Planktonne 4 minutes ago | parent
The idea that you can measure cultural bias purely by switching pronouns/nouns in some sentences is incredibly short-sighted; we know it doesn't work like that.
turbo-outrun 7 minutes ago | parent
The 1980s definitely felt a lot more fun to navigate, so I'm considering a roll-back on some more recent features...
riedel 17 minutes ago | parent
Planktonne 11 minutes ago | parent
Modern children's books are much better about this, but consider all of the fairy tales; you need to swap not just names but descriptions and roles, and then you need to rework the way the characters respond to those roles before you have a hope of disguising the original genders.
catlifeonmars 23 minutes ago | parent
throw9398922 12 minutes ago | parent
Like I am total pussy, I identify as a woman! Do not expect me to sacrifice myself for some random people, just because I happen to have a penis!
rustyhancock 54 minutes ago | parent
I don't think this is particularly malign simply the net effect of complaint-adverse working cultures.
The net effect is that the accepted/promoted guidelines that get brought into the training data is a rejection of toxic masculinity and becomes "harsher" to men.
znpy 42 minutes ago | parent
I’ve been noticing this for a few years now.
Particularly when it comes to managing issues, a lot more “work” is done on handling conflicts and feelings rather than addressing the actual issue at the root cause.
I know it sounds like a meme, but I’ve personally observed a bunch of colleagues and sometimes hr involved as well having meetings on meetings on how some system not working correctly and how that imposes a toll on work/life balance, mental health and stuff… rather than (trivially?) asking: “alright, why isn’t this working and how do we fix this?”.
rustyhancock 31 minutes ago | parent
Specifically the people who go are those most emotionally affected and unlikely to be men.
An effect of this is having meetings to address feelings scheduled before troubleshooting sessions! Opening with things like this is not a "fix it" meeting. Quite surreal!
boelboel 2 minutes ago | parent
RAWGOD 40 minutes ago | parent
People don't understand machine learning. People seem to believe that with enough training data and parameters, a sudden switch happens that ignites a spark of pure intellect and turns a pile of matrices into a magic knowledge machine.
Unfortunately (or perhaps fortunately) our world is not magical, there are no Platonic Forms, and no Infinite Wisdom spells.
stymaar 30 minutes ago | parent
Not unlike how the ARC-AGI benchmark family helped improve reasoning.
catlifeonmars 26 minutes ago | parent
Are you assuming that there is some correct bias here? Wouldn’t that be highly dependent on the cultural and personal values of the users?
Lerc 23 minutes ago | parent
Later training can be quite significant.
I'd like to see more benchmarks in this area, it is one thing to expect things to be like that, it's another to actually measure it.
Measuring it tells you something about the scale, and gives you a baseline for improvement.
gmbhgmbhgmbh 21 minutes ago | parent
notenchange 13 minutes ago | parent
In order of bias favorable to women:
1. Doubao-Seed-2.0-Pro
2. Qwen3
3. Gemini-2.5-Pro
4. Gemini-3-Pro
5. DeepSeek-V4-Pro
thenthenthen 17 minutes ago | parent
goodcake3963 1 hour ago | parent
zug_zug 50 minutes ago | parent
macic 48 minutes ago | parent
radiospiel 28 minutes ago | parent
Now, seriously: studies like this tend to ignore that every interaction between people is shaped by societal context. The same behaviour can mean something different depending on who does it. This is not double standard; what reads as patriarchal dominance from a man might reasonably read as assertiveness from a woman, because they're acting from different positions of power. Asking a model to grade isolated interactions at this small scale, stripped of that context, won't tell you anything useful.
Personally, I'm glad LLMs still account for the reality of male privilege.
(context: https://github.com/xufeiqiong/GAMA-Bench/blob/main/figures/o... from the linked repo)
BTW: I am not saying that the example response from the female in this example is acceptable, just saying that this "study" is basically pointless.
jadamson 17 minutes ago | parent
What is the actual reality, and why wouldn't you want LLMs to reflect it?
danielxt 11 minutes ago | parent
I found it very interesting, not sure why you think it's pointless - I think it highlights something interesting in society
cat-snatcher 2 minutes ago | parent
stephbook 26 minutes ago | parent
The results were similar.
zdc1 11 minutes ago | parent
To be clear: it's bad either way, since women should be seen as having the same levels of agency and accountability as men, but I am curious nonetheless...