172 points gmays 15 hours ago 48 comments
Mashimo 14 hours ago | parent
minimaxir 14 hours ago | parent
https://reddit.com/r/StableDiffusion/comments/1x79gth/why/
https://reddit.com/r/StableDiffusion/comments/1x7ktbu/enshit...
I gave Flux 3 Klein my typical human test that has never failed on newer image models and it did fail; in addition to lower quality, the fingers were definitely not the correct proportions.
Whether the cause is due to more safeguards against NSFW content is hard to confirm technically; it was more an intuition back in the Stable Diffusion XL days but I suspect modern training paradigms are better at correlative inference.
tetraodonpuffer 14 hours ago | parent
minimaxir 14 hours ago | parent
dotancohen 3 hours ago | parent
https://github.com/black-forest-labs/flux-3-image-klein/blob...
dotancohen 3 hours ago | parent
swyx 11 hours ago | parent
badsectoracula 10 hours ago | parent
spottedmarley 13 hours ago | parent
vunderba 13 hours ago | parent
Flux 2 Klein 9b also had anatomical issues as well, but this one feels practically lobotomized.
echelon 10 hours ago | parent
What the heck are they doing?
Is this fast/cheap at the pareto frontier? Doesn't really work if humans look deformed.
vunderba 9 hours ago | parent
It’s bafflingly worse than other comparably sized ones: Qwen-Image 2.1 7B, Z-Image Turbo 6B which was released practically a year ago, even its own predecessor Flux 2 Klein 9b.
Even if we concede that the Klein variants are intended more as editor models, the results I've seen on Reddit aren't that impressive either.
I feel like they just handed their collective heads on a platter over to the team over at Krea especially since Krea 3 addresses the major limitation of Krea 2 which was strictly text-to-image only.
dannyw 8 hours ago | parent
Safetymaxxing at the expense of benign output quality is sad to see.
SV_BubbleTime 8 hours ago | parent
European edit model cannot make it easy to nudify people… they lobotomize it, it’s trash, Mission Accomplished!
Another reason that China is pulling ahead daily. They can leave in some anatomy and not knee cap their own product, leave in IP, and give away the model so as to undercut API/credit sales of US and EU models.
Finally… the Neo Puritan death march is having a direct financial toll.
viraptor 56 minutes ago | parent
ThrowawayTestr 12 hours ago | parent
beernet 11 hours ago | parent
CMay 8 hours ago | parent
At high resolutions, structural integrity on people can definitely fall apart like older models, where you get one person turning into a long spaghetti spanning across the frame. It might be that you need to do grounding by generating some kind of scene reference at its stable resolutions first then having it use that for the larger resolution like older models too.
They say that their prompt "upscaler" model or system prompt are essentially necessary for the model, but my results have been hit or miss with that claim. Some basic prompts are better, some upscaled prompts are better. I think that if you gain an intuition for how the model understands things, you might get better results by default by hand crafting prompts specifically for it.
Some of the stylized art I'm getting out of it at higher resolutions are really nice and I prefer them over other models.
All of these models seem to have their own character in terms of system requirements, performance, prompt adherence, artistic outputs and so on. None of the models I have tried are a complete homerun, so maybe in this case the model feels a little inconsistent in some ways, but it's a model I will probably keep around.
Aerroon 14 minutes ago | parent
jjcm 14 hours ago | parent
Still though, it's a lot like the porsche mission S vs the tesla roadster situation with the weights release. Moss Image dropped which looks far better at the moment, leading to a "why Flux?" question in the community.
I still think the edit capabilites are absolutely excellent, but for t2i I'd try out moss: https://huggingface.co/OpenMOSS-Team/MOSS-Image-Base/tree/ma...
I've been VERY impressed with Moss' design capabilites out of the box. Some samples:
https://image.non.io/9a32f732-668e-4fb3-bfef-13f0f40a0972.we...
https://image.non.io/8b5ee315-1ffd-4985-8ff0-d62e19d33f29.we...
https://image.non.io/5130501a-5c07-4635-82f5-fa64d60e8871.we...
IMO the taste is lacking, but it has some of the best text reproductions I've seen with their new VAE. Here's a type ramp example:
https://image.non.io/57246870-a245-4875-983f-993656e09e3d.we...
badsectoracula 9 hours ago | parent
vunderba 9 hours ago | parent
Annoyingly, the original Qwen-Image was actually Apache 2 before they switched over unfortunately.
In addition to Moss, Boogu Image 0.1 is a unified model which came out in June and is kind of being slept on right now, is actually pretty decent and falls under the Apache 2.0 license. It scored surprisingly high on my GenAI benchmark (comparable to Krea 2 and Ideogram 4).
badsectoracula 7 hours ago | parent
writtenone 14 hours ago | parent
kristofferR 13 hours ago | parent
soulofmischief 10 hours ago | parent
This example is a rough comparison to what actually happens, but it does attempt to demonstrate what compression and knowledge are, and how patterns, symmetries, and extrapolation/interpolation can make describing/modeling a complex system much more efficient.
Models can even go a step further, offloading entropy to the input. An efficient model exploits predictable structure; the remaining details can be expensive to compress further. The input can supply whatever additional information is necessary to produce the desired output within some margin of error. The information required depends on the model’s efficiency over a given domain, the structure of that domain, and the required precision of the output.
Consider generating an image of a pebble driveway. Most models today will generate a plausible arrangement of pebbles using their learned distributions. Reproducing a particular arrangement requires the input to convey the details that distinguish it from other plausible arrangements. The more closely you want to reproduce it, the more informative the input needs to be—potentially including a reference image of the arrangement itself.
This certainly raises a lot of open questions that are fun to pursue, such as the smallest possible model that can recover a complete description of our universe from minimal input.
qingcharles 6 hours ago | parent
accrual 13 hours ago | parent
Thorentis 12 hours ago | parent
SV_BubbleTime 8 hours ago | parent
api 12 hours ago | parent
Meanwhile a decent LLM that can do tool use and code and reason tends to weigh in at a minimum of 30B parameters, and you need over 100B to get good performance.
Do LLMs just contain more information or are diffusion models more efficient at compression?
I saw some work on language diffusion models a while back but I think they tend to have problems with reasoning versus transformer type models.
roenxi 12 hours ago | parent
The get a proper LLM they have to model all of human knowledge regarding patterns, physics, biology, social interaction, skills, history, etc, etc. For images they have to recall what a dog looks like in a still photo. The image models aren't even necessarily good at a wide range of novel situations; usually they get used for stock scenes.
Natural evolution has also had a much easier time coming up with vision models (everything with eyeballs) than complex language models (as far as we know only a smallish family of monkeys).
swyx 11 hours ago | parent
soulofmischief 8 hours ago | parent
Some of this understanding is in the input embeddings themselves, embedding models do a lot of heavy lifting behind image generation models.
I posit that you can theoretically achieve the same capability in a model trained on the right sequence of "images" as you can purely text; both are turned into embeddings and can ultimately convey the same exact relationships. I don't think it's very useful to try and create delineations between text and image inference, especially as more models move towards native multimodality.
swyx 3 hours ago | parent
look at any study of llm depth vs multihop reasoning capability (here, just to help https://www.latent.space/p/ainews-death-of-params-zai-ceo-ji... but theres a long line of others).
i will grant that people do do "reasoning in image models" type benchmarks, and it's not nothing, but its kid stuff vs what we make LLMs do, and the only way you get image models that basically do reasoning is you glom a diffusion head on an LLM backbone, which is basically gpt image 2.0 and above
none of which is to dispute the original question which is perhaps "why are image models so smol vs LLMs" - which i agree with and wish there were funding for scaling them - but the abject failure of sora indicates that perhaps our data isn't nearly good enough (again pointing to another thing - much easier to pretrain and posttrain LLMs given quantity of text data)
soulofmischief 3 hours ago | parent
soulofmischief 8 hours ago | parent
Any lossless text description of a given image would just be a structured text output of the exact pixel values, or an encoding that losslessly exploits regularities. Anything less is categorically lossy. An ordinary semantic description of a reasonably complex image will generally be lossy. A short, lossless text description would need to exploit regularities in the image, such as a solid-color image, or a basic pattern or sequence which is easily reproducible, such as a precisely specified checkerboard image.
And being able to represent images losslessly in text simply establishes text’s capacity to encode information. It doesn't establish an LLM’s holistic understanding of images. There is heavy lifting in the phrase “images are a subset.” An image can be almost any conceivable perceptual arrangement of data. The bounds are not clear. Maybe what you meant to suggest was that images of our natural world contain exploitable regularities.
> Natural evolution has also had a much easier time coming up with vision models (everything with eyeballs) than complex language models (as far as we know only a smallish family of monkeys).
It isn't appropriate to explain complex biological systems in terms of today's technologies. This is something people have been doing for a long time. The mind is like a a book, a loom, a camera, an engine, a computer, an LLM/vision model. Etc. The cognitive abilities required for an organism to meaningfully interpret its vision can possibly largely be the same cognitive abilities underlying speech, and all that is missing for a brain to exploit this might be sufficiently advanced vocal cords or manual dexterity; nothing to do with the brain itself, but its auxiliary organs.
ThrowawayTestr 12 hours ago | parent
soulofmischief 8 hours ago | parent
When you say "look the same", what do you mean?
I understand this was just a casual one-off comment, but as presented I'm having a hard time understanding what you're trying to convey and if you have appropriate domain knowledge: Your "looks the same" and my "looks the same" might be vastly different, especially depending on context.
gavmor 11 hours ago | parent
Then I considered whether the universe of imagery is simply smaller than the universe of ideas—which must, itself, include the universe of images, too.
But finally, I'm thinking maybe images are just harder to benchmark.
Or maybe they're _not_ actually worth 1,000 words.
schopra909 5 hours ago | parent
nodja 10 hours ago | parent
Image models are essentially a mapping of text embedding space -> image. So the clearer and cleaner the text embedding space is the better model you get as you need less weights trying to interpret a text prompt, recent image models even use multimodal versions of LLMs (Flux uses Qwen3 VL) so all the visual separation was done beforehand making the model even more efficient.
edit: Maybe a better analogy is that the image models are only half the model in a encoder-decoder sense, where the LLM is a pretrained frozen encoder and the image model is the decoder.
drusepth 11 hours ago | parent
This seems like a very competitive price for image models if it can compete on quality, no?
For example, Krea 3 released yesterday starting at $0.06/image.
invalidmonk 11 hours ago | parent
risphere 3 hours ago | parent
ionwake 1 hour ago | parent
How many man hours go into not allowing things that might break some law of offense? How many hours wasted trying to change the meaning of words and related punishments.
I mean it doesn't make sense to me in any form of efficient civilisation.