28 points fortran77 3 days ago 12 comments

Neywiny 2 days ago | parent

Wow. It can read bytes from a byte output? That's incredible

pier25 34 minutes ago | parent

I've suspected for years that AI companies have been using commercial software to train their models including games, audio plugings, DAWs, etc. It would not surprise me one bit if we find out they used torrented pirated apps like they did with books and music.

There's certainly eg open source audio dev material out there but not nearly as much as web dev. How else do you explain all the avalanche of vibe coded audio plugins and DAWs appearing this year?

riggsdk 22 minutes ago | parent

In that case it would be movie-plot worthy when the LLM was trained on all those embedded viruses and malware. "Believing" it is intentional and then start embedding it into all software it creates for us.

mixtureoftakes 19 minutes ago | parent

There is zero chance models are not trained on pirated media and games, especially most popular ones.

Makes complete sense to study things people actually want to use and consume

basilgohar 14 minutes ago | parent

I agree 100% with sentiment. It is inconceivable to me that models were not trained, either directly, or indirectly through other aggregates, on code and binaries and, of course, media, fetched from torrent or other filesharing sites.

petu 19 minutes ago | parent

> How else do you explain all the avalanche of vibe coded audio plugins and DAWs

By them being nothing special?

> appearing this year?

Vibe coding in general became viable last year, Opus 4.5 is Nov 24, 2025.

rhdunn 14 minutes ago | parent

It should be theoretically possible to use C/etc. source code, assembly output, and compiled output in the training set with equivalence mapping between them. That would make it possible for the LLM to learn disassembly and decompiling to some degree.

You don't need software for that aside from the compiler/linker tools (which are free for C/C++ compilers, rust, etc.). You can then permutate/generate the source code using tools/techniques like fuzzing.

There's also things like Intel's instruction set documentation.

xnx 5 minutes ago | parent

My hunch is that one of the handicaps Google is dealing with (vs. OpenAI and Anthropics) is that Google is not training on pirated media. They are using YouTube, Google book project scans, and purchased copies of media.

secondcoming 32 minutes ago | parent

I recently watched a video of a guy trying to unbrick his Harley Davidson Livewire electric motorbike. Harley Davidson were unable to do it. Perplexity created an app to sniff the canbus and talk to the battery and other components on the bike. Soon it'll be possible to write your own firmware for things like this.

[0] is the episode I'm referring to, but the whole series of videos about his woes with this bike are quite interesting.

[0] https://www.youtube.com/watch?v=Z4Ty0oqA_Bk

JKCalhoun 20 minutes ago | parent

An uninteresting case I am sure, but I have been leaning on LLMs to disassemble 6502 hex dumps and it's no doubt easy-lifting for them.

And the proof of course is that I can reassemble/link, with "modern" tools, their presented assembly and it combines right back into a hex dump mirroring the original.

Anyway, it's been a joy to take the long-out-of-print book, "The First Book of KIM", and re-typeset it (re-assemble it?) for modern hobbyists like myself. LLMs have allowed me to clean up the poor OCR-extracted text from the original. Claude has not only done that, but found missing labels and "equates" in the assembly, as legitimately printed in the book—not OCR errors.

Heck, Claude latched on to a bug in the classic "WUMPUS" game that apparently the author was not even aware of. (But I left that bug in for hobbyists to find—or exploit.)

layer8 11 minutes ago | parent

I wonder if prompt injection via an executable is possible. Especially in the context of having AI perform malware analysis.