58 points makeramen 3 hours ago 15 comments

throwaway27448 43 minutes ago | parent

Technical details aside, this volume is ridiculous. How on earth do they see this kind of "growth" as an asset and not a liability?

rogerrogerr 37 minutes ago | parent

This is obviously just a response to https://www.anthropic.com/research/redesigning-source-contro.... Probably no one in the chain of writing this even thought about your question.

ralph84 25 minutes ago | parent

Because this kind of growth is how they get to RSI.

wilkystyle 12 minutes ago | parent

Whereas previously, creating this amount of code by hand would simply result in RSI.

warkdarrior 17 minutes ago | parent

> Technical details aside, this volume is ridiculous. How on earth do they see this kind of "growth" as an asset and not a liability?

That coding volume is a liability only for human engineers, with their limited memory, short attention span, tiredness, and quirky coding preferences. LLMs don't have any of those problems.

throwaway27448 11 minutes ago | parent

Sure, but you also don't know what your LLM is doing without running into these same limitations. So how is this an improvement?

mrbungie 2 minutes ago | parent

Not necessarily. High LoC software might be a bad design smell (without a counterfactual for the same level of functionality is might not easy to tell though). Badly designed code entering an agent context is always a liability, because it contaminates decisions down the road.

ctkhn 16 minutes ago | parent

Instead of keeping it simple, they decided to go stupid.

vatsachak 37 minutes ago | parent

Impressive. We're definitely seeing LLMs help create real novel software

paxy 36 minutes ago | parent

While I don't have any particular interest in the topic this is a great blog post. No AI in every second line, no needless marketing or hype. Just a bunch of engineers talking in their own voice about a topic in great detail with numbers, charts, visualizations.

bigmadshoe 14 minutes ago | parent

Can anyone explain to me what this massive volume of code could actually be doing? They obviously have variations of model architectures, training infrastructure, serving infrastructure, and the source for their apps.

Why would the volume that any of this be increasing exponentially? And what are all the engineers doing when (besides the model quality) their products don't seem to be changing very much?

Mateo781201 11 minutes ago | parent

Maybe it could be faking code and ai usage?

I've seen it on other workplaces, but from what I see from open ai and anthropic, the code shouldn't be as extended.

But maybe I'm crazy lol

7e 11 minutes ago | parent

It's AI slop. AI coding agents write much more voluminous code, in my experience. The base code is more expansive, and there are more tests, and there are many, many more commits as you keep fixing and fixing and fixing over and over and over.

O5vYtytb 8 minutes ago | parent

At some point I imagine they will be writing their own software for the entire training and inference stack. Kernels, libraries, why not? With compute so constrained it must be beneficial to optimize everything as much as possible

firemelt 4 minutes ago | parent

lol nice try openai but its shallow and too late