27 points gafferongames 4 hours ago 15 comments
27183 4 hours ago | parent
In other words: bias. Tons and tons of self-congratulatory, glue sniffing bias.
Mond_ 21 minutes ago | parent
> Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something.
sigalor 4 hours ago | parent
glenstein 4 hours ago | parent
That seems to me to be a natural progression, from discrete models to models that are just continuously improved. Maybe we'll end up with different models with different rates of improvement rather than static differences in performance, and methodologies for that improvement will be the thing we care about. Maybe over time, even benchmark tests will be primarily concerned with that kind of efficiency.
I think a huge debate right now is the relative value of the "frontier" models from Western companies at the cutting edge, vs distilled versions of those models that are good enough and exponentially cheaper coming from China. But a paradigm of 'always training' means an always active, always advancing frontier, which is a stronger moat than a one-off model that's more advanced for a few months.
Topology1 1 hour ago | parent
Ydarbleoj 1 hour ago | parent
weezing 1 hour ago | parent
firemelt 1 hour ago | parent
I like this one better
ealready_value 54 minutes ago | parent
reducesuffering 15 minutes ago | parent
HPsquared 13 minutes ago | parent
api 8 minutes ago | parent
It hasn't been a reliable predictive metric so far. All runaway growth tech sectors and businesses tend to look economically insane until they're not.
AlexErrant 14 minutes ago | parent
> There are swarms of insect-sized drones that can poison human infantry before they are even noticed; flocks of bird-sized drones to hunt the insects; new ICBM interceptors, and new, harder-to-intercept ICBMs. The rest of the world watches the buildup in horror, but it seems to have a momentum of its own.
Does anyone really predict insect drones _in production_ 2 years from now, to the degree that we need bird drones to hunt the insect drones? How the hell are these things powered?
Lean/math/millenienium prizes are "grindable" [0]. Wake me up when AI is making order-of-magnitude improvements in ungrindable real world tasks like batteries, hypersonic engine manufacturing, and stealth/silent motors that you can't hear.
api 7 minutes ago | parent
The Internet ended up being both more incredible and more mundane than predicted.
waffletower 50 seconds ago | parent