28 points pramodbiligiri 2 days ago 22 comments
swiftcoder 2 days ago | parent
robbomacrae 2 days ago | parent
I've tried to benchmark them the most common public skills including those for ADLC (ie SuperPowers) couple of times here https://orcabot.com/benchmarks/agent-skills. Annoyingly I haven't been able to release one in a while because its been next to impossible to stop the new frontier models from cheating one way or another.
swiftcoder 2 days ago | parent
Yeah, I kind of figured. I was hoping was AWS-affiliated lab would be a little more rigorous
Throw12349067 2 days ago | parent
My assessment has been just use the native harness.
CharlieDigital 2 days ago | parent
Evals showed that speed and token use improved when it was removed.....
The models have improved and internalized some of these principles.
They still have value, IMO, because they help improve consistency (at the expense of speed and cost).
jiaosdjf 2 days ago | parent
I check every benchmark site weekly, compare harnesses and models, and its still pretty much just vibes
hersko 1 day ago | parent
bessbd 2 days ago | parent
> 14 agents: 11 domain experts, 2 reviewers, and an adaptive composer
wow, that's a lot of domain experts, I'm convinced
ernsheong 2 days ago | parent
imtringued 2 days ago | parent
daitangio 2 days ago | parent
https://github.com/daitangio/take-ai-control/tree/demo/nello...
branch demo/nello-openspec
themgt 2 days ago | parent
Sure, we could go to nine domain expert agents next, like the competition. That seems like the logical thing to do. After all, eight worked out pretty well, and nine is the next number after eight. So let’s play it safe. Let’s make a thicker sandbox, add some IOPS and call it the Bedrock9SuperTurbo. Why innovate when we can follow? Oh, I know why: Because we’re a business, that’s why!
You think it’s crazy? It is crazy. But I don’t give a shit. From now on, we’re the ones who have the edge in the multi-agent game. Is Devin the best a man can get? Fuck, no. Bedrock AI-DLC is the best a man can get.
Here’s the report from Engineering. Someone put it in the bathroom: I want to wipe my ass with it. They don’t tell me what to invent—I tell them. And I’m telling them to stick two more agents in there. I don’t care how. Make the agents so token efficient they’re invisible. Put some on an Alexa. I don’t care if they have to cram the fourteenth agent in perpendicular to the other ones, just do it!
alexjplant 1 day ago | parent
Earlier this year I spent considerable time making a six-agent multi-LLM configuration in OpenCode with a Bifrost multi-model router before just switching to OpenSpec and GLM-5.3 and calling it a day.
[1] https://theonion.com/fuck-everything-were-doing-five-blades-...
esafak 1 day ago | parent
hersko 1 day ago | parent
hn_explorer121 22 hours ago | parent