19 points algoth1 1 hour ago 2 comments
algoth1 1 hour ago | parent
Phillip has updated the leaderboard and surprisingly every new model release got substantially better, except for the OpenAi models. 6.2 Sol is 30th whereas 6.1 Sol is the 10th. Astra 6 is 9th, Astra 6.2 is 15th. By comparison Fable 5.2 became the 1st and Fable 5.1 is 7th. All the new google models, even hydrogen, are above the human baseline. By contrast, Astra 6 pro is the only openai model slightly above the human baseline at 8th place
bieganski 7 minutes ago | parent
I tried taking the test, but ultimately stopped at Question 4:
There are two sisters, Amy who always speaks mistruths and Sam who always lies.
:)