Yet another Hacker News

Gemini Decisions API

73 points iamdelirium 2 hours ago 12 comments

iamdelirium 2 hours ago | parent

Looks like Google announced their own Jev inspired API and model

dude250711 53 minutes ago | parent

It was a hot topic 2 months ago.

waximabbax 2 hours ago | parent

Its bit more expensive than other other Decision Models in the same lane.

However, it can accept Audio and Video as input as well and for those specific cases it can be extremely useful.

florkbork 47 minutes ago | parent

Meanwhile, they are suffocating Jules today (https://killedbygoogle.com/) with a metaphorical pillow to the face and no migration path mapped out for casual users apart from "use antigravity" in a 1 line high banner; after about a year of existence.

It seems unlikely this will be around in 6 months at this rate.

Catloafdev 32 minutes ago | parent

That doesn't make any sense, this is a Jev competitor and a model release, like their Carbon and Argon models. It won't simply be 'killed' like apps might without something to succeed it.

kasperset 27 minutes ago | parent

Barring Search, Gmail, and YouTube I am really wary of using anything from Google now.

IncreasePosts 40 minutes ago | parent

It took OpenAI 2 weeks after Jev to release a decision end point, and now google does it 2 months later. Why such a difference? Bureaucracy? Quality control?

iamdelirium 4 minutes ago | parent

Looking at their benchmarks, it's actually a better model than OpenAI and Jev (which in the same evals is worst than Jev?).

eminence32 28 minutes ago | parent

I'm sort of surprised it took Jev for everyone to realize "oh yeah, this is a useful thing that we should have in our product portfolio".

But maybe this is one of those things that's only obvious in retrospect? I'm sure people were trying something similar years ago with grammar-constrained outputs (for example to only output a simple json structure), but you can't get probabilities out of the model that way. Which makes me wonder: how do these models calculate probabilities?

NitpickLawyer 4 minutes ago | parent

You can do it with LLMs by looking at the logprobs of ('yes', 'Yes', 'YES'...) vs. ('no'...). This works for bool or whatever they call it in jev space nool I think?

You can do it manually or use ready made libs. I know there's one in python on top of vllm that can do something like this.

kaycebasques 17 minutes ago | parent

API docs: https://aistudio.google.com/docs/decisions-api

pratzc07 14 minutes ago | parent

So is it over for Jev now that the big boys are in the game