YHK - yet another hacker news clone

OpenAI models are coming to Google Cloud

126 points armcat 6 hours ago 42 comments

nsagent 2 hours ago | parent

Gotta love the disclaimer at the bottom:

  Microsoft remains OpenAI’s primary cloud partner.

hobofan 1 hour ago | parent

Things that you only say because you are contractually forced to say them.

merelydev 1 hour ago | parent

Or don't want to crash stock price.

echelon 1 hour ago | parent

OpenAI buys from Azure because of the Microsoft investment deal.

OpenAI sells and reaches enterprise customers via GCP.

Enterprises want zero data retention guarantees and they're already on AWS or GCP, so this is how OpenAI reaches those customers and makes more money.

keerthiko 21 minutes ago | parent

isn't the largest portion of openAI's reach to (overwhelming cloud provider leader AWS) enterprise customers via amazon bedrock?

AndrewKemendo 1 hour ago | parent

We need a new acronym

Google, NVIDIA, OpenAI, MSFT…

GNOM…oh wait no

The strategy that I’ve heard said out loud now by all the major technology companies is “we’re all doing it (AI) together”

In my view this was more or less the political result of the White House summit

So I think we’re seeing what is basically going to be a giant amorphous set of collaborations such that nobody gets taken down, and the whole market doesn’t collapse

If Alphabet, OAI, MSFT, AMZ…etc all agree to be interoperable then they will be acting more or less as a single body in tension.

Whether that’s good or not is a question of your worldview but I think that’s the strategy

selimthegrim 1 hour ago | parent

This is like that SNL skit with Tim Meadows where Will Ferrell has the F on his shirt on the kids TV show and keeps getting in the inappropriate order

solyin 52 minutes ago | parent

Add in Meta (Muse app is a winner)

MOM-NG GNOMM NGMOM MGNOM MGMNO MGMON ONMGM NOMGM NOMMG

paxy 42 minutes ago | parent

Giant companies working together isn’t an AI-age phenomenon. Go back 10, 20, 30 years and you’ll see that despite the public perception of competitiveness all the largest tech companies (Apple, Microsoft, Google, Samsung, Amazon) buy/sell to each other, sign partnerships and have tight economic interdependencies.

AndrewKemendo 5 minutes ago | parent

Who said it’s new? :)

However if you look at the trust busting era what preceded it was this exact kind of private “cooperation” to prevent government involvement

simonw 27 minutes ago | parent

Add Anthropic and you get MANGO. MSFT, Anthropic, NVIDIA, Google, OpenAI.

AndrewKemendo 6 minutes ago | parent

Let’s go with Mango!

bananzamba 1 hour ago | parent

How are they trusting Google not to destill them

lrvick 1 hour ago | parent

Probably a very strict contract, and letting OpenAI read all the session logs like they do for their own customers.

aviinuo 1 hour ago | parent

Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live

binlog 1 hour ago | parent

Doesn’t really matter what happens at the GPU level when Google can see all API traffic.

worldsavior 1 hour ago | parent

Except google cloud doesn't use Nvidia GPUs but TPUs.

Mond_ 1 minute ago | parent

Google has both. Afaik we don't know whether OpenAI models will run on TPUs or GPUs here.

jayd16 29 minutes ago | parent

Isn't distillation more of a black box type affair?

zeroxfe 5 minutes ago | parent

Distillation does not require access to weights.

WarmWash 1 hour ago | parent

Google Cloud couldn't give a shit about Google Deepmind, and backdooring Clouds customers only stands to hurt Cloud.

dumberquestions 1 hour ago | parent

This is speculation, but funnily enough Gemini models show the least evidence of being distilled from OAI or Anthropic compared to everything else in the market.

BudaDude 33 minutes ago | parent

I feel this is correct. Google has probably the most data of any company in the world. For better or worse, they don't need to train on the outputs of other models.

binlog 1 hour ago | parent

Contracts and lawyers are more powerful than any technical tool.

amelius 30 minutes ago | parent

Yeah like the copyright lawyers of content owners that got their works trained on?

iamdelirium 1 hour ago | parent

GCP already hosts Anthropic models so probably trusts and lawyers.

tgma 42 minutes ago | parent

America is a high-trust society.

paxy 27 minutes ago | parent

More like - America is a high-litigation society.

amelius 31 minutes ago | parent

First answer this: How are they trusting OpenRouter not to distill them?

123haw 1 hour ago | parent

Preparing for Oracle bankruptcy.

cubefox 1 hour ago | parent

Is this the begging of the end of Gemini?

dgellow 1 hour ago | parent

No? Why would you think that’s the case? Gemini fills its own niche

iamdelirium 1 hour ago | parent

GCP has been hosting Anthropic models for a while.

cubefox 1 hour ago | parent

Google owns Anthropic stock.

tancop 58 minutes ago | parent

Why would it? The point of Gemini is provide user facing services cheaper than if they were paying OpenAI, make some money on the side with API credits and position themselves as a leader when investors want to see AI everywhere.

Google Cloud is competing with AWS. Amazon has Bedrock so Google needs to keep up with them by serving both Claude and GPT, along with Gemini and open models.

open592 1 hour ago | parent

I don't understand all the wild speculation and question here - openai is selling a shit ton of inference through third parties. these third parties want to provide inference to their customers who use gcp (and don't want to also inference through bedrock or azure ai foundary.

these are all zdr engagements and thus "enterprise" contracts.

basically it boils down to - anthropic already provides inference direct through GCP, Azure, and AWS - so to compete openai is doing the same.

lemonish97 26 minutes ago | parent

"OpenAI models will soon be available in the Gemini Agent"

They definitely need to have a better name if they're going to use 3p models

AznHisoka 24 minutes ago | parent

Does this mean OpenAI is going to use TPU now?

londons_explore 17 minutes ago | parent

> Enterprises with Google Cloud spend commitments will be able to draw down their GCP commitments for these purchases.

This is a fairly big move by Google... It means revenue they have already booked and reported to shareholders they now might have to give away - potentially all of it. Bean counters hate that!

game_the0ry 8 minutes ago | parent

Prediction: google cloud will pivot to being a hyperscaler versus a model + hyperscaler. Kind of like how xAI started hosting anthropic workloads with colossus cluster.

bc the alpha is not the model, the alpha is having the physical infra (chips, power, etc).

hackernudes 6 minutes ago | parent

But x.ai also hosts Grok? Why would google stop developing their own models? I think you're right that Google will try to make money from their infrastructure (that's basically what Google Cloud is too).

barumrho 6 minutes ago | parent

Is that a long term prediction? Are you saying that physical infra will always lag demand from here on?