172 points theanonymousone 2 hours ago 39 comments

Onavo 1 hour ago | parent

Performance charts and benchmarks are here:

https://www.reddit.com/r/DeepSeek/comments/1x84wke/deepseek_...

randomblock1 1 hour ago | parent

risphere 1 hour ago | parent

The native web search api is 10x cheaper than OpenAIs. I hope they will release the web search api as a standalone API.

alex-moon 1 hour ago | parent

I may be missing something so apologies if I'm telling you something you already know but: there are plenty of web search APIs for agents - the Brave one is the one I use: https://brave.com/search/api/

mmmmbbbhb 1 hour ago | parent

Tavily one is free, too. Easy to use cli with a skill.

ytxm 45 minutes ago | parent

I gave it a kick and got mixed results. For example, searching for a Microsoft product couldn't find its landing page, and searching for a niche open source package landed in the Debian repos for the top hits, but the home page was in the first 10 hits.

Lovely to see they're doing their own search though, I love how many folk are actively working on search clones at the moment.

hmontazeri 1 hour ago | parent

My favorite model just got better. Gotta love what deepseek is doing

olavgg 1 hour ago | parent

I really like the having DeepSeek Flash + Opus 5.5 as advisor/reviewer at the moment. I run through a $200 Claude Code subscription in less than 24 hours now just for a single project, and I hate fiddling with different accounts every day. Now that I get a 200 USD api credits inlcuded with the subscriptions I have rewritten my coding agent workflow completely.

rpastuszak 55 minutes ago | parent

> I run through a $200 Claude Code subscription in less than 24 hours now just for a single project

How?

fahrvrgnugen 50 minutes ago | parent

Loading tons of MCPs and never compacting

hugodan 43 minutes ago | parent

not reviewing its ongoing work and spawning subagents that end up looping each other

ramigb 42 minutes ago | parent

I swear I have the same question in my head always when I read such statements! I have never once reached 90% that includes everyday usage across multiple repos, artefact generation, device debugging, long running harness work!

I am not saying OP is not telling the truth. I just really want to understand!

pheggs 32 minutes ago | parent

in my experience there's a huge difference in token usage when creating new projects versus working on existing ones

olavgg 35 minutes ago | parent

Its easy when you spawn a couple of subagents in a homelab with a rack with 5+ servers.

This is how one of my claude code session looks like right now, one prompt from yesterday:

  ◯ lean-tracks  ▰▰▰▰▰▰▰▰▰▰▰▱▱▱▱▱▱▱▱▱  7/12 · 18h35m · ↓ 3.1m tokens
  ◯ lean-tracks  ▰▰▰▰▰▰▰▰▰▰▰▰▱▱▱▱▱▱▱▱  6/10 · 17h47m · ↓ 2.6m tokens
  ◯ lean-tracks  ▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱  0/1 · 4h49m · ↓ 275.9k tokens
  ◯ lean-tracks  ▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱  0/1 · 4h30m · ↓ 395.0k tokens
 ◯ lean-tracks  ▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱▱  0/1 · 3h50m · ↓ 490.3k tokens

imdsm 26 minutes ago | parent

Not sure if this will help you but it helped me. I was using subagents and workflows for lots of long running tasks, and part of that work included running tests. If tests took longer than 5 minutes, the cache expired, and the whole thing was then being processed as uncached input.

I created a skill to better manage agents, including a way to keep the caches valid, and it has decreased my usage considerably. I now struggle to use my 100% each week and I hit claude hard. I have a reset expiring in 5 days and I'm trying to burn down the tokens (68% with 3d 8h left) quickly so I can use my reset before it expires.

Token efficiency just means understanding the way the system works. Best person to help with that... my old friend claude.

olavgg 23 minutes ago | parent

Yeah, I should see if I can create a similar skill. The tests do spend some time to complete.

Claude: Confirmed: 195M of the 212M cache tokens (92%) come from full re-writes after 5+ minute gaps, accounting for 77% of relative cost. Now I'll check the existing wrappers so the skill builds on them.

raylad 23 minutes ago | parent

How do you keep the caches valid?

j45 15 minutes ago | parent

Ask Claude, it's pretty wild to see.

iamflimflam1 13 minutes ago | parent

Some to think about with both Claude and skills.

Can you invert things. What’s deterministic and what needs “thinking”?

Can you create a script that runs things chaining together the deterministic parts with calling out to Claude for glue that needs “thinking”.

nextaccountic 3 minutes ago | parent

> including a way to keep the caches valid

Maybe doing bogus small requests to prevent the cache from expiring?

I mean in the API you can set the cache expiration time right? But I guess claude code can't do this

TomGarden 34 minutes ago | parent

Not OP, but I used to run out in a few days, for me it was a matter of suboptimal code review practices with many subagents looking at different aspects, often expanded to look at more than the diff.

monster_truck 25 minutes ago | parent

I can drain a $200 OAI plan in 2 hours flat working on my 10 projects simultaneously.

Maybe you're not being ambitious enough with these things? They are at their most fun when you spec out sprawling architecture documents and watch 1+8 astras buzzsaw through it.

I'm only at 260B for the year, though. I'm sure someone who has used more will be along shortly to chime in

E: The other subthread talking about tests is correct. Expensive models should not waste a single second waiting on tests or validation. If you cannot assign a single cheap model to be the test bitch, then just tell them to frontload everything and clean up later as a single wave.

ricardobayes 24 minutes ago | parent

Not meant as a bad faith response but have you shipped anything? Do you have income from this? Why 10 projects apart from fueling ADHD and "never finishing a project"?

tedk-42 11 minutes ago | parent

Some of us want to build and don't care that it doesn't monetise.

joshstrange 8 minutes ago | parent

Not OP and while I’m not draining my accounts in a single day/hour, I’m hitting limits with a $200-Claude and $100-OpenAI account.

> Have you shipping anything?

Yes, hundreds of PRs and shipped new features to 3 different platforms (day job and 2 side-business apps/platforms I’ve been developing for many years, pre-LLM). Those new features have gone out to customers and been used.

> Do you have income from this?

Well my day job for one, and I’ve been able to more easily sell to new clients with my side business. Without the changes I’ve shipped I would have been able to land a couple of the clients I’ve signed on recently.

I don’t think OP’s message implied they are never finishing a project, maybe they edited it?

In addition to the 3 income-generating projects, I have a number of other “just for me” projects. Some are mature now and only need occasional development when I want a new feature. Some are in flux as I build them out (like my “software factory”).

At this point I’m limited by compute and tokens more than anything else.

loveparade 7 minutes ago | parent

Would love to see these 10 projects that are being worked on simultaneously

thomasmarcelis 50 minutes ago | parent

Interesting, coming from a similar situation, I'm interested what workflow you landed on. Opus planning + available to be called for deep thinking + opus reviwer? or?

nickludlam 1 hour ago | parent

This and (the not quite yet open) Kimi K2.8 are my main coding engines, and I find them incredibly cost efficient. I find Deepseek in particular is really good with Svelte work.

Right now I use each of them in their own respective coding harnesses, deepseek-harness and kimi-code, but I do wonder what they are like inside something like opencode.

epolanski 35 minutes ago | parent

Is it already updated to the newest version on Opencode?

epolanski 32 minutes ago | parent

By far my favorite model.

At the beginning of the month I realized I had more tokens and more capabilities on Opencode at 8$/month via DS 4.1 flash, than I had on a 200$ account in June with the american providers.

Literally both more tokens and capabilities than Opus 4.8/GPT 5.5.

Even if you pay per token, you're still unlikely to outspend american providers.

gregwebs 22 minutes ago | parent

The company's own news page: https://api-docs.deepseek.com/news/news261017

They are showing this new version scoring significantly higher across multiple coding benchmarks, beating Sol 5.6 (6.1 is the latest) across 10/11 benchmarks.

OsrsNeedsf2P 18 minutes ago | parent

DS isn't better than Sol and Gemini in the benchmarks, but after working with them all for a while now I'm beginning to understand why people find DS _feels_ so much better.

First, it's the tok/s and TTFT from providers. Deepseek blazes through work - at quite good quality - and you don't find yourself waiting for your agents to finish.

Second is the openness. Being able to see the CoT and not being randomly blocked for cyber review. You're never wondering if it's stuck or if it will randomly fail. Combined with the great cost value.. My next subscription will probably be Z.ai

Oxodao 14 minutes ago | parent

also it's cheap, using it in opencode is great

MangoCoffee 10 minutes ago | parent

Deepseek and Muse are my go to for cheap. both work perfect for basic and mid tier tasks

nextaccountic 4 minutes ago | parent

What about mimo v2.6 pro?

petu 9 minutes ago | parent

Is that a dig on DeepSeek not offering subscription plans?

If so OpenCode Go looks good and includes DeepSeek models (yet to try myself).

Philip-J-Fry 1 minute ago | parent

Feels better to me in the sense that it doesn't try to be too clever. When I ask it to do things it actually generates code that a developer would write. That still lets me build software in layers like I do mentally. And it keeps you in control of where abstractions are.

Some people would say that you don't need this at all with the frontier llms. But when extending existing software or writing software that fits into an existing ecosystem, I find I still need to offer a lot of guidance. And it's better that the context window isn't flooded with code that was reverted after I looked at it.

AmazingTurtle 4 minutes ago | parent

so i did some apples to bananas comparison.

i let 4 different agents review the same dirty code base (200+ files changed, c++, game engine):

- deepseek v4.1 flash via deepseek API: took 20m to find one p1 issue that was relevant and a p2 issue that was irrelevant

- glm 5.3 flash NVFP4 via TP2 DGX Sparks: took 1h 5m to find a p3 documentation issue

- gpt 5.6 sol: took 5m30s for one p1 and one p2 issue. both relevant

- gpt 6.1 sol: took 4m30s for two p1 and one p2 issue. both relevant.

Worth to mention: none of those findings overlapped.

I let deepseek v4.1 flash and gpt 6.1 sol both plan fixes for the summary of the findings. in this particular scenario: gpt 6.1 sol planned to increase a buffer size from 128 to 256 to fit the 191 elements that blew past a test scenario. it included some headroom. deepseek v4.1 flash on the other hand decided to make it exactly 191 to satisfy the test, for example.

The TPS decode on deepseek is impressive. I never had a second / feeling of being left aone and though "damn this thing is working". Despite all my efforts, it took ~4x longer in a review, found less and planned worse than GPT 6.1 Sol. Wall clock time. I don't have token counts for comparison. If I were to grade those models from 1-10 (10 = top tier GG), I'd give deepseek a solid 6.5 and 6.1 sol a 7.5-8.0 maybe.