Plenty. Consumer GPU + CPU offloading is a pretty common way to run MoEs these days, and not everyone will drop $40K just to run Deepseek in CUDA instead of hitting an API or something.
I can (just barely) run GLM-4.5 on a single 3090 desktop.
I’ve kinda lost this thread, but what does that have to do with consumer GPU market share? The servers are a totally separate category.
I guess my original point was agreement: the 5000 series is not great for ‘AI’, not like everyone makes it out to be, to the point where folks who can’t drop $10K for a GPU are picking up older cards instead. But if you look at download stats for these models, there is interest in running stuff locally instead of ChatGPT, just like people are interested in internet free games, or Lemmy instead of Reddit.
I’m not sure the bulk of datacenter cards count as ‘discrete GPUs’ anymore, and they aren’t counted in that survey. They’re generally sold socketed into 8P servers with crazy interconnects, hyper specialized to what they do. Nvidia does sell some repurposed gaming silicon as a ‘low end’ PCIe server card, but these don’t get a ton of use compared to the big silicon sales.
I’m not sure that would even help that much, since tools out there already support CUDA, and even if AMD had a better version it would still require everyone to update apps to support it.
I will never get another AMD card after my first one just sucked ass and didn’t ever work right.
I wanted to try a Intel card but I wasn’t even sure if I could find linux drivers for it because they weren’t on the site for download and I couldn’t find anything specifying if their newer cards even worked on linux.
So yeah, Nvidia is the only viable company for me to buy a graphics card from
That kind of comment always feels a bit weird to me; are you basing AMD’s worth as a GPU manufacturer on that one bad experience? It could just as well have been the same on an Nvidia chip, would you be pro-AMD in that case?
On the Intel part, I’m not up to date but historically Intel has been very good about developing drivers for Linux, and most of the time they are actually included in the kernel (hence no download necessary).
That kind of comment always feels a bit weird to me; are you basing AMD’s worth as a GPU manufacturer on that one bad experience?
Absolutely, if a company I am trying for the first time gives me a bad experience, I will not go back. That’s me giving them a chance, and AMD fucked up that chance and I couldn’t even get a refund for like a $200 card. Choosing to try a different option resulted in me wasting time and money, and it pushed back my rig working for half a year until i could afford a working card again which really pissed me off.
I didn’t know that about intel cards, I’ll have to try one for my next upgrade if I can find on their site that they are supported.
I don’t know, real world data maybe? Your one, or 2, or even 10 experiences are very insignificant statistically speaking. And of course it’s not a rare story, people who talk online about a product are most usually people with a bad experience, complaining about it, it kinda introduces a bias that you have to ignore. So you go for things like failure rates, which you can find online.
By the way, it’s almost never actually a fault from AMD or Nvidia, but the actual manufacturer of the card.
Edit: Not that I care about Internet points, but downvoting without a rebuttal is… Not very convincing
Please read my entire comment, I also said your experience as one person is statistically insignificant. As in, you cannot rely on 1 bad experience considering the volume of GPUs sold. Anybody can be unlucky with a purchase and get a defective product, no matter how good the manufacturer is.
Also, please point out where I did any fanboyism. I did not take any side in my comments. Bad faith arguments are so weird.
Nice. Did not answer anything, did not point out where I’m simping, or being a fanboy. I’m not pro Nvidia, nor AMD, nor anything (rather than that I’m pretty anticonsumerism actually, not that you care).
You’re being extremely transparent in your bad faith.
The vast majority of consumers do not watch or read reviews. They walk into a Best Buy or whatever retailer and grab the box that says GeForce that has the biggest number within their budget. LTT even did a breakdown at some point that showed how even their most watched reviews have little to no impact on sales numbers. Nvidia has the mind share. In a lot of people’s minds GeForce = Graphics. And I say all that as someone who is currently on a Radeon 7900XTX. I’d be sad to see AMD and Intel quit the dGPU space, but I wouldn’t be surprised.
Who the hell keeps buying nvidia? Stop it.
It’s the fucking AI tech bros
Not as many as you’d think. The 5000 series is not great for AI because they have like no VRAM, with respect to their price.
4x3090 or 3060 homelabs are the standard, heh.
Their data centre division is pulling in 41 billion revenue vs 4 billion consumer market.
https://finance.yahoo.com/news/nvidia-q2-profit-soars-59-021402431.html
Yeah. What does that have to do with home setups? No one is putting an H200 or L40 in their homelab.
Does the original title mention home setups?
It mentions desktop GPUs, which are not part of this market cap survey.
Basically I don’t see what the server market has to do with desktop dGPU market share. Why did you bring that up?
Who the fuck buys a consumer GPU for AI?
If you’re not doing it in a home lab, you’ll need more juice than anything a RTX 3000/4000/5000/whatever000 series could have.
Plenty. Consumer GPU + CPU offloading is a pretty common way to run MoEs these days, and not everyone will drop $40K just to run Deepseek in CUDA instead of hitting an API or something.
I can (just barely) run GLM-4.5 on a single 3090 desktop.
… Yeah, for yourself.
I’m referring to anyone running an LLM for commercial purposes.
Y’know, 80% of Nvidia’s business?
I’ve kinda lost this thread, but what does that have to do with consumer GPU market share? The servers are a totally separate category.
I guess my original point was agreement: the 5000 series is not great for ‘AI’, not like everyone makes it out to be, to the point where folks who can’t drop $10K for a GPU are picking up older cards instead. But if you look at download stats for these models, there is interest in running stuff locally instead of ChatGPT, just like people are interested in internet free games, or Lemmy instead of Reddit.
The original post is about Nvidia’s domination of discrete GPUs, not consumer GPUs.
So I’m not limiting myself to people running an LLM on their personal desktop.
That’s what I was trying to get across.
And it’s right on point for the original material.
I’m not sure the bulk of datacenter cards count as ‘discrete GPUs’ anymore, and they aren’t counted in that survey. They’re generally sold socketed into 8P servers with crazy interconnects, hyper specialized to what they do. Nvidia does sell some repurposed gaming silicon as a ‘low end’ PCIe server card, but these don’t get a ton of use compared to the big silicon sales.
Microsoft.
Microsoft is buying them for AI.
From what I understand, chatGPT is running on azure servers.
The same people buying Intel and Microsoft.
Meanwhile framework’s new AMD offering has nvidia slop in it. Just why. We want AMD. Give us AMD.
AMD doesn’t support CUDA
At the end of the day I think it is this simple. CUDA works and developers use it so users get a tangible benefit.
AMD comes up with a better version of CUDA and you have the disruption needed to compete.
I’m not sure that would even help that much, since tools out there already support CUDA, and even if AMD had a better version it would still require everyone to update apps to support it.
I will never get another AMD card after my first one just sucked ass and didn’t ever work right.
I wanted to try a Intel card but I wasn’t even sure if I could find linux drivers for it because they weren’t on the site for download and I couldn’t find anything specifying if their newer cards even worked on linux.
So yeah, Nvidia is the only viable company for me to buy a graphics card from
That kind of comment always feels a bit weird to me; are you basing AMD’s worth as a GPU manufacturer on that one bad experience? It could just as well have been the same on an Nvidia chip, would you be pro-AMD in that case?
On the Intel part, I’m not up to date but historically Intel has been very good about developing drivers for Linux, and most of the time they are actually included in the kernel (hence no download necessary).
Absolutely, if a company I am trying for the first time gives me a bad experience, I will not go back. That’s me giving them a chance, and AMD fucked up that chance and I couldn’t even get a refund for like a $200 card. Choosing to try a different option resulted in me wasting time and money, and it pushed back my rig working for half a year until i could afford a working card again which really pissed me off.
I didn’t know that about intel cards, I’ll have to try one for my next upgrade if I can find on their site that they are supported.
What else would a consumer base things on except their own experiences? Not like it’s a rare story either.
I don’t know, real world data maybe? Your one, or 2, or even 10 experiences are very insignificant statistically speaking. And of course it’s not a rare story, people who talk online about a product are most usually people with a bad experience, complaining about it, it kinda introduces a bias that you have to ignore. So you go for things like failure rates, which you can find online.
By the way, it’s almost never actually a fault from AMD or Nvidia, but the actual manufacturer of the card.
Edit: Not that I care about Internet points, but downvoting without a rebuttal is… Not very convincing
A persons actual experience with a product isnt real world data? Fan boys for huge companies are so weird.
Please read my entire comment, I also said your experience as one person is statistically insignificant. As in, you cannot rely on 1 bad experience considering the volume of GPUs sold. Anybody can be unlucky with a purchase and get a defective product, no matter how good the manufacturer is.
Also, please point out where I did any fanboyism. I did not take any side in my comments. Bad faith arguments are so weird.
Sure buddy, we’re all idiots for not liking the product you simp for. Got it.
Nice. Did not answer anything, did not point out where I’m simping, or being a fanboy. I’m not pro Nvidia, nor AMD, nor anything (rather than that I’m pretty anticonsumerism actually, not that you care).
You’re being extremely transparent in your bad faith.
The vast majority of consumers do not watch or read reviews. They walk into a Best Buy or whatever retailer and grab the box that says GeForce that has the biggest number within their budget. LTT even did a breakdown at some point that showed how even their most watched reviews have little to no impact on sales numbers. Nvidia has the mind share. In a lot of people’s minds GeForce = Graphics. And I say all that as someone who is currently on a Radeon 7900XTX. I’d be sad to see AMD and Intel quit the dGPU space, but I wouldn’t be surprised.
I do local ai stuff and i get more support with nvidia cuda, and you usually get exclusive gaming features first on nvidia like dlss, rtx, and voice
I wish they shipped with more vram though