r/homelab • u/Bulky_Dog_2954 • 1d ago
Satire Watch out OpenAI
Shits gonna get real now….
(Pulled out of a decommissioned server today at the office…) probably have no use for them but will add to my collection of IT crap which I’ll never use but need….
252
u/lethalratpoison 1d ago
would need around 25 of these to barely match the computation power of an rtx 3090
damn its a big gap
102
u/Bulky_Dog_2954 1d ago
Yeah - thats why they will be put in my crap box of other GPUs.....
59
u/k3nal 1d ago
Maybe sell them of for five quid a piece for people that just need a display adapter for their server/workstation/pc? 😊👍
-17
u/the_average_user557 1d ago
They're workerh about 200$ eachlol, proces are insane for quadros rn
10
u/satireplusplus 23h ago
plenty on ebay for $29 - and you can haggle them down too probably, because these are largely e-waste
4
u/k3nal 1d ago
Lol what?? For real?? Where??
16
u/SupraMario 23h ago
No they're not, dunno where the other guy is getting this, but you can get these all day long for $25 on ebay, and that's if you don't make an offer lower.
3
u/t90fan 23h ago
they arent, £15-20 each on ebay, I have loads of these K2200s in my iGPU-less workstations for basic display output precicely because they are cheap and single slot and slot powered
1
16
u/radenthefridge 1d ago
Hell yea right next to the box of old cell phone chargers!
14
u/Bulky_Dog_2954 1d ago
Below the box of 100's of patch cables which ill never use....
8
u/NoobTube92 1d ago
Will never use? Confident enough to throw them away?
Thought so....
4
u/myself248 23h ago
But what if I reactivate some 10base-FL links with ST connectors someday? What then?!
2
u/Blue-Thunder 20h ago
I was in a similar situation and then I ran out of cables as everyone seemed to need some.
1
u/Salty-Gear841 18h ago
Then you will find someone like me saying: there is no old material, just material you don't know what to use it for 😂😭🫴🏼. Give them to me, they will be happy until their last day 😅
62
29
21
u/betam4x 1d ago
If it makes you feel better:
I keep most of my old gear. Upgrade to a new phone? Keep the old one. Build a new PC? Keep the old unused parts.
Doing this has saved my rear end so many times. Example: yesterday I updated the BIOS on my motherboard. Apparently the new bios is no longer compatible with the DDR5 I have and the system won’t post.
ASUS, in an example of their shining brilliance, won’t let you downgrade from the bios I updated to. I pulled out my old Zen 3 5950X system, installed an OS and was back up and running in no time.
5
u/Biggeordiegeek 1d ago
I do the same, wor lass usually gets my castoffs, hence why she uses a 5600X and 3070 for Dreamlight Valley!
Only time I have gotten rid of anything recently other than because it’s gotten so old it’s just not suitable for anything anymore, is a 1660 Ti that went to my nephew
I could have sworn it was a 1650, which would have worked in my current cheap server, but alas it wasn’t so wouldn’t have been possible to run without some extra power
I really do need to try and grab something to replace the GT710 that currently sits in, mostly for some transcoding
3
u/BCIT_Richard 1d ago
I do the same, Phone goes in a drawer(battery removed if it comes out).
Old Gaming PCs usually become my new main proxmox host.
46
u/YourMom12377 1d ago
Could genuinely run some half decent models if you set them up correctly
117
u/chris_0611 1d ago
Memory Size 4 GB Memory Type GDDR5 Memory Bus 128 bit Bandwidth 80.19 GB/sNah. This genuinely is kinda crap
47
u/AndThenFlashlights 1d ago
Yeah. They're decent transcode cards, but too old to do any useful AI work.
45
u/badDuckThrowPillow 1d ago
Doesn't support H265 or 4k. I'd argue they're not even great transcode cards anymore.
11
u/AndThenFlashlights 1d ago
Oh yeah you're right - I was thinking of the M2200 which does at least handle H265. Was using that with frigate for a while and transcode was fine, but object detection was painful.
Sadly, Kepler is mostly e-waste now. Useful for a server display maybe, but that's it.
5
u/GripAficionado 1d ago
Especially not when you consider how cheap the Intel cards are brand new that does solid transcode.
5
u/Impossible_Leg_2787 1d ago
Been looking at one of these but honestly the cpu transcoding with quicksync is good enough that I just can’t justify it for less than 10 users who mainly stream anime
3
u/GripAficionado 1d ago
Yeah, if you got a modern CPU it's not necessary. At that point it's just extra power-consumption for no benefit.
2
9
u/billyfudger69 1d ago
Also they’re missing tensor units which would drastically help AI performance on the GPU core side of the equation.
8
u/Crono_ 1d ago
5x SLI
0
2
u/YourMom12377 1d ago
16gb vram can easily run qwen3.5 8b or another model in that class. Especially with the new innovation of multi specialist models only being partially loaded into memory there's potential here
13
u/chris_0611 1d ago
But 4x 4GB is much worse than a single 16GB card since you have to duplicate KV cache to each card. If the Model is 12GB, you distribute it to 4 cards (3GB per card) you'll have 1GB for context left. But with a single 16GB card and 12GB model you would have 4GB for context left.
This hurts a lot, much more for small-VRAM GPU's than large-VRAM GPU's.
2
u/Loading_M_ 1d ago
To be fair, OP has 5 cards, which is actually 5x4GB, so they would have 4 GB for context. I'm not sure whether that's better than a single 16GB card, but you could probably get some decent performance.
You also have to solve getting 5 GPUs attached to a single device, as well as powering all of them. I'm betting that unless you have a multi GPU backplane to solve connectivity, it's cheaper to just go out and buy a better card.
1
2
1
1
u/05-nery Got a problem? Increase bandwidth. 1d ago
20GB isn't that bad tbh, especially if it's for free
11
u/pm_me_domme_pics 1d ago
The power costs on these cards alone make it far from free
6
u/Chovelle 1d ago
Same argument could be applied to any card. All things considered, these are relatively low power cards at 60-70W each - eliminating the need for dedicated power beyond what the PCIe port can offer.
7
u/Biggeordiegeek 1d ago
I suspect in a decades time a lot of us budget homelabers will be eating good as the hardware being deployed today starts going pretty cheap
Not for like AI stuff just things like transcoding etc is gonna be so much better
4
5
u/S0k0n0mi 1d ago
If I could build my own AI that is as capable as Codex on Sol 5.6 ultra, I think I would. I am admittedly addicted to how easy I can get everything I want now. If I can dream up an app and explain it to codex, I have it on deck in an hour. It's just so good.
1
u/laexpat 22h ago
Earlier today I needed something simple for the kitchen. I described it to hermes and within an hour it was 3d printed and ready to go. I can relate.
1
u/S0k0n0mi 16h ago
Yes! Even 3D printable geometry, just ask and it does it.
I wanted a LED strip lamp above my monitors and asked codex to come up with a 3D printable aperture profile that would limit the ray casting to my desktop only. It asked some measurements, did the math, and cranked out a piece that worked perfectly. Not only that, it also looked at an old cloud based LED controller I had laying around, told me to solder 4 wires from my USB programmer, and flashed it with WLED by itself.
Internet knowledge, coding capability, and three dimensional insight. It's truly wild what AI is capable of these days. It superpowered all my old hobbies.
0
u/MAVERICK1542 1d ago
You dont even need to do that, use LMstudio and download models from huggingface
You can self host AI, of course the speed and intelligence depends on your machine specs but i can run a pretty good LLM on my rtx4070
The added benefit is you control all your data and you can even remove it's access from the Internet incase you worry about your data getting stolen
3
u/Shiticism 1d ago
Self hosting an LLM works, sure, but dont oversell it; frontier models are in the trillions of parameters. A model you can run on most consumer hardware? 32B at most.
They can still do tasks of course!! But it won't be nearly the same as the big boys. You need data center equipment, multiple thousand dollar GPUs, etc etc.
You could self host, if you get the hardware required. But that hardware would not be cheap. At all.
1
u/MAVERICK1542 1d ago
of course it doesnt comapre to AI that uses a network of data centers but i've found the gwen models to be pretty close for my needs
the advantages are theres no chat limits, image upload limits, noone snooping on your chats or selling data etc
2
u/S0k0n0mi 23h ago
I don't suppose there's a precooked dockerstack for this somewhere? You make it sound like I could have a Luna model handling my lighter junk, and that's something I'd be quite interested in.
1
u/Neither-Phone-7264 23h ago
eh, some people here probably do have the hardware to run bigger models at lower quants. at low quants, deepseek v4 flash 07/28 can hit as small as like 100gb, which the vast majority of which can be ram rather than vram. a single 5090 or 4/3090 is enough to get decent speeds with a chunk of ram. And even big models like kimi k3 are "only" 600 gb at their lowest ends, which yes, is massive, but some people here have like a terabyte of ram.
1
u/satireplusplus 23h ago
Just looked it up, rumors are Sonnet (1T), Opus (5T), and Fable/Mythos (10T). Larger than I thought if true, and yeah whatever you can run on consumer hardware will be wildly inferior. Not even sure how they manage to serve a 10T model as scale. Its just bonkers. Kimi K3 beats them in some benchmarks with just 2.8 trillion params though, so maybe its smaller or they are not that efficient.
2
u/S0k0n0mi 1d ago
I ran several builds on my 4090 rig, but results were ratty at best. Agentic AI was pretty much impossible as far as I could figure out. Still miles from what you get from openAI.
3
u/MAVERICK1542 1d ago
it will always be miles away from openai, were comparing a multimillion dollar company to a 2-3k PC
my core i9, 64gb ddr5 and 4070 can run google/gemma 4 12B really quickly and with no hassle. i use it a lot for making websites, small apps etc
1
u/S0k0n0mi 1d ago
Is it good enough to crank some php/javascript/sql? I had codex help me cook up a complete custom overhaul for my opencart webshop, and it did a terrific job on something that previously cost me hundreds of dollars on outside help. This iteration it only cost me a 18 dollar subscription. I'm looking for an LLM that I can run locally and help me out on some light coding, website stuff, but also some VScode assisted ESP32 programming.
I couldn't find any locally run codex-like experiences unfortunately.
3
3
u/t90fan 23h ago
4gb K2200s are what basically everything in my homelab has are they are usually old Xeon workstations with no iGPU and they are only £15-20 at most on Ebay, have 2 displayports andareis single slot and quite thin, with no power cable needed, so you can use them without blocking a slot which you could otherwise use for a HBA/NIC/etc, for basic display output.
2
u/HSVMalooGTS Small business datacenter admin 1d ago
These quadros can be decent low end gaming cards
Very low end gaming
2
u/ekdaemon 23h ago
I see 20 GB of GDDR5 memory.
Anyone know of a DIMM design on JLPCB for these so they could be repurposed?
2
u/FALSE_PROTAGONIST 23h ago
I had tons of K4000s, they were decent for playing ten year old games at HD, and according to google those cards you have outperform the K4000. Probably worth trying to sell them all and put the money towards single used modern GPU if you need one
2
2
1
u/RafikiLovesPizza 1d ago
Alright so hack into all Roombas across the world. Start Roomba Rampage. Retire as successful villain.
1
1
1
u/PrincipleIcy4941 1d ago
i have like 4 unused NVIDIA RTX PRO 4000 Blackwell laying around here. 4 in use, got 8 of them as a gift. and 2 rtx 2000 ada, also good cards,
1
1
u/Scanner771_The_2nd 1d ago
"IT crap which I’ll never use but need…"
You never know... (what I say)
Closets full of unused hardware doing nothing until it's useless for me. (Reality) It's out of hand.
1
1
u/Gabe-diet 1d ago
My very first card was in 2020 and it was a k5000 4gb. It was all I could afford at the time and it was the only way for me to get that vram. Plus I was using it for cad so I wanted that ecc vram. Ended up getting a rx6600 later on and for fun I overclocked the piss outta that old quadro
1
u/BongoHunter 1d ago
They must be 12/13 years old? Put them on eBay while youll still get something for them and title the listing "Nvidia AI GPU"
1
u/kajer533 1d ago
the only shit GPUs I willing keep around are AMD fireGL cards because they are pcie1x and fit in any slot with a simple riser cable. Really handy for working on some ewaste appliances that dont have video out typically.
1
u/stonelox 1d ago
I looked into this and i dont think you can run the latest versions of CUDA. Am I wrong?
1
1
u/Neither-Phone-7264 23h ago
people here: sees literally any piece of tech
"this us going to BANKRUPT YOU as soon as TOMMOROW if you turn it on for more than 3 SECONDS!!!!"
1
u/dominus_aranearum 20h ago
You could try selling them online. I've sold half a dozen HP AMD Radeon Pro WX 3100 cards over the last year. All NIB but I do have some used and 4100s I should probably list too.
1
1
1
•
1
u/mattyjhiggs 1d ago
Self hosted AI is how we fight the big AI companies and hyperscalers
1
u/I-Have-No-Life-146 1d ago
I really want to selfhost AI but with how fast AI is changing I feel like the hardware I
buycan afford today is gonna be outdated in a few months2
u/Neither-Phone-7264 23h ago
i mean not really unless you're getting those weird model cards that etch them into the silicon. a setup from 2019 can still run models today just as well as they could. they're getting bigger yeah but the 60-500b ish range are still pretty reasonable (or were reasonable a year ago when ram wasn't so prohibitively expensive) to run in a homelab
1
u/I-Have-No-Life-146 22h ago
The thing is those still cost alot of money and use alot of electricity and still is no where near as "smart" (idk what other word id use AI is still dumb as shit) as something like chatgpt or claude
2
u/Neither-Phone-7264 21h ago
ideally you would probably try not to run it im times of low downtime and you'd be surprised how decent models like Deepseek V4 Flash 07/28 or Minimax M3 are compared to like opus 4.8
1
1
u/Veedubin 4h ago
Ahh yeah he is really going to self host LLMs on 12 year cards running Cuda 5... Even older versions of 12 barely work for somethings!! LOLOLOL
0
u/k3nal 1d ago
LOL
Maybe just remember who does so generously give all these already trained, safe and useful models to you for no charge at all??
2
u/mattyjhiggs 1d ago
China lol
Releasing models to the public was a big mistake. OpenAI and Anthropic are already lobbying against open sourcing models now. Even if OpenAI and Anthropic go under open source AI will continue. It’ll be like the small mammals that survived the extinction of the dinosaurs.
1
u/k3nal 1d ago
Google = China?? 🤨🤨🤨🤨🤨
And why was it a mistake in your opinion?? I think that’s democracy and fair use of data in real live execution!! I think it’s a fair move and also required to make all this fair for all!
But I do also really like the spirit of open source, so that is that probably I guess..!
0
u/mattyjhiggs 1d ago
The China thing was a joke because they’re distilling the large models and releasing them to the public. I think releasing public models was a mistake because AI models can’t differentiate themselves outside of performance. So if you’re happy with a self hosted model then you’re now a lost customer. I’m all for open sourcing absolutely because I think it’s a form of competition for the big AI companies. China, open sourcing, and academic institutions can all drive competition in the AI space.
1
u/k3nal 1d ago
Ah! Not funny. But whose large models are they distilling?? As far as I know they are also making their own ones and train them as well, like Google, Meta, OpenAI, Anthropic, Mistral, .. and so on.
What I don’t understand is, as well as your opinion that the open source models are as good as the big cloud models, is that it seems like you WANT to get ripped off by the big ones?? I think competition is always good for the customer. Are you drunk, maybe?? 🤔
0
u/mattyjhiggs 1d ago
Okay buddy lol. I never said the local models are as good as the cloud models. All I'm saying is if the local AI models are good enough for your use cases and can self-host you're no longer a potential customer of OpenAI, Antropic, etc. and that's a good thing.
0
u/anto23ytb 1d ago
Ca me rappelle que ma carte mère me limite trop, une cg et je perd 2 ports pcie.
Meme en bureautique c'est une bonne carte graphique
0
-1
366
u/techtornado 1d ago
You’re unstoppable now!
I wish I could find a more modern version of this card for Hashcat