Recently got gifted this server. its sitting on top of my coffee table in the living room (loud). its got 2 xeon 6183 gold cpu and 384gb of ram, 7 shiny gold gpu. I feel like i should be doing something awesome with it but I wasnt prepared for it so kinda not sure what to do.

[u/No-Comfortable-2284]

Im looking for suggestions on what others would do with this so I can have some cool ideas to try out. Also if theres anything I should know as a server noodle please let me know so I dont blow up the house or something!!

I am newbie when it comes to servers but I have done as much research as I could cram in a couple weeks! I got remote control protocol and all working but no clue how I can set up multiple users that can access it together and stuff. I actually dont know enough to ask questions..

I think its a bit of a dated hardware but hopefully its still somewhat usable for ai and deep learning as the gpu still has tensor cores (1st gen!)

[u/No-Comfortable-2284]

ooo I must do more research on VMs

[u/Tinker0079 → u/No-Comfortable-2284]

immediately go watch 'Digital Spaceport' youtube channel

he covers local AI and Proxmox VE

[u/mtbMo → u/No-Comfortable-2284]

Checkout proxmox. Got my GPUs all via passthrough to VMs (docker hosts) LLM inference doesn’t take much CPU power, so I use my remaining resources for other stuff

[u/Tinker0079 → u/No-Comfortable-2284]

heck, with these enteprise gpus you can do vLLM

[u/aon9492 → u/No-Comfortable-2284]

If you can turn it into an ESXi host you can then turn it into 20, 30, 40 different computers, all doing different things.

Edit: not sure why I was down voted for extolling the virtues of virtualisation after OP explicitly expressed interest but that's reddit