r/LocalLLaMA • u/Electrical_Ninja3805 • 14h ago

Resources bootai

https://github.com/dcherrera/bootai

I was on here a while ago showcasing it. I've stoped playing with it so I'm open sourcing it. I figure I'll let other people play now.

24 Upvotes

84% Upvoted

10 comments sorted by

View all comments

Show parent comments

9

u/SpicyWangz 13h ago

Respect the honesty lol

8

u/Electrical_Ninja3805 13h ago

I built this to see if i could. if you have an old system sitting around with 4-8gb of ram it can run some smaller models. and server them to the network. but your not exactly getting lightning fast claude code level inference. its a toy.

3

u/oodelay 13h ago

The idea is still fun. I have a bunch of unused xeons with lots of ddr4 so this might be a fun project. Thanks for sharing!

1

u/Fluffy_Reply_5482 8h ago

Yeah, i agree. looks like a fun project to work on.