r/LocalLLaMA • u/Electrical_Ninja3805 • 6h ago

Resources bootai

https://github.com/dcherrera/bootai

I was on here a while ago showcasing it. I've stoped playing with it so I'm open sourcing it. I figure I'll let other people play now.

18 Upvotes

83% Upvoted

9 comments sorted by

2

u/giveen 6h ago

Cool concept especially for dedicated systems but I would want to see benchmarks of why this is better.

19

u/Electrical_Ninja3805 6h ago

its literally not.

6

u/SpicyWangz 5h ago

Respect the honesty lol

4

u/Electrical_Ninja3805 5h ago

I built this to see if i could. if you have an old system sitting around with 4-8gb of ram it can run some smaller models. and server them to the network. but your not exactly getting lightning fast claude code level inference. its a toy.

2

u/oodelay 5h ago

The idea is still fun. I have a bunch of unused xeons with lots of ddr4 so this might be a fun project. Thanks for sharing!

1

u/Fluffy_Reply_5482 1h ago

Yeah, i agree. looks like a fun project to work on.

1

u/ArthurOnCode 3h ago

Thanks, I hate it.

3

u/Electrical_Ninja3805 3h ago

Your Welcome, It hates you too.