A self-hosting enthusiast on Reddit demonstrates a home server setup, nicknamed "lvgale," that concurrently serves three large language models of different sizes: a 27B, a 9B, and a 2B parameter model. The build runs on modest hardware the poster jokingly calls a "hardware abomination."
The