Self-Hoster Serves Three LLMs Concurrently on a Single PCIe x1 Link

A self-hosting enthusiast on Reddit demonstrates a home server setup, nicknamed "lvgale," that concurrently serves three large language models of different sizes: a 27B, a 9B, and a 2B parameter model. The build runs on modest hardware the poster jokingly calls a "hardware abomination."

The standout detail is that the entire system operates through a single PCIe x1 link, an interface typically far too narrow for demanding AI inference workloads. The project shows how careful configuration can squeeze surprising performance out of constrained bandwidth.

The post is drawing attention in the r/selfhosted community, where users often share creative ways to run local AI without enterprise-grade equipment. It highlights a growing interest in multi-model, self-hosted inference on affordable hardware.

Read More at the original source →