Consider this hypothetical scenario: if you were given $100,000 to build a PC/server to run open-source LLMs like LLaMA 3 for single-user purposes, what would you build?
Consider this hypothetical scenario: if you were given $100,000 to build a PC/server to run open-source LLMs like LLaMA 3 for single-user purposes, what would you build?
4 of whatever modern GPU has the most vram currently. (So I can run 4 personalities at the same time)
Whatever the best amd epyc cpu currently is.
As much ECC ram as possible.
Waifu themes all over the computer.
Linux, LTS edition.
A bunch of nvme SSDs configured redundantly.
And 2 RTX 4090s. (One for the host and one for me)