Consider this hypothetical scenario: if you were given $100,000 to build a PC/server to run open-source LLMs like LLaMA 3 for single-user purposes, what would you build?

  • TechNerdWizard42@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    6 months ago

    I run it all locally on my laptop. Was about $30k new but you can get them used now years later for about $1k to $2k.