Reddit user chain-77 discovered that a $95 Ryzen 5 4600G APU can do respectable AI work by telling Linux to see it as a 16GB GPU. Although the processor doesn’t compare to dedicated cards in traditional graphics rendering, AI relies heavily on memory, where an APU’s ability to allocate shared memory freely becomes an advantage.

  • nottheengineer@feddit.de
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    Interesting. If LLama performance and the GPU allocation improves, it could make a lot of sense to build something like that with the last generation of DDR4 APUs because that memory is cheap.