SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · edit-21 month agoWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?message-squaremessage-square18fedilinkarrow-up131arrow-down112file-text
arrow-up119arrow-down1message-squareWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · edit-21 month agomessage-square18fedilinkfile-text
minus-squareplutopos@lemmy.ziplinkfedilinkarrow-up1·8 days agoThere are no lower or upper bounds for local LLMs. Just get the best GPU/RAM combo you can with your budget. Some laptops also have NPUs that are dedicated specifically to AI iirc
minus-squareSocialistVibes01@lemmy.mlOPlinkfedilinkarrow-up0·6 days agoThanks. What about NVidia vs AMD? Should I go with AMD if cheaper?
minus-squareplutopos@lemmy.ziplinkfedilinkarrow-up1·5 days agoAMD has better Linux support if you plan on using it
There are no lower or upper bounds for local LLMs. Just get the best GPU/RAM combo you can with your budget. Some laptops also have NPUs that are dedicated specifically to AI iirc
Thanks. What about NVidia vs AMD? Should I go with AMD if cheaper?
AMD has better Linux support if you plan on using it