Track_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 1 month agoHexadecimalslrpnk.netimagemessage-square108linkfedilinkarrow-up11.02Karrow-down119
arrow-up11Karrow-down1imageHexadecimalslrpnk.netTrack_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 1 month agomessage-square108linkfedilink
minus-squaressillyssadass@lemmy.worldlinkfedilinkarrow-up7·1 month agoDon’t you need a beefy GPU to run local LLMs?
minus-squareMasterNerd@lemm.eelinkfedilinkarrow-up3·1 month agoDepends on how many parameters you want to use. I can run it with 8billion on my laptop.
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.