☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 4 days agoChina open-source AI models surpass 10 billion downloadsdailyittehad.com.pkexternal-linkmessage-square32linkfedilinkarrow-up177arrow-down12
arrow-up175arrow-down1external-linkChina open-source AI models surpass 10 billion downloadsdailyittehad.com.pk☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 4 days agomessage-square32linkfedilink
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up4·3 days agoI’m using 3.6 at 27bln and q8 on a M1 with 64gb.
I’m using 3.6 at 27bln and q8 on a M1 with 64gb.
What tps do you get on that?
Roghlt 10 to 13 tps give or take.