☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 1 month agoOllaya — Run decision models locally.ollaya.devexternal-linkmessage-square9linkfedilinkarrow-up126arrow-down18
arrow-up118arrow-down1external-linkOllaya — Run decision models locally.ollaya.dev☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 1 month agomessage-square9linkfedilink
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up8arrow-down1·1 month agollama.cpp isn’t configured for this mode, there are forks that can work though, this is a good explanation of what’s different https://www.youtube.com/watch?v=bcGO7xre46o
llama.cpp isn’t configured for this mode, there are forks that can work though, this is a good explanation of what’s different https://www.youtube.com/watch?v=bcGO7xre46o