☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 29 days agoOllaya — Run decision models locally.ollaya.devexternal-linkmessage-square9linkfedilinkarrow-up126arrow-down18
arrow-up118arrow-down1external-linkOllaya — Run decision models locally.ollaya.dev☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 29 days agomessage-square9linkfedilink
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up8arrow-down1·29 days agollama.cpp isn’t configured for this mode, there are forks that can work though, this is a good explanation of what’s different https://www.youtube.com/watch?v=bcGO7xre46o
or just use llama.cpp
llama.cpp isn’t configured for this mode, there are forks that can work though, this is a good explanation of what’s different https://www.youtube.com/watch?v=bcGO7xre46o