

This is definitely interesting, a lot of work to setup given I normally just use the built in frontend for llama.cpp though. I also don’t use LLMs for anything serious, but I might give it a go. I do love the vodka joke though. When life gives you potato, make vodka.

Yeahhh, unfortunately I have friends that I can’t talk to anywhere else and won’t move. I’m not in the UK so it’s not an immediate concern but it seems to slowly be coming for everyone