That looks great but there is exactly zero chance I would run this on a computer I didn't own, in my apartment. Call me paranoid, but that's just how I feel right now.
Yeah, no way I'd ever trust something like this if it wasn't on hardware I control.
You can't 100% trust some company to secure something this personal, but you know that you won't one day sell your personal diary to some ad firm.
Plus, privacy isn't even the biggest concern. What do you do when the company hosting it goes bust? Or simply decides to not support it anymore, or randomly increases the price? The server in my basement has way less uptime than AWS, but I control what services it runs, forever.
with llama.cpp it's easier than ever too. i have used these models even just to vent about stuff or to rubber duck. it's pretty helpful, but i'm right there with you, local or nothing.
