This desktop app for hosting and running LLMs locally is rough in a few spots, but still useful right out of the box.
Vitalik Buterin and Davide Crapis, the head of AI at the Ethereum Foundation, are proposing a new system to improve privacy when using large language models.