This desktop app for hosting and running LLMs locally is rough in a few spots, but still useful right out of the box.
A new blog post from Microsoft lays out a per-app permission system that's coming to Windows 11 in the near future.