This desktop app for hosting and running LLMs locally is rough in a few spots, but still useful right out of the box.
As posted to and then subsequently removed from the PCMR Reddit, a GitHub repository has popped up that creator PromptPirate ...