KoboldCpp

Description: User-friendly interface for running local LLMs

Website: https://github.com/LostRuins/koboldcpp

KoboldCpp is a web-based interface for running local language models. It offers a ChatGPT-like chat interface but runs entirely on your computer.

Features

• Web-based user interface
• Support for multiple model formats
• Story writing mode
• API compatibility