Ollama

Description: Run large language models locally with a simple API

Website: https://ollama.ai

Ollama provides an easy way to run LLMs locally. It handles model downloads, management, and offers a simple API.

Features

• One-command model installation
• REST API for integration
• Support for many popular models
• Automatic GPU detection

Quick Start

ollama run llama2