Category: Inference Engine

4 Tools in this category

GPT4All

Private and local AI chatbot solution without cloud and GPU requirements

Inference Engine Local

llama.cpp

C++ implementation of LLaMA for efficient local inference

Inference Engine Local

LocalAI

OpenAI API-compatible local inference engine for developers

Inference Engine Local

Ollama

Run large language models locally with a simple API

Inference Engine Local