Local AI Hub

Tools and resources for running AI models locally

Inference Engine

4 Tools

GPT4All

Private and local AI chatbot solution without cloud and GPU requirements

Inference Engine Local

llama.cpp

C++ implementation of LLaMA for efficient local inference

Inference Engine Local

LocalAI

OpenAI API-compatible local inference engine for developers

Inference Engine Local

Ollama

Run large language models locally with a simple API

Inference Engine Local

Models

8 Tools

DeepSeek V3 & R1

Chinese open-source MoE models with excellent reasoning performance

Models Local

Gemma 3

Google's lightweight open-source models based on Gemini 2.0 technology

Models Local

GPT-OSS

OpenAI's first open-weight models with reasoning capabilities

Models Local

Kimi K2.5

1 Trillion parameter MoE model with visual capabilities and Agent Swarm

Models Local

Llama 4

Meta's latest open-source LLM generation with native multimodal capabilities

Models Local

Mistral 3

French open-source MoE model with multimodal capabilities

Models Local

Qwen3.6

Alibaba's current Qwen model family with open-weight variants for coding, agents, and local deployment

Models Local

Qwen3-Coder

Alibaba's specialized coding model with agentic capabilities

Models Local

Hardware

5 Tools

Mac Mini M4 / M4 Pro

Compact AI workstation with Unified Memory for local LLM inference

Hardware Local

Minisforum AI Mini PCs

Compact mini PCs with AMD Ryzen AI and Intel Core Ultra for local AI

Hardware Local

NVIDIA DGX Spark

AI supercomputer with Grace Blackwell on your desk – up to 1 PetaFLOP AI performance

Hardware Local

Nvidia Project DIGITS

Desktop AI computer with 128GB Unified Memory for local AI development

Hardware Local

Nvidia RTX 4090

Premium GPU with 24GB VRAM for local LLM inference and fine-tuning

Hardware Local

Interface

4 Tools

Jan

100% offline ChatGPT alternative with full privacy

Interface Local

KoboldCpp

User-friendly interface for running local LLMs

Interface Local

LM Studio

Graphical user interface for running local language models

Interface Local

text-generation-webui

Flexible web UI for text generation with extensive extension support

Interface Local

Workflow Automation

3 Tools

Flowwise

AI workflow builder for effortless creation of AI applications

Workflow Automation Local

Langflow

Open-source visual builder for AI workflows with drag-and-drop editor

Workflow Automation Local

n8n

Open-source workflow automation for complex processes and integrations

Workflow Automation Local

Benchmarks

4 Tools

Artificial Analysis

Independent performance analysis of 100+ LLMs with detailed metrics

Benchmarks

Hugging Face Open LLM Leaderboard

Technical benchmark leaderboard for open-source LLMs with 6 standardized tests

Benchmarks

LLM Explorer

Interactive table with 51,600+ models and extensive filtering options

Benchmarks

LMSYS Chatbot Arena

Community-driven LLM ranking through pairwise comparisons with Elo system

Benchmarks

Learning Resources

4 Tools

freeCodeCamp – Local AI with Ollama

Free video course (~3 hrs) on Ollama setup, Python, RAG and hands-on projects

Learning Resources

LLMlokal.de

German beginner's guide to hardware, tools and models for local LLMs

Learning Resources

Local AI Master

Free interactive guides, PDF modules and tutorials on Ollama and local AI

Learning Resources

My Courses

Structured video courses on JavaScript, TypeScript, React, Alpine.js and AI programming.

Learning Resources