Offline large language model tool - AI tools

LM Studio is a desktop application that allows users to run Large Language Models (LLMs) locally and offline, supporting various architectures including Llama, Mistral, Phi, Gemma, DeepSeek, and Qwen 2.5.

• Free

Ollama is a platform that enables users to run powerful language models like Llama 3.3, DeepSeek-R1, Phi-4, Mistral, and Gemma 2 on their local machines.

• Free

Kolosal AI is a lightweight, open-source application enabling users to train, run, and chat with local Large Language Models (LLMs) directly on their devices, ensuring complete privacy and control.

• Free

Nemotron AI offers advanced language models (LLMs) with exceptional understanding, reasoning, and generation capabilities, supporting multilingual tasks and extended context windows.

• Contact for Pricing

LM Studio is a user-friendly desktop application that allows users to run various large language models (LLMs) locally and offline, including Llama 2, PN3, Falcon, Mistral, StarCoder, and GEMMA models from Hugging Face.

• Free

DeepSeek v3 is a cutting-edge AI language model with 671B parameters, built on an innovative Mixture-of-Experts (MoE) architecture. It delivers state-of-the-art performance in various benchmarks while ensuring efficient inference.

• Free

onedollarai.lol provides access to a variety of top-tier large language models (LLMs), including Meta LLaMa 3 and Microsoft Phi, for a flat monthly fee of $1.

• Paid
• From 1$

Neural Magic offers enterprise inference server solutions to streamline AI model deployment, maximizing computational efficiency and reducing costs on both GPU and CPU infrastructure.

• Contact for Pricing

Fullmoon is an open-source app that enables users to run local large language models directly on Apple devices, offering completely offline functionality and optimized performance for Apple silicon.

• Free

Cognify AI specializes in developing advanced AI-powered conversational agents and Large Language Model (LLM) applications, leveraging expert knowledge in machine learning and deep learning.

• Contact for Pricing

DeepSeek V3 is a powerful, open-source AI model with 671B parameters, available for free online use and local installation. It offers advanced AI capabilities without registration or cost.

• Free

WebGPU GPT Model Demo allows users to experiment with various GPT models, including Shakespeare and GPT-2, directly within their web browser using WebGPU.

• Free