High-performance LLM platform - AI tools

Axolotl AI We make fine-tuning accessible, scalable, fun
Axolotl AI is a free, open-source tool designed to make fine-tuning Large Language Models (LLMs) faster, more accessible, and scalable across various AI models and platforms.
- Free
Laminar The AI engineering platform for LLM products
Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.
- Freemium
- From 25$
Float16.cloud Your AI Infrastructure, Managed & Simplified.
Float16.cloud provides managed GPU infrastructure and LLM solutions for AI workloads. It offers services like serverless GPU computing and one-click LLM deployment, optimizing cost and performance.
- Usage Based
Petals Run large language models at home, BitTorrent‑style.
Petals enables users to run large language models like Llama 3.1 and Mixtral collaboratively, distributing the load across a network of consumer-grade GPUs.
- Free
neutrino AI Multi-model AI Infrastructure for Optimal LLM Performance
Neutrino AI provides multi-model AI infrastructure to optimize Large Language Model (LLM) performance for applications. It offers tools for evaluation, intelligent routing, and observability to enhance quality, manage costs, and ensure scalability.
- Usage Based
LlamaEdge The easiest, smallest and fastest local LLM runtime and API server.
LlamaEdge is a lightweight and fast local LLM runtime and API server, powered by Rust & WasmEdge, designed for creating cross-platform LLM agents and web services.
- Free
Kalavai Turn your devices into a scalable LLM platform
Kalavai offers a platform for deploying Large Language Models (LLMs) across various devices, scaling from personal laptops to full production environments. It simplifies LLM deployment and experimentation.
- Paid
- From 29$
BenchLLM The best way to evaluate LLM-powered apps
BenchLLM is a tool for evaluating LLM-powered applications. It allows users to build test suites, generate quality reports, and choose between automated, interactive, or custom evaluation strategies.
- Other
Lepton AI The New AI Cloud for High-Performance Computing and Inference
Lepton AI is a cloud-native platform offering cutting-edge AI inference and training with high-performance GPU infrastructure, achieving 99.5% uptime and processing billions of tokens daily.
- Freemium
Rig Build Modular and Scalable LLM Applications in Rust
Rig is a Rust-based framework for building modular and scalable LLM applications. It offers a unified LLM interface, Rust-powered performance, and advanced AI workflow abstractions.
- Free
WebLLM High-Performance In-Browser LLM Inference Engine
WebLLM enables running large language models (LLMs) directly within a web browser using WebGPU for hardware acceleration, reducing server costs and enhancing privacy.
- Free
FriendliAI Accelerate Generative AI Inference
FriendliAI provides a high-performance platform for accelerating generative AI inference, enabling fast, cost-effective, and reliable deployment and serving of Large Language Models (LLMs).
- Usage Based
LLMLingua Series Effectively Deliver Information to LLMs via Prompt Compression
LLMLingua Series offers prompt compression techniques to accelerate Large Language Model (LLM) inference, reduce costs, and enhance performance, especially in long context scenarios.
- Other
LiteLLM Unified API Gateway for 100+ LLM Providers
LiteLLM is a comprehensive LLM gateway solution that provides unified API management, authentication, load balancing, and spend tracking across multiple LLM providers including Azure OpenAI, Vertex AI, Bedrock, and OpenAI.
- Freemium
Lora Integrate local LLM with one line of code.
Lora provides an SDK for integrating a fine-tuned, mobile-optimized local Large Language Model (LLM) into applications with minimal setup, offering GPT-4o-mini level performance.
- Freemium