Cachelot - Alternatives & Competitors
Lightning-fast LRU cache library and key-value server
Cachelot is a free, open-source LRU cache library and Memcached-compatible distributed caching server optimized for high-speed performance and efficient memory utilization.
Free
Ranked by Relevance
-
1
LMCache Accelerating the Future of AI, One Cache at a TimeLMCache is an open-source Knowledge Delivery Network (KDN) designed to accelerate LLM applications, making them up to 8x faster and more cost-effective. It improves performance for AI chatbots and RAG queries through prompt caching and KV cache compression.
- Free
Didn't find tool you were looking for?