Agent skill

ollama-stack

Run local LLM workloads with Ollama, Open WebUI, and GPU-aware tuning for private development environments.

Stars 163
Forks 31

Install this agent skill to your Project

npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/other/other/ollama-stack

Metadata

Additional technical details for this skill

author
devops-skills
version
1.0

SKILL.md

Ollama Stack

Deploy a local LLM stack for offline and privacy-first workflows.

Minimal Setup

bash
curl -fsSL https://ollama.com/install.sh | sh
ollama serve
ollama pull llama3.1:8b
ollama run llama3.1:8b

Docker Compose Pattern

  • Ollama container with persistent model volume
  • Open WebUI for chat interface
  • Optional LiteLLM proxy for unified API routing

Best Practices

  • Pin model versions for reproducibility.
  • Monitor VRAM, RAM, and swap utilization.
  • Restrict network exposure to trusted subnets.

Related Skills

  • mac-mini-llm-lab - Apple Silicon optimization
  • docker-compose - Service orchestration

Expand your agent's capabilities with these related and highly-rated skills.

Didn't find tool you were looking for?

Be as detailed as possible for better results