What is screenpipe?
screenpipe is a cross-platform, open-source solution designed for developers. It continuously records screen activity, audio, UI elements, and interactions, storing the data locally in a SQLite database. This allows for the extraction of text and transcription of audio.
The tool offers two primary modes of operation: as a desktop application platform for deploying NextJS apps and as a backend library for integrating desktop context into existing applications. It supports embeddings, RAG pipelines, and local LLMs via Ollama, as well as OpenAI/Anthropic proxy.
Features
- 24/7 Recording: Records screen, audio, UI elements, and interactions continuously.
- Local Data Storage: Extracts text, transcribes audio, and stores data in a local SQLite database.
- Embeddings & RAG: Supports embeddings, RAG pipelines, and local LLMs via Ollama.
- OpenAI/Anthropic Proxy: Integration with OpenAI and Anthropic.
- Dual Functionality: Operates as a desktop app platform and a backend library.
- Cross-platform: Compatible with Windows, macOS, and Linux
Use Cases
- Build AI assistants that understand user's desktop context.
- Create search tools that index and query desktop activities.
- Develop tools to analyze and optimize user workflows.
- Applications requiring user activity tracking.
