Agent skill

media-understand

使用 AI 理解和分析多媒体内容(图片、视频、音频)。Use when user wants to 理解图片, 分析视频, 音频转文字, 视频问答, understand media, analyze video, transcribe audio, describe image, what is in this video/image/audio.

Stars 0
Forks 0

Install this agent skill to your Project

npx add-skill https://github.com/InfQuest/vibe-ops-plugin/tree/main/skills/media-understand

SKILL.md

Media Understanding

使用 Gemini 2.5 Flash 分析和理解多媒体内容。

Supported Formats

Type Formats Max Size
Image jpg, jpeg, png, gif, webp 20MB
Video mp4, mpeg, mov, webm, YouTube URL 100MB
Audio wav, mp3, aiff, aac, ogg, flac, m4a 100MB

Prerequisites

  1. MAX_API_KEY 环境变量(Max 自动注入)
  2. Bun 1.0+(Max v0.0.27+ 内置,无需额外安装)

Usage

bash
bun skills/media-understand/media-understand.js <media_path_or_url> [prompt] [language]

Arguments:

  • media_path_or_url: File path or YouTube URL
  • prompt: Question or analysis request (default: "Please describe this content")
  • language: Output language - chinese or english (default: chinese)

Examples

Image Analysis

bash
# Describe image
bun skills/media-understand/media-understand.js ./photo.jpg "请描述这张图片" chinese

# OCR - Extract text
bun skills/media-understand/media-understand.js ./screenshot.png "识别图片中的所有文字" chinese

# Answer question about image
bun skills/media-understand/media-understand.js ./chart.png "这个图表显示了什么趋势?" chinese

Video Analysis

bash
# YouTube video summary
bun skills/media-understand/media-understand.js "https://youtube.com/watch?v=xxx" "总结这个视频的主要内容" chinese

# Local video analysis
bun skills/media-understand/media-understand.js ./video.mp4 "视频中发生了什么?" chinese

# Timestamp-based question
bun skills/media-understand/media-understand.js "https://youtu.be/xxx" "视频 2:30 处讲了什么?" chinese

Audio Analysis

bash
# Transcribe audio
bun skills/media-understand/media-understand.js ./recording.mp3 "请转录这段音频" chinese

# Summarize podcast
bun skills/media-understand/media-understand.js ./podcast.m4a "总结这段播客的要点" chinese

# Detect speakers
bun skills/media-understand/media-understand.js ./meeting.wav "识别不同的说话人并整理他们说的内容" chinese

Common Prompts

Image:

  • 描述图片: "请详细描述这张图片的内容"
  • OCR: "识别并提取图片中的所有文字"
  • 物体识别: "图片中有哪些物体?"

Video:

  • 总结: "总结这个视频的主要内容"
  • 时间戳: "视频 X:XX 处发生了什么?"
  • 提取信息: "视频中提到了哪些关键信息?"

Audio:

  • 转录: "请转录这段音频的完整内容"
  • 总结: "总结这段音频的要点"
  • 说话人识别: "识别不同的说话人"

Notes

  • Video via Gemini: Best results with YouTube URLs. Local video files may have limited support.
  • Audio tokens: ~32 tokens/second
  • Video tokens: ~300 tokens/second at default resolution
  • Long media files will consume more tokens

Error Handling

File not found: Check the file path is correct

Unsupported format: Use supported formats listed above

File too large: Compress or trim the media file

API error: 请在 Max 设置中检查 Max API Key 是否正确配置

Expand your agent's capabilities with these related and highly-rated skills.

InfQuest/vibe-ops-plugin

youtube-download

使用 yt-dlp 下载 YouTube 视频、音频或字幕。Use when user wants to 下载视频, 下载YouTube, youtube下载, 下载油管, download youtube, download video, 下载B站, bilibili下载.

0 0
Explore
InfQuest/vibe-ops-plugin

video-gen

使用 AI 生成视频,支持 Veo/Sora 模型。Use when user wants to 生成视频, AI视频, 文生视频, 图生视频, generate video, create video, text to video, image to video, 做一个视频.

0 0
Explore
InfQuest/vibe-ops-plugin

video-trim

裁剪视频片段,支持压缩、音频控制等选项。Use when user wants to 剪辑视频, 裁剪视频, 截取视频, 视频剪切, 切视频, trim video, cut video, clip video, extract video segment.

0 0
Explore
InfQuest/vibe-ops-plugin

audio-extract

从视频文件中提取音频。Use when user wants to 提取音频, 抽取音频, 视频转音频, 导出音频, extract audio, video to audio, get audio from video, 把视频的声音提取出来.

0 0
Explore
InfQuest/vibe-ops-plugin

image-gen

使用 AI 生成图片,支持多种模型和风格。Use when user wants to 生成图片, 画图, 创建图像, AI绘图, 生成一张图, generate image, create image, draw picture, AI art, 编辑图片, 修改图片, edit image, modify image.

0 0
Explore
InfQuest/vibe-ops-plugin

skill-extractor

从当前会话中提取经验,自动生成可复用的 Claude Code Skill。Use when user wants to 提取skill, 总结成skill, 固化经验, 生成skill, extract skill, create skill from context, save as skill, 把经验变成skill.

0 0
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results