Agent skill

glmv-prompt-gen

Analyze images/videos and generate professional prompts for text-to-image and text-to-video AI tools (Midjourney, Stable Diffusion, DALL-E, Sora, Runway, Kling, Pika). Use when the user wants to generate prompts from reference images/videos, create AI art prompts, or get prompt engineering suggestions from visual content.

View SKILL.md on GitHub Repository
Stars 304
Forks 22

Install this agent skill to your Project

npx add-skill https://github.com/zai-org/GLM-skills/tree/main/skills/glmv-prompt-gen

Metadata

Additional technical details for this skill

openclaw 
{
    "emoji": "\u2728",
    "homepage": "https://github.com/zai-org/GLM-V/tree/main/skills/glmv-prompt-gen",
    "requires": {
        "env": [
            "ZHIPU_API_KEY"
        ],
        "bins": [
            "python"
        ]
    },
    "primaryEnv": "ZHIPU_API_KEY"
}

SKILL.md

GLM-V Prompt Generation Skill

Analyze reference images or videos and generate professional prompts for AI image/video generation tools.

When to Use

  • Generate prompts for text-to-image tools (Midjourney, Stable Diffusion, DALL-E, etc.)
  • Generate prompts for text-to-video tools (Sora, Runway, Kling, Pika, etc.)
  • User mentions "生成prompt", "文生图prompt", "文生视频prompt", "prompt工程", "参考图生成prompt", "generate prompt"
  • User provides an image/video and wants to recreate or remix it
  • Extract prompt ideas from reference visual content

Supported Input Types

Type Formats Max Size Max Count Base64
Image jpg, png, jpeg 5MB / 6000×6000px 50 ✅
Video mp4, mkv, mov 200MB — ❌ (URL only)

⚠️ Images and videos cannot be used in the same request. ⚠️ Videos only support URLs — local paths and base64 are NOT supported.

📋 Output Display Rules (MANDATORY)

After running the script, you must display the full prompt output exactly as returned. Do not summarize, truncate, or only say "prompt generated". Users need the complete prompt (especially the English prompt) for direct copy/paste.

  • Show the full output: content analysis + prompt + prompt breakdown
  • In auto mode, show both text-to-image and text-to-video prompts
  • English prompts are core output and must be shown completely
  • If output was saved (-o), provide the file path and show file content

Output Modes

Mode Description
image Generate prompts for text-to-image tools (default)
video Generate prompts for text-to-video tools
auto Generate prompts for both image and video

Resource Links

Resource Link
Get API Key https://bigmodel.cn/usercenter/proj-mgmt/apikeys
API Docs Chat Completions / 对话补全

Prerequisites

API Key Setup / API Key 配置（Required / 必需）

This script reads the key from the ZHIPU_API_KEY environment variable and shares it with other Zhipu skills. 脚本通过 ZHIPU_API_KEY 环境变量获取密钥，与其他智谱技能共用同一个 key。

Get Key / 获取 Key： Visit Zhipu Open Platform API Keys / 智谱开放平台 API Keys to create or copy your key.

Setup options / 配置方式（任选一种）：

  1. OpenClaw config (recommended) / OpenClaw 配置（推荐）： Set in openclaw.json under skills.entries.glmv-prompt-gen.env:

    json
    "glmv-prompt-gen": { "enabled": true, "env": { "ZHIPU_API_KEY": "你的密钥" } }

  2. Shell environment variable / Shell 环境变量： Add to ~/.zshrc:

    bash
    export ZHIPU_API_KEY="你的密钥"

💡 If you already configured another Zhipu skill (for example zhipu-tools or glmv-caption), they share the same ZHIPU_API_KEY, so no extra setup is needed. 💡 如果你已为其他智谱 skill（如 zhipu-tools、glmv-caption）配置过 key，它们共享同一个 ZHIPU_API_KEY，无需重复配置。

How to Use

Image → Text-to-Image Prompt

bash
python scripts/prompt_gen.py --images "https://example.com/photo.jpg"
python scripts/prompt_gen.py --images /path/to/photo.png

Image → Text-to-Video Prompt

bash
python scripts/prompt_gen.py --images "https://example.com/scene.jpg" --mode video

Image → Both (Image + Video Prompts)

bash
python scripts/prompt_gen.py --images "https://example.com/photo.jpg" --mode auto

Video → Text-to-Video Prompt

bash
python scripts/prompt_gen.py --videos "https://example.com/clip.mp4" --mode video

Save Result to File

bash
python scripts/prompt_gen.py --images photo.jpg --mode image -o prompt.md

Custom Model

bash
python scripts/prompt_gen.py --images photo.jpg --model glm-4.6v-flash

Output Example (image mode)

### Content Analysis
A cyberpunk cityscape at night, with dense skyscrapers, glowing neon signs, and rain-wet streets reflecting colorful light.

### Prompt
Cyberpunk cityscape at night, towering skyscrapers with glowing neon signs,
rain-wet streets reflecting colorful lights, flying cars in the distance,
volumetric fog, dramatic lighting, ultra detailed, 8K, cinematic composition

### Prompt Breakdown
- **Subject**: Futuristic skyline with skyscrapers and neon lights
- **Style**: Cyberpunk, sci-fi
- **Color**: Cool/warm contrast with blue-purple dominance and neon accents
- **Lighting**: Neon glow, wet-surface reflections, volumetric fog
- **Composition**: Wide-angle perspective with layered depth
- **Mood**: Mysterious, futuristic, high-tech

CLI Reference

python scripts/prompt_gen.py (--images IMG [IMG...] | --videos VID [VID...]) [OPTIONS]
Parameter Required Description
--images, -i One of Image paths or URLs (jpg/png/jpeg, base64 OK)
--videos, -v One of Video URLs (mp4/mkv/mov, URL only)
--mode, -m No Output mode: image (default), video, or auto
--model No Model name (default: glm-4.6v)
--temperature, -t No Sampling temperature 0-1 (default: 0.6)
--max-tokens No Max output tokens (default: 2048)
--thinking No Enable thinking/reasoning mode
--stream No Enable streaming output
--output, -o No Save result to file
--pretty No Pretty-print JSON error output

Error Handling

API key not configured: → Guide user to configure ZHIPU_API_KEY

Authentication failed (401/403): → API key invalid/expired → check at Zhipu API Keys / 智谱官网

Rate limit (429): → Quota exhausted → wait and retry

Content filtered: → warning field present → content blocked by safety review

Timeout: → Video processing may take time → increase timeout or use smaller files

Recommended Agent Skills

Expand your agent's capabilities with these related and highly-rated skills.

zai-org/GLM-skills

glmocr-handwriting

Official skill for recognizing handwritten text from images using ZhiPu GLM-OCR API. Supports various handwriting styles, languages, and mixed handwritten/printed content. Use this skill when the user wants to read handwritten notes, convert handwriting to text, or OCR handwritten documents.

304 22
Explore
zai-org/GLM-skills

glmv-prd-to-app

Build a complete, production-ready full-stack web application from PRD documents, prototype images, and resource files. Handles the entire pipeline: system design, database schema, seed data, backend API, frontend UI, visual verification against prototypes, and deployment script generation. Use this skill whenever the user: - Provides a PRD (product requirement document) and wants a working app built - Says things like "根据PRD开发", "build from PRD", "implement this product", "把需求文档做成应用", "develop this app from requirements" - Has prototype images + requirements and wants full-stack implementation - Wants to turn product specifications into a running web application - Mentions building an app from wireframes/mockups combined with a requirements doc Trigger this skill even if the user just says "帮我开发" or "build this" with PRD materials present in the working directory.

304 22
Explore
zai-org/GLM-skills

glmocr-table

Official skill for recognizing and extracting tables from images and PDFs into Markdown format using ZhiPu GLM-OCR API. Supports complex tables, merged cells, and multi-page documents. Use this skill when the user wants to extract tables, recognize spreadsheets, or convert table images to editable format.

304 22
Explore
zai-org/GLM-skills

glmv-doc-based-writing

Write a textual content based on given document(s) and requirements, using ZhiPu GLM-V multimodal model. Read and comprehend one or multiple documents (PDF/DOCX), write a content in Markdown format according to the specified requirements. Use when the user wants to draft a paper/article/essay/report/review/post/brief/proposal/plan, etc.

304 22
Explore
zai-org/GLM-skills

glmocr-formula

Official skill for recognizing and extracting mathematical formulas from images and PDFs into LaTeX format using ZhiPu GLM-OCR API. Supports complex equations, inline formulas, and formula blocks. Use this skill when the user wants to extract formulas, convert formula images to LaTeX, or OCR mathematical expressions.

304 22
Explore
zai-org/GLM-skills

glmv-caption

Generate captions (descriptions) for images, videos, and documents using ZhiPu GLM-V multimodal model series. Use this skill whenever the user wants to describe, caption, summarize, or interpret the content of images, videos, or files. Supports single/multiple inputs, URLs, local paths, and base64 (images only).

304 22
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results