Agent skill

fal-lip-sync

Create talking head videos, lip sync audio to video, and animate portraits with expressions. Use when the user requests "Talking head", "Lip sync", "Make this person talk", "Animate portrait", "Live portrait", "Avatar video".

Stars 45
Forks 6

Install this agent skill to your Project

npx add-skill https://github.com/fal-ai-community/skills/tree/main/skills/claude.ai/fal-lip-sync

Metadata

Additional technical details for this skill

author
fal-ai
version
1.0.0

SKILL.md

fal-lip-sync

Create talking head videos, sync lips to audio, and animate portraits using fal.ai models.

Scripts

Script Purpose
talking-head.sh Generate a talking head video from an image + audio/text
lip-sync.sh Sync lips in an existing video to new audio

Usage

Talking Head (Image + Audio → Video)

bash
./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --audio-url "https://example.com/speech.mp3" --model veed/fabric-1.0

Talking Head (Image + Text → Video with auto TTS)

bash
./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --text "Hello, welcome to our presentation" --model fal-ai/creatify/aurora

Lip Sync (Video + Audio → Synced Video)

bash
./scripts/lip-sync.sh --video-url "https://example.com/video.mp4" --audio-url "https://example.com/new-speech.mp3"

Arguments

talking-head.sh

Argument Description Required
--image-url URL of portrait/face image Yes
--audio-url URL of audio to sync Yes (or --text)
--text Text to speak (auto TTS) Yes (or --audio-url)
--model / -m Model endpoint No (default: veed/fabric-1.0)
--tts-model TTS model for --text mode No (default: fal-ai/minimax/speech-2.6-turbo)
--wait / -w Wait for completion No (default: true)
--async / -a Return request ID immediately No

lip-sync.sh

Argument Description Required
--video-url URL of video to lip sync Yes
--audio-url URL of audio to sync to Yes
--model / -m Model endpoint No (default: fal-ai/sync-lipsync/v2)

Finding Models

To discover the best and latest lip sync and talking head models, use the search API:

bash
# Search for talking head models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "talking head"

# Search for lip sync models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "lip sync"

# Search for live portrait / expression transfer
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "live portrait"

Or use the search_models MCP tool with relevant keywords like "lip sync", "talking head", "avatar".

Output Format

json
{
  "video": {
    "url": "https://fal.media/files/...",
    "content_type": "video/mp4"
  }
}

Present the video URL directly to the user.

Expand your agent's capabilities with these related and highly-rated skills.

fal-ai-community/skills

fal-image-edit

Edit images using AI on fal.ai. Style transfer, object removal, background changes, and more. Use when the user requests "Edit image", "Remove object", "Change background", "Apply style", or similar image editing tasks.

45 6
Explore
fal-ai-community/skills

fal-workflow

Generate production-ready fal.ai workflow JSON files. Use when user requests "create workflow", "chain models", "multi-step generation", "image to video pipeline", or complex AI generation pipelines.

45 6
Explore
fal-ai-community/skills

fal-restore

Restore and fix image quality — deblur, denoise, dehaze, fix faces, restore documents. Use when the user requests "Fix blurry image", "Remove noise", "Fix face", "Restore photo", "Enhance document", "Deblur", "Denoise".

45 6
Explore
fal-ai-community/skills

fal-platform

fal.ai Platform APIs for model management, pricing, usage tracking, and cost estimation. Use when user asks "show pricing", "check usage", "estimate cost", "setup fal", "add API key", or platform management tasks.

45 6
Explore
fal-ai-community/skills

fal-vision

Analyze images using AI — segment objects, detect objects, extract text (OCR), describe images, ask questions about images. Use when the user requests "Segment image", "Detect objects", "OCR", "Extract text from image", "Describe image", "What's in this image", "Image analysis".

45 6
Explore
fal-ai-community/skills

fal-tryon

Virtual try-on — see how clothes look on a person. Use when the user requests "Try on clothes", "Virtual try-on", "How does this look on me", "Fashion try-on", "Garment transfer".

45 6
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results