Voice Reply Skill

Generate spoken audio responses using OpenAI's Text-to-Speech API.

When to Use

1. When the user asks to "reply by voice", "voice reply", "speak this", or similar voice-related requests.

2. Command trigger: When user sends /voice_note, resend the last message as a voice note.

   • Remove all emojis from the text before converting to speech
   • Rephrase if needed to make it sound natural when spoken (e.g., convert bullet points to flowing sentences)

How to Use

1. Prepare the Response

Write your response without emojis — they don't translate well to speech.

2. Generate Audio

Important: Use opus format for Telegram voice notes (shows waveform bubble).

curl https://api.openai.com/v1/audio/speech \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o-mini-tts",
    "input": "<your text here>",
    "voice": "echo",
    "speed": 1.2,
    "response_format": "opus"
  }' -s --output /tmp/voice_reply.ogg

3. Send the Audio

Copy to outbound folder and send via message tool:

mkdir -p /home/exedev/.clawdbot/media/outbound
cp /tmp/voice_reply.ogg /home/exedev/.clawdbot/media/outbound/voice_reply.ogg

Then use the message tool with asVoice: true for proper voice message format:

{
  "action": "send",
  "channel": "telegram",
  "to": "<user_id>",
  "media": "/home/exedev/.clawdbot/media/outbound/voice_reply.ogg",
  "asVoice": true
}

Important:

• Use .ogg (opus) format — required for Telegram voice notes
• asVoice: true sends as voice bubble with waveform
• message caption is optional for voice notes

Configuration Options

Voice Options

Speed

• Range: 0.25 to 4.0
• Default: 1.2 (slightly faster than normal)

Model

• gpt-4o-mini-tts — Fast, cost-effective
• tts-1 — Standard quality
• tts-1-hd — High definition

Example Workflow

# 1. Generate audio (opus format for Telegram voice notes)
curl https://api.openai.com/v1/audio/speech \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o-mini-tts",
    "input": "Hey Oscar! Your main task today is Create Task Skill. Let me know if you need help!",
    "voice": "echo",
    "speed": 1.2,
    "response_format": "opus"
  }' -s --output /tmp/reply.ogg

# 2. Copy to outbound
cp /tmp/reply.ogg ~/.clawdbot/media/outbound/reply.ogg

# 3. Send via message tool with asVoice: true

Tips

• Keep responses concise for voice — long text becomes tiring to listen to
• Avoid special characters, URLs, and code blocks
• Use natural language, as if speaking to someone
• Numbers and dates should be written out naturally

References

• OpenAI TTS Documentation
• OpenAI Audio API Reference