Use this file to discover all available pages before exploring further.

Media overview

OpenClaw generates images, videos, and music, understands inbound media (images, audio, video), and speaks replies aloud with text-to-speech. All media capabilities are tool-driven: the agent decides when to use them based on the conversation, and each tool only appears when at least one backing provider is configured.

Capabilities

Image generation

Create and edit images from text prompts or reference images via `image_generate`. Synchronous — completes inline with the reply.

Video generation

Text-to-video, image-to-video, and video-to-video via `video_generate`. Async — runs in the background and posts the result when ready.

Music generation

Generate music or audio tracks via `music_generate`. Async on shared providers; ComfyUI workflow path runs synchronously.

Text-to-speech

Convert outbound replies to spoken audio via the `tts` tool plus `messages.tts` config. Synchronous.

Media understanding

Summarize inbound images, audio, and video using vision-capable model providers and dedicated media-understanding plugins.

Speech-to-text

Transcribe inbound voice messages through batch STT or Voice Call streaming STT providers.

Provider capability matrix

Provider	Image	Video	Music	TTS	STT	Realtime voice	Media understanding
Alibaba		✓
BytePlus		✓
ComfyUI	✓	✓	✓
DeepInfra	✓	✓		✓	✓		✓
Deepgram					✓	✓
ElevenLabs				✓	✓
fal	✓	✓
Google	✓	✓	✓	✓		✓	✓
Gradium				✓
Local CLI				✓
Microsoft				✓
MiniMax	✓	✓	✓	✓
Mistral					✓
OpenAI	✓	✓		✓	✓	✓	✓
OpenRouter	✓	✓		✓			✓
Qwen		✓
Runway		✓
SenseAudio					✓
Together		✓
Vydra	✓	✓		✓
xAI	✓	✓		✓	✓		✓
Xiaomi MiMo	✓			✓			✓

note

Media understanding uses any vision-capable or audio-capable model registered in your provider config. The matrix above lists providers with dedicated media-understanding support; most multimodal LLM providers (Anthropic, Google, OpenAI, etc.) can also understand inbound media when configured as the active reply model.

Async vs synchronous

Capability	Mode	Why
Image	Synchronous	Provider responses return in seconds; completes inline with reply.
Text-to-speech	Synchronous	Provider responses return in seconds; attached to the reply audio.
Video	Asynchronous	Provider processing takes 30 s to several minutes.
Music (shared)	Asynchronous	Same provider-processing characteristic as video.
Music (ComfyUI)	Synchronous	Local workflow runs inline against the configured ComfyUI server.

For async tools, OpenClaw submits the request to the provider, returns a task id immediately, and tracks the job in the task ledger. The agent continues responding to other messages while the job runs. When the provider finishes, OpenClaw wakes the agent so it can post the finished media back into the original channel.

Speech-to-text and Voice Call

Deepgram, DeepInfra, ElevenLabs, Mistral, OpenAI, SenseAudio, and xAI can all transcribe inbound audio through the batch

text

tools.media.audio

path when configured. Channel plugins that preflight a voice note for mention gating or command parsing mark the transcribed attachment on the inbound context, so the shared media-understanding pass reuses that transcript instead of making a second STT call for the same audio.

Deepgram, ElevenLabs, Mistral, OpenAI, and xAI also register Voice Call streaming STT providers, so live phone audio can be forwarded to the selected vendor without waiting for a completed recording.

OpenClaw Docs