#voice-clone

2 tutorials, projects and news items tagged voice-clone.

Dub a video into another language in the speaker's voice

Use when the user wants to dub a video into another language while keeping the original speaker's voice. Transcribes the original locally with timestamps, translates line by line to fit each line's duration, synthesizes each line in the original speaker's cloned voice with F5-TTS, places each line back at its original time point (speeding up by at most 1.25x), then swaps in the new audio track and generates subtitles. Includes a Chinese polyphone replacement table. Everything runs locally for free. The official F5-TTS model only supports Chinese and English, and its pretrained model is not licensed for commercial use. Use case: Have your AI agent dub a video line by line into another language, in your own voice

Skill·Intermediate·5 minvideodubbingvoice-clonetts
Let Your AI Agent Dub Your Video in Your Own Voice

Beginner tutorial: Use our own local method for bilingual videos to have your AI agent transcribe the original with timestamps, translate each line to fit its duration, clone the original voice with F5-TTS to synthesize line by line and place each line back at its original time, then swap in the new audio track and subtitles. Covers how to fix misread Chinese polyphones, with 3 prompts you can copy and paste.

Tutorial·Beginner·8 min·Videovideodubbingvoice-clonetts