Back to KizunaAI Quick Start

Choose a Voice or Clone Your Own

Overview

When Sokuji speaks a translation, KizunaAI uses a voice: for your translation when Translation the other side hears is on (Me or Both mode), and for the other side’s when Translation I hear is on. You can pick one of about 200 preset voices, or clone your own voice from a short recording so that the other side hears the translation in your voice. All of this is in Settings → Advanced → Provider. The screenshots are from Sokuji 0.44.0.

1Open the voice settings

Open Settings, switch to Advanced with the button at the top right of the panel, and choose the Provider tab. Voice Settings shows the voice in use, with a short description of how it sounds. The Speech block leads there too: under each spoken row, Voice is followed by the voice’s name, and clicking the name opens Voice Settings.

Open the voice settings

2Browse and filter the preset voices

Click the voice to open the list. Narrow it down by gender, age, accent, use case and style, and press the play button to hear a sample. Previews are synthesized for you and charged to your account balance.

Browse and filter the preset voices

3Add your own voice

Under Custom voices (0/1), choose Add a voice…. Import an audio file with Import voice…, record straight away with Record voice…, or drop a file onto the dialog. The clip must be between 3 seconds and 2 minutes long, and at most 35 MB.

Add your own voice

Tip

A clear recording of you speaking naturally, in a quiet room, gives the best result.

4Listen, confirm and clone

Listen to the clip, tick I confirm I have the right to use this voice and click Clone voice. The recording is sent to Kizuna AI and passed on to Soniox to build your voice. It is not stored on Kizuna AI’s servers; it stays on this device so your voice can be rebuilt later.

Listen, confirm and clone

5Use “My voice”

Your clone appears as My voice under Custom voices (1/1). Select it like any preset; the play button previews it and the bin deletes it.

Use “My voice”

6Replace your voice

Each account has one custom voice. While you have it, the list reads Custom voices (1/1) and offers no Add a voice…. To use a new recording, delete My voice with the bin first: Add a voice… then comes back.

Replace your voice

7Choose the voice you hear

While the other side’s translation is read to you (Translation I hear on), Voice Settings has two rows. Voice the other side hears is the voice of your translation: a preset or My voice. Voice I hear reads the other person’s translation to you and offers the preset voices only. By default the two are different voices, so you can tell the two people apart; if you pick the same voice for both, a note under Voice I hear names the voice that reads instead.

Choose the voice you hear

8Adjust the speech speed

Under Speech Synthesis (TTS) Settings, Speech Speed makes the translated voice slower or faster, from 0.7× to 1.3×.

Adjust the speech speed

Tips

  • A voice is only used when a translation is spoken. With Translation the other side hears and Translation I hear both switched off, no voice is needed.
  • Building a custom voice and previewing voices need a balance on your account.
  • Settings are locked while a session runs. Stop the session to change the voice.

Frequently Asked Questions

Why does a session use a built-in voice instead of My voice?

Sokuji tells you when this happens and why. The most common reasons: this device has no copy of your recording (record it again in Settings to use your voice on this computer), all custom voice slots are busy for the moment, or the voice could not be built from the clip (try a clearer recording). The session continues with a built-in voice.

Does my recording have to be in the language my translation is spoken in?

No. Your voice is not tied to the language of the recording: cloned from you speaking English, it still speaks your Spanish translation in your voice. If you can, record yourself speaking the language your translation is spoken in: it then sounds the most like you speaking that language.

Can I clone someone else’s voice?

Only with their permission. You confirm that you have the right to use the voice before it is cloned.

Can the other person’s translation be read in my cloned voice?

No. Voice I hear offers the preset voices only. Your cloned voice speaks your own translation.

Does my voice work in every region?

Custom voices belong to one region, and each region remembers its own voice choice. If you change the region, add your voice again there. Voice I hear is one choice for every region.

Troubleshooting

Still stuck? Send us feedback from the account menu, or write to support@kizuna.ai. You can also ask in GitHub Discussions.