Cloning A Voice for Voice Changer

Clone your own voice as a Voice Changer voice in ACE Studio.

What Is Voice Changer Cloning?

This is a feature to customize your own voice changer voice by uploading your samples. AI will learn the timbre based on the samples you upload, and clone a digital version of this voice.

After the customization, you can use your profile to convert voices from audio just like our pre-made AI voice changer voices in ACE Studio.

Your cloned AI voice is private under your account, no one else can access it without your authorization.

How to Clone My Voice for Voice Changer?

Preparing Your Datasets

Clean Dry Vocals

High-quality voices require clean and dry vocal samples:

• Without any reverb, delay, chorus effects

• Without background noise

• Without instrumentals or any non-human sounds

• Without any harmonies or vocal doubles

30-100 mins of singing vocal samples are recommended for a voice. The more samples you provide, the more singing details AI can learn, but it brings fewer benefits when you reach over 120 minutes.

Room Reflections

Vocals recorded with big room reflections might cause error recognitions and result in unexpected model performances.

Vocals from stem splitter

When you are using vocal remover or stem splitter for vocals, the output quality might be damaged too low for training. For a higher quality voice model, please optionally use vocals from stem splitter.

Recording Samples

Quality microphone with audio interface

Professional microphones with audio interfaces bring high-quality vocals. You'll need recording software to connect to your interface, record, edit, and mix your vocals.

When recording for a voice model, avoid microphones that are not built for singing:

• Phone or laptop mics

• Lapel or headset mics

• Karaoke mics

• Earphone mics or bluetooth earphones like air pods (these are usually for phone talks)

Recording environment

1. Unwanted background noises can include people talking, electrical hums and buzzes, traffic and outdoor noise, as well as movements of accessories or objects. To prevent these noises from interfering with your recording, it is important to select a quiet location. Choose a place where you can minimize or eliminate unexpected noise disturbances.

2. Sound reflections can occur due to the presence of hard, level surfaces, resulting in reverberation or echoes in your recordings. This can give your tracks a hollow or distant quality, detracting from the desired intimacy and clarity.

3. Try clapping your hands sharply in the room and listen carefully. If you perceive a fluttering sound or a prolonged echo, it indicates the presence of reverb issues.

4. To address this, incorporate soft materials that can absorb sound. Consider using carpets, rugs, or thick curtains to significantly reduce reflections. Covering hard floors and, if possible, hanging curtains over windows, as well as placing furniture with fabric coverings in the room, can be beneficial.

5. Avoid using hard surfaces as they contribute to the problem. If you cannot afford professional acoustic panels, you can utilize everyday items such as canvas paintings, tapestries, or foam tiles to break up these surfaces.

6. When setting up your microphone, be mindful of its placement. Avoid positioning it too close to walls or in corners. Instead, aim for the center of the room or experiment with different locations to find the optimal spot with minimal reverb.

Headphone bleed

During recordings, particularly when capturing vocals, it is common for the audio from headphones to bleed into the microphone. This issue arises when the volume of the headphones is set too high or when open-back headphones are being used. This might be acceptable when recording for a song, but try to avoid this bleeding when recording for your voice model.

Microphone placement

For regular volume, it is recommended to position yourself about 2 inches away from the microphone. However, for louder phrases or when belting, it is advisable to increase the distance to around 4-6 inches. It is important to note that you should always stay closer than 12 inches from the microphone to maintain optimal audio capture.

Creating Space for Belting

When engaging in belting techniques, it's important to allow yourself ample space, both in terms of microphone distance and the size of the room you're in. Excessive sound isolation, such as being confined in a closet or booth, or surrounding your microphone with foam, can easily result in overloading the microphone capsule. If you're unsure, it's advisable to incorporate more room sound when performing belted phrases.

Singing Languages

For a voice changer voice, you don’t need to keep all samples in one language.

Singing or Speech

For a voice changer voice, there is no big difference between speech samples and singing samples. But for a singing voice changer voice, it is more suitable to use singing samples for training.

File Quality Settings

The audio quality of your samples directly impacts the quality of your voice.

We recommend you to set your audio quality in:

• Bit Depth = 16-bit

• Sample Rate = 44.1khz or 48khz

• Lossless file format (.wav or .flac)

Post-Processing

To maintain the natural character and clarity of your target voice:

• No overlaps: multi-layered vocals can complicate AI's analysis. Place the overlapped takes at back and stick to a single vocal track to ensure the AI can accurately process and learn from your samples.

• No hard cuts: hard cuts can create abrupt starts or ends, which are not normal in a natural singing sound and can introduce clicks or pops. Use smooth fades at the beginning and end of the vocal clip for a more natural transition.

• No duplicating sections: Duplicated sections don't help for the training. Your voice model benefits from the natural variation of performance.

• Control the volume: Make sure your samples stay around 30-50% of your meter. Use a volume rider or automation to make sure volume levels are consistent across your entire dataset. The aim is to create a consistent volume level across the recording while keeping the dynamics within sections.

Training Your Voice

You can customize one voice changer voice in one custom slot.

Click on a slot to start uploading your samples.

After all samples being uploaded, the training will start automatically. You can check its status by refreshing the webpage.

When the page jumps back to the slot list with a new trained voice, you’re all set.

Click ‘Open in ACE’ to open ACE Studio and use your new trained voice.

Re-training Your Voice

Click on the Retrain button to retrain your voice.

Retraining will remove your previous voice under this slot. AI will start training a completely new voice from scratch using the new dataset. Prior to initiating the retraining process, you have the option to either retain the historical samples within this slot and upload additional new samples, or you can choose to clear the historical samples and only use the newly uploaded samples.

When preparing new samples, please note:

• If the duration of newly added samples is significantly smaller than the already uploaded samples, for example, adding 1 min of new sample to a dataset of 30 mins, retraining may not bring about significant changes in the performance of the model.

• Retraining will not change the type of your slot.

When should I retrain my voice?

• When your datasets has better quality or larger amount than before, you can use them to iteratively improve your voice

• When you are not satisfied with the current result and want to adjust your datasets

Managing Your Voice

Click on the Manage button to open the management window of a custom voice changer voice. In that window, you can modify:

• Model picture

• Model name

• Tags

• Model type

• Language tag (only for the type of voice)

After doing changes, you can click on the Open in ACE button to refresh the voice list of ACE Studio.