AI Personal Learning
and practical guidance

Retrieval based Voice Conversion WebUI: A Framework for Retrieval-based Voice Conversion | Simulating Real-life Singing Voices

General Introduction

Retrieval based Voice Conversion WebUI is a simple and easy-to-use VITS-based voice conversion framework, which can realize voice conversion between any speakers, including song cover and real-time voice change. It features low latency, excellent voice conversion effect, small amount of data training, etc. It supports N-card, A-card and I-card acceleration, provides web interface and real-time voice conversion interface, and can also call UVR5 model to quickly separate the human voice from the accompaniment, and use the most advanced human voice pitch extraction algorithm, RMVPE, to eliminate the problem of mute voice.

colab online experience

The bottom model is trained using close to 50 hours of open-source, high-quality VCTK training set, with no copyright concerns.


Look for RVCv3's bottom model with bigger parameters, bigger data, better results, essentially equal inference speed, and less training data required.

 

-1

Training Reasoning Interface

 

-2

Real-time voice change interface

 

 

Function List

 

  • Train your own speech conversion model with as little as 10 minutes of speech data
  • Supports multiple sample rates and tones using pre-trained speech conversion models
  • Speech conversion using a web interface or a real-time voice-altering interface with end-to-end low latency support
  • Uses UVR5 modeling to separate vocals and backing tracks, supports multiple audio file formats
  • Use RMVPE algorithm to extract vocal pitch, support pytorch/onnx/DirectML

 

 

Using Help

 

  • Download or clone this repository and install the required dependencies and pre-models
  • Run go-web.bat or go-realtime-gui.bat and select the action you want to perform
  • According to the interface prompts, select the input and output voice files or devices, adjust parameters and options
  • Click start or stop and enjoy voice conversion!
AI Easy Learning

The layman's guide to getting started with AI

Help you learn how to utilize AI tools at a low cost and from a zero base.AI, like office software, is an essential skill for everyone. Mastering AI will give you an edge in your job search and half the effort in your future work and studies.

View Details>
May not be reproduced without permission:Chief AI Sharing Circle " Retrieval based Voice Conversion WebUI: A Framework for Retrieval-based Voice Conversion | Simulating Real-life Singing Voices

Chief AI Sharing Circle

Chief AI Sharing Circle specializes in AI learning, providing comprehensive AI learning content, AI tools and hands-on guidance. Our goal is to help users master AI technology and explore the unlimited potential of AI together through high-quality content and practical experience sharing. Whether you are an AI beginner or a senior expert, this is the ideal place for you to gain knowledge, improve your skills and realize innovation.

Contact Us
en_USEnglish