NeoRVC 🎵
An extension of AIcoverGen to create covers with any RVC v2 trained AI voice from YouTube videos or a local audio file. For developers who may want to add a singing functionality into their AI assistant/chatbot/vtuber, or for people who want to hear their favourite characters sing their favourite song. to create covers with any RVC v2 trained AI voice from YouTube videos or a local audio file. For developers who may want to add a singing functionality into their AI assistant/chatbot/vtuber, or for people who want to hear their favourite characters sing their favourite song.
Changelog
- WebUI for easier conversions and downloading of voice models
- Hybrid Pitch detection method control Method
- Support for cover generations from a local audio file
- Option to keep intermediate files generated. e.g. Isolated vocals/instrumentals
- Download suggested public voice models from table with search/tag filters
- Support for Pixeldrain download links for voice models
- Implement new rmvpe pitch extraction technique for faster and higher quality vocal conversions
- Volume control for AI main vocals, backup vocals and instrumentals
- Index Rate for Voice conversion
- Reverb Control for AI main vocals
- Local network sharing option for webui
- Extra RVC options - filter_radius, rms_mix_rate, protect
- Local file upload via file browser option
- Upload of locally trained RVC v2 models via WebUI
- Pitch detection method control, e.g. rmvpe/crepe/fcpe
- Pitch change for vocals
- Audio output format option: wav or mp3.
- Cli Inference
How to use cli
full inference:
python ./neorvc/main_cli.py "https://youtube.com/watch?v=example" "my_voice_model" --pitch_change 2 --keep_files --output_type full
vocal_only inference:
python ./neorvc/main_cli.py "path/to/vocals.wav" "my_voice_model" --output_type vocals
References
The NeoRVC builds upon the foundations of the following projects:
Vocoders:
VC Clients:
- Retrieval-based-Voice-Conversion-WebUI by RVC-Project
- rvc-cli by blaisewf
- So-Vits-SVC by svc-develop-team
- Mangio-RVC-Fork by Mangio621
- VITS by jaywalnut310
- Harmonify by Eempostor
- rvc-trainer by thepowerfuldeez
- AICoverGen by SociallyIneptWeeb
Pitch Extractors:
- RMVPE by Dream-High
- torchfcpe by CNChTu
- torchcrepe by maxrmorrison
- anyf0 by SoulMelody
Other:
- FAIRSEQ by facebookresearch
- FAISS by facebookresearch
- ContentVec by auspicious3000
- audio-slicer by openvpi
- python-audio-separator by nomadkaraoke
We acknowledge and appreciate the contributions of the respective authors and communities involved in these projects.
Contributions
If you want to participate and help me with this project feel free to create an issue if something goes wrong or make a pull request to improve this project.
Any type of contribution is welcome 🔥
If you like this project you can star this repository. I will appreciate a lot 😸
You can donate to the me on here:
