diff --git a/README.md b/README.md index 0e01098..152881c 100644 --- a/README.md +++ b/README.md @@ -4,31 +4,54 @@ For `SenseVoice`, visit [SenseVoice repo](https://github.com/FunAudioLLM/SenseVoice) and [SenseVoice space](https://www.modelscope.cn/studios/iic/SenseVoice). + +## Highlight + +**CosyVoice 2.0** has been released! Compared to version 1.0, the new version offers more accurate, more stable, faster, and better speech generation capabilities. + +### Multilingual +- **Support Language**: Chinese, English, Japanese, Korean, Chinese dialects (Cantonese, Sichuanese, Shanghainese, Tianjinese, Wuhanese, etc.) +- **Crosslingual & Mixlingual**:Support zero-shot voice cloning for cross-lingual and code-switching scenarios. + +### Ultra-Low Latency +- **Bidirectional Streaming Support**: CosyVoice 2.0 integrates offline and streaming modeling technologies. +- **Rapid First Packet Synthesis**: Achieves latency as low as 150ms while maintaining high-quality audio output. + +### High Accuracy +- **Improved Pronunciation**: Reduces pronunciation errors by 30% to 50% compared to CosyVoice 1.0. +- **Benchmark Achievements**: Attains the lowest character error rate on the hard test set of the Seed-TTS evaluation set. + +### Strong Stability +- **Consistency in Timbre**: Ensures reliable voice consistency for zero-shot and cross-language speech synthesis. +- **Cross-language Synthesis**: Marked improvements compared to version 1.0. + +### Natural Experience +- **Enhanced Prosody and Sound Quality**: Improved alignment of synthesized audio, raising MOS evaluation scores from 5.4 to 5.53. +- **Emotional and Dialectal Flexibility**: Now supports more granular emotional controls and accent adjustments. + + ## Roadmap +- [x] 2024/12 + + - [x] 25hz cosyvoice 2.0 released + +- [x] 2024/09 + + - [x] 25hz cosyvoice base model + - [x] 25hz cosyvoice voice conversion model + +- [x] 2024/08 + + - [x] Repetition Aware Sampling(RAS) inference for llm stability + - [x] Streaming inference mode support, including kv cache and sdpa for rtf optimization + - [x] 2024/07 - [x] Flow matching training support - [x] WeTextProcessing support when ttsfrd is not avaliable - [x] Fastapi server and client -- [x] 2024/08 - - - [x] Repetition Aware Sampling(RAS) inference for llm stability - - [x] Streaming inference mode support, including kv cache and sdpa for rtf optimization - -- [x] 2024/09 - - - [x] 25hz cosyvoice base model - - [x] 25hz cosyvoice voice conversion model - -- [ ] TBD - - - [ ] 25hz llama based llm model which supports lora finetune - - [ ] Support more instruction mode - - [ ] Music generation - - [ ] CosyVoice-500M trained with more multi-lingual data - - [ ] More... ## Install