deepgeek/CosyVoice
2
0
Fork 0
mirror of https://github.com/FunAudioLLM/CosyVoice.git synced 2026-02-05 18:09:24 +08:00
Code Issues Packages Projects Releases Wiki Activity

[mod]readme

Browse Source
This commit is contained in:
hengwu.zty
2025-12-15 13:24:44 +08:00
parent 95d56cba64
commit f11ba4024c
1 changed files with 18 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

36
README.md
View File

@@ -12,7 +12,7 @@
**Fun-CosyVoice 3.0** is an advanced text-to-speech (TTS) system based on large language models (LLM), surpassing its predecessor (CosyVoice 2.0) in content consistency, speaker similarity, and prosody naturalness. It is designed for zero-shot multilingual speech synthesis in the wild. **Fun-CosyVoice 3.0** is an advanced text-to-speech (TTS) system based on large language models (LLM), surpassing its predecessor (CosyVoice 2.0) in content consistency, speaker similarity, and prosody naturalness. It is designed for zero-shot multilingual speech synthesis in the wild.
### Key Features ### Key Features
- **Language Coverage**: Covers 9 common languages (Chinese, English, Japanese, Korean, German, Spanish, French, Italian, Russian), 18+ Chinese dialects/accents (Guangdong, Minnan, Sichuan, Dongbei, Shan3xi, Shan1xi, Shanghai, Tianjin, Shan1dong, Ningxia, Gansu, etc.) and meanwhile supports both multi-lingual/cross-lingual zero-shot voice cloning. - **Language Coverage**: Covers 9 common languages (Chinese, English, Japanese, Korean, German, Spanish, French, Italian, Russian), 18+ Chinese dialects/accents (Guangdong, Minnan, Sichuan, Dongbei, Shan3xi, Shan1xi, Shanghai, Tianjin, Shandong, Ningxia, Gansu, etc.) and meanwhile supports both multi-lingual/cross-lingual zero-shot voice cloning.
- **Content Consistency & Naturalness**: Achieves state-of-the-art performance in content consistency, speaker similarity, and prosody naturalness. - **Content Consistency & Naturalness**: Achieves state-of-the-art performance in content consistency, speaker similarity, and prosody naturalness.
- **Pronunciation Inpainting**: Supports pronunciation inpainting of Chinese Pinyin and English CMU phonemes, providing more controllability and thus suitable for production use. - **Pronunciation Inpainting**: Supports pronunciation inpainting of Chinese Pinyin and English CMU phonemes, providing more controllability and thus suitable for production use.
- **Text Normalization**: Supports reading of numbers, special symbols and various text formats without a traditional frontend module. - **Text Normalization**: Supports reading of numbers, special symbols and various text formats without a traditional frontend module.
@@ -60,23 +60,23 @@
- [x] Fastapi server and client - [x] Fastapi server and client
## Evaluation ## Evaluation
| Model | CER (%) ↓ (test-zh) | WER (%) ↓ (test-en) | CER (%) ↓ (test-hard) | | Model | Model Size | CER (%) ↓ (test-zh) | WER (%) ↓ (test-en) | CER (%) ↓ (test-hard) |
|-----|------------------|------------------|------------------| |-------|------------|---------------------|---------------------|-----------------------|
| Human | 1.26 | 2.14 | - | | Human | - | 1.26 | 2.14 | - |
| F5-TTS | 1.53 | 2.00 | 8.67 | | Seed-TTS | - | 1.12 | 2.25 | 7.59 |
| SparkTTS | 1.20 | 1.98 | - | | MiniMax-Speech | - | 0.83 | 1.65 | - |
| Seed-TTS | 1.12 | 2.25 | 7.59 | | F5-TTS | 0.3B | 1.52 | 2.00 | 8.67 |
| CosyVoice2 | 1.45 | 2.57 | 6.83 | | SparkTTS | 0.5B | 1.20 | 1.98 | - |
| FireRedTTS-2 | 1.14 | 1.95 | - | | CosyVoice2 | 0.5B | 1.45 | 2.57 | 6.83 |
| IndexTTS2 | 1.01 | 1.52 | 7.12 | | FireRedTTS-2 | - | 1.14 | 1.95 | - |
| VibeVoice | 1.16 | 3.04 | - | | IndexTTS2 | 1.5B | 1.01 | 1.52 | 7.12 |
| HiggsAudio | 1.79 | 2.44 | - | | VibeVoice | 1.5B | 1.16 | 3.04 | - |
| MiniMax-Speech | 0.83 | 1.65 | - | | HiggsAudio-v2 | 3B | 1.50 | 2.44 | - |
| VoxPCM | 0.93 | 1.85 | 8.87 | | VoxPCM | 0.5B | 0.93 | 1.85 | 8.87 |
| GLM-TTS | 1.03 | - | - | | GLM-TTS | - | 1.03 | - | - |
| GLM-TTS_RL | 0.89 | - | - | | GLM-TTS_RL | - | 0.89 | - | - |
| Fun-CosyVoice3-0.5B-2512 | 1.21 | 2.24 | 6.71 | | Fun-CosyVoice3-0.5B-2512 | 0.5B | 1.21 | 2.24 | 6.71 |
| Fun-CosyVoice3-0.5B-2512_RL | 0.81 | 1.68 | 5.44 | | Fun-CosyVoice3-0.5B-2512_RL | 0.5B | 0.81 | 1.68 | 5.44 |
## Install ## Install