Commit Graph

316 Commits

Author SHA1 Message Date
雾聪
9a4aebb0ea add func inference_bistream_vllm 2025-03-01 18:50:19 +08:00
雾聪
54e9384fb1 update export_codec_vllm 2025-02-26 20:25:14 +08:00
雾聪
f280558bcb update func export_codec_vllm 2025-02-26 16:48:21 +08:00
雾聪
f6a18ee07a update vllm_codec_engine 2025-02-25 19:40:30 +08:00
雾聪
4df0683a37 add vllm_codec_engine 2025-02-25 17:43:33 +08:00
雾聪
c37c00ff94 add func export_codec_vllm 2025-02-25 15:01:29 +08:00
Xiang Lyu
fd45708e4b Merge pull request #977 from hanasay/main
Convert audio to mono while extract speech token
2025-02-16 12:51:04 +08:00
hanasay
296ed4f526 Convert audio to mono while extract speech token
modified:     tools/extract_speech_token.py
2025-02-14 15:25:45 +08:00
Xiang Lyu
95e99e0417 Merge pull request #940 from c4fun/fastapi-cosyvoice2
Add a inference_instruct2 route to support and defaultly supports cosyvoice2 in fastapi server
2025-02-07 16:30:27 +08:00
c4fun
ba6d8c07ba revert the main function to original and only preserve the inference endpoint 2025-02-07 16:28:30 +08:00
Xiang Lyu
da3f129977 Merge pull request #936 from huyyxy/main
feat(docker): update CUDA base image to 12.4.1 for TensorRT support
2025-02-06 11:39:53 +08:00
c4fun
2889c25863 supports and defaultly supports cosyvoice2 in fastapi server 2025-01-27 20:51:57 +08:00
huyyxy
aa65200713 feat(docker): update CUDA base image to 12.4.1 for TensorRT support
- Upgrade base image from nvidia/cuda:11.8.0-cudnn8-devel-ubuntu22.04 to nvidia/cuda:12.4.1-cudnn-devel-ubuntu22.04
- Enable CUDA 12.4 runtime environment
- Ensure TensorRT dependency compatibility
- Validation steps:
  - Verify CUDA version via nvidia-smi after build
  - Test import tensorrt in container without errors

Closes #935
2025-01-26 12:33:50 +08:00
Xiang Lyu
86e26f54c7 Merge pull request #930 from sd0ric4/main
feat: add POST endpoints to resolve browser error about GET request wi…
2025-01-26 10:17:15 +08:00
sd0ric4
f1c214377c fix: add POST endpoints to resolve browser error about GET request with body 2025-01-24 19:41:14 +08:00
Xiang Lyu
369ea80bd4 Merge pull request #926 from Vinkle-hzt/main
fix bistream extra token
2025-01-23 22:02:25 +08:00
huzetao.hzt
69518b2bde fix bistream extra token 2025-01-23 19:08:18 +08:00
Xiang Lyu
276cfa02b6 Merge pull request #925 from FunAudioLLM/dev/lyuxiang.lx
fix pitch computation
2025-01-23 15:45:42 +08:00
lyuxiang.lx
190840b8dc fix pitch computation 2025-01-23 15:44:03 +08:00
lyuxiang.lx
c6c3f27ecc fix typo 2025-01-23 11:27:10 +08:00
Xiang Lyu
49761d2474 Merge pull request #924 from FunAudioLLM/dev/lyuxiang.lx
add llm bistream
2025-01-23 10:19:21 +08:00
lyuxiang.lx
07e477519b add llm bistream 2025-01-23 10:12:06 +08:00
Xiang Lyu
41c5e8cd6d Merge pull request #887 from Wauplin/patch-1
Fix diffusers / huggingface_hub compatibility in requirements.txt
2025-01-15 18:23:05 +08:00
Lucain
66ceaff472 Fix diffusers / huggingface_hub compatibility in requirements.txt
As mentioned in https://github.com/FunAudioLLM/CosyVoice/issues/516#issuecomment-2592067949 and https://github.com/FunAudioLLM/CosyVoice/issues/527#issuecomment-2592067100, it is more future-proof to upgrade `diffusers` version rather than downgrading `huggingface_hub` to an old one. This will also fix the `cannot import name 'cached_download' from 'huggingface_hub'` issue without relying on outdated packages.

Sorry again for the inconvenience 🙏
2025-01-15 10:21:08 +01:00
Xiang Lyu
07a314767f Merge pull request #884 from FunAudioLLM/dev/lyuxiang.lx
update
2025-01-14 22:56:21 +08:00
lyuxiang.lx
0b75c3a03f update 2025-01-14 22:55:13 +08:00
Xiang Lyu
b4dea3d64a Merge pull request #878 from FunAudioLLM/dev/lyuxiang.lx
update
2025-01-13 10:31:12 +08:00
lyuxiang.lx
43f9e9ab20 update 2025-01-13 10:30:13 +08:00
Xiang Lyu
025f6f0f7f Merge pull request #875 from lsby/main
fix docker python version
2025-01-13 10:27:49 +08:00
Xiang Lyu
69051d11ec Merge pull request #876 from FunAudioLLM/dev/lyuxiang.lx
fix bug
2025-01-12 21:21:25 +08:00
lyuxiang.lx
59fa786769 fix bug 2025-01-12 21:18:41 +08:00
hbybyyang
f38f594303 fix docker python version 2025-01-12 15:59:58 +08:00
Xiang Lyu
eb4d5d053f Merge pull request #868 from FunAudioLLM/dev/lyuxiang.lx
move prompt wav to asset
2025-01-10 17:53:32 +08:00
lyuxiang.lx
d450c32296 update 2025-01-10 17:52:25 +08:00
lyuxiang.lx
e84d72a4d9 move prompt wav to asset 2025-01-10 17:51:21 +08:00
Xiang Lyu
06e86619c2 Merge pull request #867 from FunAudioLLM/dev/lyuxiang.lx
Dev/lyuxiang.lx
2025-01-10 16:46:11 +08:00
lyuxiang.lx
e257c16796 Merge branch 'dev/lyuxiang.lx' of github.com:FunAudioLLM/CosyVoice into dev/lyuxiang.lx 2025-01-10 16:44:01 +08:00
lyuxiang.lx
87475ccf41 fix conflict 2025-01-10 16:43:31 +08:00
Xiang Lyu
8a1bce6c81 Merge pull request #865 from FunAudioLLM/dev/lyuxiang.lx
Dev/lyuxiang.lx
2025-01-10 14:18:21 +08:00
Xiang Lyu
b1e966309d Merge branch 'main' into dev/lyuxiang.lx 2025-01-10 14:16:34 +08:00
lyuxiang.lx
b95f18909e add empty cache 2025-01-10 14:14:32 +08:00
lyuxiang.lx
1cfc5dd077 add online trt export 2025-01-10 13:55:05 +08:00
lyuxiang.lx
d2e43fe6f4 update 2025-01-08 17:01:40 +08:00
Xiang Lyu
426c4001ca Merge pull request #842 from Vinkle-hzt/main
support online onnx to trt conversion
2025-01-08 11:21:42 +08:00
Xiang Lyu
92f1c659b9 Merge branch 'dev/lyuxiang.lx' into main 2025-01-08 11:21:06 +08:00
Xiang Lyu
ac75ae5184 Merge pull request #849 from FunAudioLLM/dev/lyuxiang.lx
update gradio
2025-01-08 11:12:31 +08:00
lyuxiang.lx
1e52c6071e update gradio 2025-01-08 11:11:16 +08:00
huzetao.hzt
2a0dd5447a add usage 2025-01-07 17:29:20 +08:00
huzetao.hzt
b6a1116d15 support online onnx to trt conversion 2025-01-07 17:20:06 +08:00
Xiang Lyu
5d12ced727 Merge pull request #832 from FunAudioLLM/dev/lyuxiang.lx
update
2025-01-04 13:45:33 +08:00