禾息 62e04e8856 Enhance CosyVoice with CUDA stream management and estimator handling ...

- Introduced a queue-based system for managing CUDA streams to improve inference performance.
- Updated inference methods to utilize CUDA streams for asynchronous processing.
- Added an EstimatorWrapper class to manage TensorRT estimators, allowing for efficient execution context handling.
- Modified model loading functions to support estimator count configuration.
- Improved logging and performance tracking during inference operations.

2025-04-16 11:16:28 +08:00

..

__init__.py

add cosyvoice code

2024-07-04 21:15:12 +08:00

cosyvoice.py

Enhance CosyVoice with CUDA stream management and estimator handling

2025-04-16 11:16:28 +08:00

frontend.py

fix(async_cosyvoice): 恢复原本文本令牌处理逻辑

2025-03-08 16:03:35 +08:00

model.py

Enhance CosyVoice with CUDA stream management and estimator handling

2025-04-16 11:16:28 +08:00