41 Commits

Author	SHA1	Message	Date
禾息	369f3c2c18	Update estimator count retrieval and memory pool limit in CosyVoice ... - Simplified estimator count retrieval in CosyVoice and CosyVoice2 classes to directly access the configs dictionary. - Adjusted memory pool limit in the ONNX to TensorRT conversion function from 8GB to 1GB for optimized resource management.	2025-04-16 14:39:06 +08:00
禾息	7f4c9a2c64	Refactor CosyVoice inference methods to streamline CUDA stream management ... - Removed the queue-based stream pool and integrated direct CUDA stream usage for improved performance. - Simplified inference methods by eliminating unnecessary synchronization and stream management code. - Enhanced logging for better tracking of synthesis operations and performance metrics. - Updated the model class to support CUDA stream context management, ensuring efficient resource utilization during inference.	2025-04-16 14:15:14 +08:00
禾息	fd9b7d45e2	Fix logging indentation in CosyVoice TTS method for improved clarity	2025-04-16 11:24:51 +08:00
禾息	62e04e8856	Enhance CosyVoice with CUDA stream management and estimator handling ... - Introduced a queue-based system for managing CUDA streams to improve inference performance. - Updated inference methods to utilize CUDA streams for asynchronous processing. - Added an EstimatorWrapper class to manage TensorRT estimators, allowing for efficient execution context handling. - Modified model loading functions to support estimator count configuration. - Improved logging and performance tracking during inference operations.	2025-04-16 11:16:28 +08:00
雾聪	96950745a6	Revert "mv AsyncLLMEngine init to CosyVoice2" ... This reverts commit 9b3f351496.	2025-03-21 16:17:35 +08:00
雾聪	9b3f351496	mv AsyncLLMEngine init to CosyVoice2	2025-03-21 10:24:04 +08:00
qihua	90b666ea20	初步合并vllm支持，异步推理的通道处理还存在bug	2025-03-07 20:26:19 +08:00
lyuxiang.lx	07e477519b	add llm bistream	2025-01-23 10:12:06 +08:00
lyuxiang.lx	1cfc5dd077	add online trt export	2025-01-10 13:55:05 +08:00
huzetao.hzt	b6a1116d15	support online onnx to trt conversion	2025-01-07 17:20:06 +08:00
lyuxiang.lx	77d8cf13a3	update	2025-01-02 10:55:59 +08:00
lyuxiang.lx	b9ddcba5fd	add some instruction and assert	2024-12-30 16:41:57 +08:00
garywill	bd4be3fc05	rename list_avaliable_spks() to list_available_spks() ... Signed-off-by: garywill <garywill@disroot.org>	2024-12-18 11:19:43 +08:00
lyuxiang.lx	26c774098d	add text_frontend arg	2024-12-17 14:03:35 +08:00
lyuxiang.lx	60b0416229	update	2024-12-16 15:32:30 +08:00
lyuxiang.lx	1298d90e48	update readme	2024-12-16 14:05:00 +08:00
lyuxiang.lx	d43a0171d4	add instruct usage	2024-12-16 11:15:51 +08:00
lyuxiang.lx	ac70560364	fix lint	2024-12-16 09:54:24 +08:00
lyuxiang.lx	6b9cebea14	update	2024-12-13 15:33:36 +08:00
lyuxiang.lx	c693039d14	update	2024-12-12 16:46:28 +08:00
lyuxiang.lx	3e381002d7	add cosyvoice2	2024-12-11 16:14:19 +08:00
lyuxiang.lx	dc3f6432ba	fix bug	2024-11-22 15:11:55 +08:00
lyuxiang.lx	16d66dc6a6	fix short tts_text bug	2024-10-22 12:56:29 +08:00
lyuxiang.lx	789ee9e5e7	add hifigan train	2024-10-16 11:37:32 +08:00
lyuxiang.lx	06934c38c7	update vc code	2024-09-26 14:46:24 +08:00
lyuxiang.lx	49015f63e6	add vc code	2024-09-26 10:49:22 +08:00
lyuxiang.lx	e19e80fcd8	update tempo change	2024-09-18 16:13:40 +08:00
lyuxiang.lx	122df8c420	set onnx to false as last chunk rtf unstable	2024-09-06 17:10:54 +08:00
lyuxiang.lx	90433f5373	fix lint	2024-09-05 16:15:34 +08:00
lyuxiang.lx	7555afb90a	update fastapi	2024-09-05 14:09:40 +08:00
lyuxiang.lx	2ce724045b	add onnx export	2024-09-04 18:15:33 +08:00
禾息	fadb22086f	export onnx	2024-09-03 11:06:24 +08:00
zhoubofan.zbf	29408360fb	fix bug	2024-08-30 13:43:54 +08:00
zhoubofan.zbf	53a3c1b17f	update	2024-08-30 00:47:40 +08:00
zhoubofan.zbf	5f21aef786	add flow decoder tensorrt infer	2024-08-29 23:35:07 +08:00
lyuxiang.lx	f1e374a9bb	add trt script TODO	2024-08-29 10:44:04 +08:00
lyuxiang.lx	9ab298dd49	add llm export script	2024-08-28 18:21:11 +08:00
lyuxiang.lx	f4e70e222c	update stream code	2024-08-07 17:09:23 +08:00
lyuxiang.lx	02f941d348	update model inference	2024-07-24 19:18:09 +08:00
lyuxiang.lx	a13411c561	add stream code	2024-07-23 00:02:30 +08:00
lyuxiang.lx	076829ab84	add cosyvoice code	2024-07-04 21:15:12 +08:00