26 Commits

Author	SHA1	Message	Date
禾息	62e04e8856	Enhance CosyVoice with CUDA stream management and estimator handling ... - Introduced a queue-based system for managing CUDA streams to improve inference performance. - Updated inference methods to utilize CUDA streams for asynchronous processing. - Added an EstimatorWrapper class to manage TensorRT estimators, allowing for efficient execution context handling. - Modified model loading functions to support estimator count configuration. - Improved logging and performance tracking during inference operations.	2025-04-16 11:16:28 +08:00
lyuxiang.lx	1cfc5dd077	add online trt export	2025-01-10 13:55:05 +08:00
lyuxiang.lx	1e52c6071e	update gradio	2025-01-08 11:11:16 +08:00
lyuxiang.lx	77d8cf13a3	update	2025-01-02 10:55:59 +08:00
lyuxiang.lx	3581caec76	fix lint	2024-12-16 10:37:10 +08:00
lyuxiang.lx	2511a49a72	update	2024-12-12 18:48:25 +08:00
lyuxiang.lx	c693039d14	update	2024-12-12 16:46:28 +08:00
lyuxiang.lx	3e381002d7	add cosyvoice2	2024-12-11 16:14:19 +08:00
lyuxiang.lx	a4db3db8ed	update flow cache	2024-10-16 15:24:47 +08:00
boji123	8130abb5ea	[debug] handle cache with prompt	2024-09-29 19:12:30 +08:00
boji123	c9acce1482	[debug] support flow cache, for sharper tts_mel output	2024-09-29 16:26:11 +08:00
lyuxiang.lx	90433f5373	fix lint	2024-09-05 16:15:34 +08:00
lyuxiang.lx	e141634da1	remove unnecessary code	2024-09-05 14:26:12 +08:00
lyuxiang.lx	2ce724045b	add onnx export	2024-09-04 18:15:33 +08:00
禾息	752103a307	Merge remote-tracking branch 'origin/inference_streaming' into inference_streaming	2024-09-03 11:13:25 +08:00
禾息	fadb22086f	export onnx	2024-09-03 11:06:24 +08:00
Xiang Lyu	ee988420f3	Merge branch 'inference_streaming' into flow_tensorrt	2024-08-30 14:20:06 +08:00
禾息	18599be8d5	mirror modify	2024-08-30 14:15:24 +08:00
zhoubofan.zbf	29408360fb	fix bug	2024-08-30 13:43:54 +08:00
禾息	6e7f5b922a	update	2024-08-30 13:14:44 +08:00
zhoubofan.zbf	53a3c1b17f	update	2024-08-30 00:47:40 +08:00
lyuxiang.lx	1ab3186799	revert trt TODO	2024-08-29 23:35:19 +08:00
zhoubofan.zbf	5f21aef786	add flow decoder tensorrt infer	2024-08-29 23:35:07 +08:00
lyuxiang.lx	f1e374a9bb	add trt script TODO	2024-08-29 10:44:04 +08:00
lyuxiang.lx	44aea805ea	add train cfg in flow matching	2024-07-11 17:36:59 +08:00
lyuxiang.lx	076829ab84	add cosyvoice code	2024-07-04 21:15:12 +08:00