deepgeek/CosyVoice
2
0
Fork 0
mirror of https://github.com/FunAudioLLM/CosyVoice.git synced 2026-02-04 09:29:25 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1187 from hexisyztem/dev/Comet

Browse Source 
Refactor CUDA stream context management in CosyVoice2Model
This commit is contained in:
Xiang Lyu
2025-04-16 16:07:43 +08:00
committed by GitHub
parent ab74475604 e8a26827ae
commit 4c9a4c2fed
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
cosyvoice/cli/model.py
View File

@@ -385,7 +385,7 @@ class CosyVoice2Model(CosyVoiceModel):
# this_uuid is used to track variables related to this inference thread # this_uuid is used to track variables related to this inference thread
self.synchronize_stream() self.synchronize_stream()
stream_context = self.stream_context_pool.get() stream_context = self.stream_context_pool.get()
with torch.cuda.stream(stream_context): with stream_context:
this_uuid = str(uuid.uuid1()) this_uuid = str(uuid.uuid1())
with self.lock: with self.lock: