From 1c164aae34cbc8ca6b8b717a1268c5f9f80fca0d Mon Sep 17 00:00:00 2001 From: aidenyzhang <79260603+aidenyzhang@users.noreply.github.com> Date: Fri, 18 Oct 2024 18:32:35 +0800 Subject: [PATCH] Update README.md --- README.md | 11 +++++++---- 1 file changed, 7 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 2843801..68121cf 100644 --- a/README.md +++ b/README.md @@ -6,14 +6,16 @@ Yue Zhang \*, Minhao Liu\*, Zhaokang Chen, Bin Wu†, -Yingjie He, +Yubin Zeng, Chao Zhan, +Yingjie He, +Junxin Huang, Wenjiang Zhou (*Equal Contribution, †Corresponding Author, benbinwu@tencent.com) Lyra Lab, Tencent Music Entertainment -**[github](https://github.com/TMElyralab/MuseTalk)** **[huggingface](https://huggingface.co/TMElyralab/MuseTalk)** **[space](https://huggingface.co/spaces/TMElyralab/MuseTalk)** **Project (comming soon)** **Technical report (comming soon)** +**[github](https://github.com/TMElyralab/MuseTalk)** **[huggingface](https://huggingface.co/TMElyralab/MuseTalk)** **[space](https://huggingface.co/spaces/TMElyralab/MuseTalk)** **[Technical report](https://arxiv.org/pdf/2410.10122)** We introduce `MuseTalk`, a **real-time high quality** lip-syncing model (30fps+ on an NVIDIA Tesla V100). MuseTalk can be applied with input videos, e.g., generated by [MuseV](https://github.com/TMElyralab/MuseV), as a complete virtual human solution. @@ -41,7 +43,8 @@ Please find details in the following two links or contact zkangchen@tencent.com # News - [04/02/2024] Release MuseTalk project and pretrained models. - [04/16/2024] Release Gradio [demo](https://huggingface.co/spaces/TMElyralab/MuseTalk) on HuggingFace Spaces (thanks to HF team for their community grant) -- [04/17/2024] :mega: We release a pipeline that utilizes MuseTalk for real-time inference. +- [04/17/2024] : We release a pipeline that utilizes MuseTalk for real-time inference. +- [10/18/2024] :mega: We publish the [technical report](https://arxiv.org/pdf/2410.10122). ## Model ![Model Structure](assets/figs/musetalk_arc.jpg) @@ -319,7 +322,7 @@ If you need higher resolution, you could apply super resolution models such as [ ```bib @article{musetalk, title={MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting}, - author={Zhang, Yue and Liu, Minhao and Chen, Zhaokang and Wu, Bin and He, Yingjie and Zhan, Chao and Zhou, Wenjiang}, + author={Zhang, Yue and Liu, Minhao and Chen, Zhaokang and Wu, Bin and Zeng, Yubin and Zhan, Chao and He, Yingjie and Huang, Junxin and Zhou, Wenjiang}, journal={arxiv}, year={2024} }