Commit Graph

55 Commits

Author SHA1 Message Date
neil.xh
f476f9cf29 gs对话接入
本次代码评审新增并完善了gs视频聊天功能,包括前后端接口定义、状态管理及UI组件实现,并引入了新的依赖库以支持更多互动特性。
Link: https://code.alibaba-inc.com/xr-paas/gradio_webrtc/codereview/21273476
* 更新python 部分

* 合并videochat前端部分

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 替换audiowave

* 导入路径修改

* 合并websocket mode逻辑

* feat: gaussian avatar chat

* 增加其他渲染的入参

* feat: ws连接和使用

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 右边距离超出容器宽度,则向左移动

* 配置传递

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 高斯包异常

* 同步webrtc_utils

* 更新webrtc_utils

* 兼容on_chat_datachannel

* 修复设备名称列表没有正常显示的问题

* copy 传递 webrtc_id

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 保证webrtc 完成后再进行websocket连接

* feat: 音频表情数据接入

* dist 上传

* canvas 隐藏

* feat: 高斯文件下载进度透出

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 修改无法获取权限问题

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 先获取权限再获取设备

* fix: gs资源下载完成前不处理ws数据

* fix: merge

* 话术调整

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 修复设备切换后重新对话,又切换回默认设备的问题

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 更新localvideo 尺寸

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 不能默认default

* 修改音频权限问题

* 更新打包结果

* fix: 对话按钮状态跟gs资源挂钩,删除无用代码

* fix: merge

* feat: gs渲染模块从npm包引入

* fix

* 新增对话记录

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 样式修改

* 更新包

* fix: gs数字人初始化位置和静音

* 对话记录滚到底部

* 至少100%高度

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 略微上移文本框

* 开始连接时清空对话记录

* fix: update gs render npm

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 逻辑保证

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* feat: 音频初始化配置是否静音

* actionsbar在有字幕时调整位置

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 样式优化

* feat: 增加readme

* fix: 资源图片

* fix: docs

* fix: update gs render sdk

* fix: gs模式下画面位置计算

* fix: update readme

* 设备判断,太窄处理

* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* 是否有权限和是否有设备分开

* feat: gs 下载和加载钩子函数分离

* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19

* fix: update gs render sdk

* 替换

* dist

* 上传文件

* del
2025-04-16 19:09:04 +08:00
Freddy Boulton
5636736c56 bump version (#226) 2025-03-31 13:03:27 -04:00
Freddy Boulton
b18f6331a3 Add code (#212) 2025-03-25 14:45:23 -04:00
Freddy Boulton
e231f793e8 trigger release (#201)
* trigger release

* add code
2025-03-20 21:01:13 -04:00
Freddy Boulton
103381dac2 bump version (#190) 2025-03-18 21:43:58 -04:00
Freddy Boulton
4fb28f3bf2 0.0.15 (#172) 2025-03-13 19:01:27 -04:00
Freddy Boulton
514310691d Bump version (#164)
* Code'

* fix
2025-03-11 13:05:39 -04:00
Freddy Boulton
504eb452f0 stt models (#147) 2025-03-07 17:03:11 -05:00
Freddy Boulton
4cac472ff4 release (#146) 2025-03-07 14:21:12 -05:00
Freddy Boulton
6517a93472 Clean up cancelled generators (#124)
* fix links

* fix upload

* add code

* Add code

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-03-04 18:08:10 -05:00
Freddy Boulton
6ea54777af ReplyOnPause and ReplyOnStopWords can be interrupted (#119)
* Add all this code

* add code

* Fix demo

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-03-03 21:47:16 -05:00
Freddy Boulton
d8396a2714 Fix async echo example (#118)
* Fix async example

* Version bump

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-03-03 14:06:24 -05:00
Freddy Boulton
9cc0278985 Video Bugfix + generator (#96)
* Code

* Fix demo

* move to init

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-27 12:30:19 -05:00
Freddy Boulton
43e42c1b22 Tidy up connection logic (#90)
* Add code:

* code

* code

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-26 18:21:26 -05:00
Freddy Boulton
da872627b9 Set border radius (#84)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-26 11:53:25 -05:00
Freddy Boulton
bb85e894be Fix python 3.13 (#83)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-26 09:43:08 -05:00
Freddy Boulton
ff0cb7197f Fix credentials (#75)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-25 19:07:40 -05:00
Freddy Boulton
2a53bf4a7a version 2025-02-25 10:59:29 -05:00
Freddy Boulton
aafd7b82eb Add code (#70)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-24 21:21:52 -05:00
Freddy Boulton
5a4693ee0b Raise errors automatically (#69)
* Add auto errors

* change code

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-24 20:21:25 -05:00
Freddy Boulton
92a4bb4098 Add cname (#67)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-24 12:21:54 -05:00
Freddy Boulton
3323ef28a8 Tweak (#66)
* thanks

* title fix

* version bump

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-24 01:30:45 -05:00
Freddy Boulton
853d6a06b5 Rebrand to FastRTC (#60)
* Add code

* add code

* add code

* Rename messages

* rename

* add code

* Add demo

* docs + demos + bug fixes

* add code

* styles

* user guide

* Styles

* Add code

* misc docs updates

* print nit

* whisper + pr

* url for images

* whsiper update

* Fix bugs

* remove demo files

* version number

* Fix pypi readme

* Fix

* demos

* Add llama code editor

* Update llama code editor and object detection cookbook

* Add more cookbook demos

* add code

* Fix links for PR deploys

* add code

* Fix the install

* add tts

* TTS docs

* Typo

* Pending bubbles for reply on pause

* Stream redesign (#63)

* better error handling

* Websocket error handling

* add code

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>

* remove docs from dist

* Some docs typos

* more typos

* upload changes + docs

* docs

* better phone

* update docs

* add code

* Make demos better

* fix docs + websocket start_up

* remove mention of FastAPI app

* fastphone tweaks

* add code

* ReplyOnStopWord fixes

* Fix cookbook

* Fix pypi readme

* add code

* bump versions

* sambanova cookbook

* Fix tags

* Llm voice chat

* kyutai tag

* Add error message to all index.html

* STT module uses Moonshine

* Not required from typing extensions

* fix llm voice chat

* Add vpn warning

* demo fixes

* demos

* Add more ui args and gemini audio-video

* update cookbook

* version 9

---------

Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-02-24 01:13:42 -05:00
Freddy Boulton
b6d8e6a57f Fix (#52)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
2025-01-27 16:16:42 -05:00
Freddy Boulton
e98dc16217 Change recording label (#50)
* add code

* bump version

* Add code
2025-01-15 12:10:38 -05:00
Freddy Boulton
4d16634307 code (#48) 2025-01-10 17:14:47 -05:00
Freddy Boulton
5812fd5aeb Make sure channel is always set, be able to raise UI errors with WebRTCError (#45)
* Code

* test

* code

* user guide
2024-12-23 15:21:10 -05:00
Freddy Boulton
e057fc1502 librosa (#44) 2024-12-20 15:15:07 -05:00
Freddy Boulton
c45febf3bf Async stream handler support (#43)
* async stream handler

* Add code
2024-12-20 12:46:17 -05:00
Freddy Boulton
8a5c1f1bb3 Code (#40) 2024-12-16 11:27:01 -05:00
Freddy Boulton
b97712bc0d fix readme (#38) 2024-12-13 12:04:42 -08:00
Freddy Boulton
6c983482b8 Add ReplyOnStopWords (#35)
* add code

* fix dependencies

* add code:
2024-12-11 18:25:53 -08:00
Freddy Boulton
903f1f70bd Audio to float32 util (#32)
* add util

* version bump
2024-12-06 14:31:12 -08:00
Freddy Boulton
80283f6631 Docs fixes (#31) 2024-12-06 10:46:52 -05:00
Freddy Boulton
54602d8d1f Fix typing (#30)
* code

* add code

* add code

* Code
2024-12-04 16:47:16 -05:00
Freddy Boulton
868e0bfa64 Add some utils fns, add moshi to cookbook, fix querySelector, support async functions in ReplyOnPause (#29)
* add

* add code
2024-12-04 15:14:19 -05:00
Freddy Boulton
c85c117576 Additional outputs tweaks + fix track constraints (#28)
* code

* add code

* add code
2024-12-03 15:32:43 -05:00
Freddy Boulton
65d0ba023f Add helper for logging into community turn server (#25)
* add credentials and docs

* lint

* update
2024-11-26 17:33:26 -05:00
Freddy Boulton
2434a65747 Docs (#20)
* Docs

* code
2024-11-18 14:06:46 -05:00
Freddy Boulton
d7acdd7eb4 commit (#16) 2024-11-05 22:09:02 -04:00
Freddy Boulton
3bf4a437fb Audio in only (#15)
* Audio + Video / test Audio

* Add code

* Fix demo

* support additional inputs

* Add code

* Add code
2024-10-30 13:08:09 -04:00
freddyaboulton
d48ae3a825 code 2024-10-29 11:24:37 -04:00
freddyaboulton
792f4c9af2 add pyproject 2024-10-25 17:21:10 -07:00
freddyaboulton
792e0a3663 add code 2024-10-25 16:30:34 -07:00
freddyaboulton
a5dbaaf49b first cut 2024-10-25 16:24:32 -07:00
freddyaboulton
55ac9a714d Bump version 2024-10-25 12:18:18 -07:00
freddyaboulton
e27af437dc fix metallic sound 2024-10-24 17:23:38 -07:00
freddyaboulton
0b3ae91415 code 2024-10-23 16:14:10 -07:00
freddyaboulton
e87c4d49e8 final touches 2024-10-23 15:52:48 -07:00
freddyaboulton
1688502e99 code 2024-10-23 15:11:39 -07:00