neil.xh
|
f476f9cf29
|
gs对话接入
本次代码评审新增并完善了gs视频聊天功能，包括前后端接口定义、状态管理及UI组件实现，并引入了新的依赖库以支持更多互动特性。
Link: https://code.alibaba-inc.com/xr-paas/gradio_webrtc/codereview/21273476
* 更新python 部分
* 合并videochat前端部分
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 替换audiowave
* 导入路径修改
* 合并websocket mode逻辑
* feat: gaussian avatar chat
* 增加其他渲染的入参
* feat: ws连接和使用
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 右边距离超出容器宽度，则向左移动
* 配置传递
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 高斯包异常
* 同步webrtc_utils
* 更新webrtc_utils
* 兼容on_chat_datachannel
* 修复设备名称列表没有正常显示的问题
* copy 传递 webrtc_id
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 保证webrtc 完成后再进行websocket连接
* feat: 音频表情数据接入
* dist 上传
* canvas 隐藏
* feat: 高斯文件下载进度透出
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 修改无法获取权限问题
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 先获取权限再获取设备
* fix: gs资源下载完成前不处理ws数据
* fix: merge
* 话术调整
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 修复设备切换后重新对话，又切换回默认设备的问题
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 更新localvideo 尺寸
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 不能默认default
* 修改音频权限问题
* 更新打包结果
* fix: 对话按钮状态跟gs资源挂钩，删除无用代码
* fix: merge
* feat: gs渲染模块从npm包引入
* fix
* 新增对话记录
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 样式修改
* 更新包
* fix: gs数字人初始化位置和静音
* 对话记录滚到底部
* 至少100%高度
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 略微上移文本框
* 开始连接时清空对话记录
* fix: update gs render npm
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 逻辑保证
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* feat: 音频初始化配置是否静音
* actionsbar在有字幕时调整位置
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 样式优化
* feat: 增加readme
* fix: 资源图片
* fix: docs
* fix: update gs render sdk
* fix: gs模式下画面位置计算
* fix: update readme
* 设备判断，太窄处理
* Merge branch 'feature/update-fastrtc-0.0.19' of gitlab.alibaba-inc.com:xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* 是否有权限和是否有设备分开
* feat: gs 下载和加载钩子函数分离
* Merge branch 'feature/update-fastrtc-0.0.19' of http://gitlab.alibaba-inc.com/xr-paas/gradio_webrtc into feature/update-fastrtc-0.0.19
* fix: update gs render sdk
* 替换
* dist
* 上传文件
* del
|
2025-04-16 19:09:04 +08:00 |
|
Václav Volhejn
|
06885d06c4
|
Ignore output_frame_size parameter (#210)
|
2025-04-01 14:10:27 -04:00 |
|
Marcus Valtonen Örnhag
|
e3f08f87f2
|
Remove twice instantiated event (#221)
Co-authored-by: Marcus Valtonen Örnhag <marcus.valtonen.ornhag@ericsson.com>
|
2025-03-28 12:25:24 -04:00 |
|
Freddy Boulton
|
6742894d3d
|
Add support for trickle ice (#193)
* cherry-pick trickle-ice
* Add code
* Add code
* format
|
2025-03-20 20:50:45 -04:00 |
|
Freddy Boulton
|
44aac8d964
|
Fix issue when the audio stream mixes sample rates and numpy array data types (#188)
* Fix code
* Fix
* keep same
|
2025-03-18 18:53:47 -04:00 |
|
MechanicCoder
|
efff9d44dc
|
Add example for "Talk to Azure OpenAi" (#181)
* Add example for "Talk to Azure OpenAi"
* Code
---------
Co-authored-by: Freddy Boulton <alfonsoboulton@gmail.com>
|
2025-03-17 12:15:22 -04:00 |
|
Freddy Boulton
|
504eb452f0
|
stt models (#147)
|
2025-03-07 17:03:11 -05:00 |
|
Rohan Richard
|
6905810f37
|
Adding nextjs + 11labs + openai streaming demo (#139)
* adding nextjs + 11labs + openai streaming demo
* removing package-lock
|
2025-03-07 14:24:23 -05:00 |
|
Freddy Boulton
|
4cac472ff4
|
release (#146)
|
2025-03-07 14:21:12 -05:00 |
|
Freddy Boulton
|
6517a93472
|
Clean up cancelled generators (#124)
* fix links
* fix upload
* add code
* Add code
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-03-04 18:08:10 -05:00 |
|
Freddy Boulton
|
6ea54777af
|
ReplyOnPause and ReplyOnStopWords can be interrupted (#119)
* Add all this code
* add code
* Fix demo
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-03-03 21:47:16 -05:00 |
|
Freddy Boulton
|
146143efb7
|
Fix backup url (#116)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-03-02 18:35:32 -05:00 |
|
EasyTop
|
25c2152304
|
Added Script to use Ollama and run locally (#111)
* Uses Ollama / Qwen 2.5 to run voice activity locally
* git push origin test
* format
---------
Co-authored-by: easytop <jgwoodward@ymail.com>
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-03-02 18:10:31 -05:00 |
|
Freddy Boulton
|
4b44e67032
|
add code (#102)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-28 12:47:20 -05:00 |
|
burtenshaw
|
a66369e031
|
[DEMO] basic demo using smolagents and FastRTC (#93)
* initial commit of FastRTC and smolagents
* add code
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-27 14:35:29 -05:00 |
|
Freddy Boulton
|
9cc0278985
|
Video Bugfix + generator (#96)
* Code
* Fix demo
* move to init
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-27 12:30:19 -05:00 |
|
Freddy Boulton
|
43e42c1b22
|
Tidy up connection logic (#90)
* Add code:
* code
* code
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-26 18:21:26 -05:00 |
|
Freddy Boulton
|
e44341d781
|
Moonshine live (#86)
* add code
* moonshine
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-26 12:37:12 -05:00 |
|
Freddy Boulton
|
da872627b9
|
Set border radius (#84)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-26 11:53:25 -05:00 |
|
Lucain
|
c6769fe33f
|
Use huggingface_hub.InferenceClient instead of openai for Sambanova client (#79)
|
2025-02-26 10:06:17 -05:00 |
|
Freddy Boulton
|
aafd7b82eb
|
Add code (#70)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-24 21:21:52 -05:00 |
|
Freddy Boulton
|
5a4693ee0b
|
Raise errors automatically (#69)
* Add auto errors
* change code
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-24 20:21:25 -05:00 |
|
Freddy Boulton
|
853d6a06b5
|
Rebrand to FastRTC (#60)
* Add code
* add code
* add code
* Rename messages
* rename
* add code
* Add demo
* docs + demos + bug fixes
* add code
* styles
* user guide
* Styles
* Add code
* misc docs updates
* print nit
* whisper + pr
* url for images
* whsiper update
* Fix bugs
* remove demo files
* version number
* Fix pypi readme
* Fix
* demos
* Add llama code editor
* Update llama code editor and object detection cookbook
* Add more cookbook demos
* add code
* Fix links for PR deploys
* add code
* Fix the install
* add tts
* TTS docs
* Typo
* Pending bubbles for reply on pause
* Stream redesign (#63)
* better error handling
* Websocket error handling
* add code
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
* remove docs from dist
* Some docs typos
* more typos
* upload changes + docs
* docs
* better phone
* update docs
* add code
* Make demos better
* fix docs + websocket start_up
* remove mention of FastAPI app
* fastphone tweaks
* add code
* ReplyOnStopWord fixes
* Fix cookbook
* Fix pypi readme
* add code
* bump versions
* sambanova cookbook
* Fix tags
* Llm voice chat
* kyutai tag
* Add error message to all index.html
* STT module uses Moonshine
* Not required from typing extensions
* fix llm voice chat
* Add vpn warning
* demo fixes
* demos
* Add more ui args and gemini audio-video
* update cookbook
* version 9
---------
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-24 01:13:42 -05:00 |
|
Freddy Boulton
|
36190066ec
|
code (#56)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-02-03 15:16:16 -05:00 |
|
Freddy Boulton
|
b6d8e6a57f
|
Fix (#52)
Co-authored-by: Freddy Boulton <freddyboulton@hf-freddy.local>
|
2025-01-27 16:16:42 -05:00 |
|
Freddy Boulton
|
c85c117576
|
Additional outputs tweaks + fix track constraints (#28)
* code
* add code
* add code
|
2024-12-03 15:32:43 -05:00 |
|
Freddy Boulton
|
3bf4a437fb
|
Audio in only (#15)
* Audio + Video / test Audio
* Add code
* Fix demo
* support additional inputs
* Add code
* Add code
|
2024-10-30 13:08:09 -04:00 |
|
freddyaboulton
|
d48ae3a825
|
code
|
2024-10-29 11:24:37 -04:00 |
|
freddyaboulton
|
0b3ae91415
|
code
|
2024-10-23 16:14:10 -07:00 |
|
freddyaboulton
|
1688502e99
|
code
|
2024-10-23 15:11:39 -07:00 |
|
freddyaboulton
|
ac8d2a8be8
|
code
|
2024-10-22 16:24:30 -07:00 |
|
freddyaboulton
|
e7f3e63c79
|
make code
|
2024-10-22 16:24:21 -07:00 |
|
freddyaboulton
|
cff6073df0
|
working prototype
|
2024-10-17 15:34:57 -07:00 |
|
freddyaboulton
|
8fa6e9794a
|
update readme
|
2024-10-14 13:06:34 -07:00 |
|
freddyaboulton
|
841d784206
|
Add code
|
2024-10-14 12:57:06 -07:00 |
|
freddyaboulton
|
d52a21449a
|
fix bugs + release version 0.0.4
|
2024-10-11 14:57:20 -07:00 |
|
freddyaboulton
|
23b1e20c05
|
Lots of bugs
|
2024-10-11 13:01:26 -07:00 |
|
freddyaboulton
|
3777bfe777
|
implementation
|
2024-10-10 14:08:59 -07:00 |
|
freddyaboulton
|
e26f1fe806
|
Delete file
|
2024-09-26 12:50:52 -04:00 |
|
freddyaboulton
|
4d184eabe7
|
formatting
|
2024-09-26 12:42:58 -04:00 |
|
freddyaboulton
|
9e0d3f5bbf
|
format
|
2024-09-26 12:41:18 -04:00 |
|
freddyaboulton
|
d5f5db5f9b
|
Add code
|
2024-09-26 12:38:42 -04:00 |
|
freddyaboulton
|
11c828edb5
|
everything working on spaces
|
2024-09-25 12:19:40 -04:00 |
|
freddyaboulton
|
83be4aa3ea
|
Working draft
|
2024-09-25 12:19:40 -04:00 |
|