mirror of
https://github.com/OpenBMB/MiniCPM-V.git
synced 2026-02-04 17:59:18 +08:00
Update README_en.md
This commit is contained in:
24
README_en.md
24
README_en.md
@@ -43,6 +43,7 @@
|
|||||||
- [Multi-turn Conversation](#multi-turn-conversation)
|
- [Multi-turn Conversation](#multi-turn-conversation)
|
||||||
- [Inference on Mac](#inference-on-mac)
|
- [Inference on Mac](#inference-on-mac)
|
||||||
- [Deployment on Mobile Phone](#deployment-on-mobile-phone)
|
- [Deployment on Mobile Phone](#deployment-on-mobile-phone)
|
||||||
|
- [WebUI Demo](#webui-demo)
|
||||||
- [TODO](#todo)
|
- [TODO](#todo)
|
||||||
- [Citation](#citation)
|
- [Citation](#citation)
|
||||||
|
|
||||||
@@ -594,10 +595,31 @@ PYTORCH_ENABLE_MPS_FALLBACK=1 python test.py
|
|||||||
### Deployment on Mobile Phone
|
### Deployment on Mobile Phone
|
||||||
Currently MiniCPM-V 2.0 can be deployed on mobile phones with Android and Harmony operating systems. 🚀 Try it out [here](https://github.com/OpenBMB/mlc-MiniCPM).
|
Currently MiniCPM-V 2.0 can be deployed on mobile phones with Android and Harmony operating systems. 🚀 Try it out [here](https://github.com/OpenBMB/mlc-MiniCPM).
|
||||||
|
|
||||||
|
### WebUI Demo
|
||||||
|
|
||||||
|
<details>
|
||||||
|
<summary>Click to see how to deploy WebUI demo on different devices </summary>
|
||||||
|
|
||||||
|
```shell
|
||||||
|
pip install -r requirements.txt
|
||||||
|
```
|
||||||
|
|
||||||
|
```shell
|
||||||
|
# For Nvidia GPUs support BF16 (like A100, H100, RTX3090), run:
|
||||||
|
python web_demo.py --device cuda --dtype bf16
|
||||||
|
|
||||||
|
# For Nvidia GPUs do NOT support BF16 (like V100, T4, RTX2080), run:
|
||||||
|
python web_demo.py --device cuda --dtype fp16
|
||||||
|
|
||||||
|
# For Mac with MPS (Apple silicon or AMD GPUs), run:
|
||||||
|
PYTORCH_ENABLE_MPS_FALLBACK=1 python web_demo.py --device mps --dtype fp16
|
||||||
|
```
|
||||||
|
</details>
|
||||||
|
|
||||||
|
|
||||||
## TODO
|
## TODO
|
||||||
|
|
||||||
- [ ] Fine-tuning support
|
- [ ] Fine-tuning support
|
||||||
- [ ] Local Web-UI deployment
|
|
||||||
- [ ] Code release for real-time interactive assistant
|
- [ ] Code release for real-time interactive assistant
|
||||||
|
|
||||||
## Model License <!-- omit in toc -->
|
## Model License <!-- omit in toc -->
|
||||||
|
|||||||
Reference in New Issue
Block a user