deepgeek/MiniCPM-o
2
0
Fork 0
mirror of https://github.com/OpenBMB/MiniCPM-V.git synced 2026-02-05 18:29:18 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update LoRA finetuning code (#154)

Browse Source 
* update lora tuning

* updata lora fine-tuning code

* update finetuning lora code

* lora code

* lora finetuning code

* updating lora finetuning code

* update lora finetuning code

* Update Lora finetuning code

* Update LoRA finetuning code

* Update LoRA finetuning code
This commit is contained in:
qianyu chen
2024-05-27 19:02:59 +08:00
committed by GitHub
parent 2b572c9221
commit 7e12387362
7 changed files with 261 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
finetune/ds_config_zero2.json
View File

@@ -1,6 +1,6 @@
{
"fp16": {
"enabled": false,
"enabled": "auto",
"loss_scale": 0,
"loss_scale_window": 1000,
"initial_scale_power": 16,
@@ -9,7 +9,7 @@
},
"bf16": {
"enabled": true
"enabled": "auto"
},
"optimizer": {