Commit Graph

38 Commits

Author SHA1 Message Date
qianyu chen
af22b8f2ed Refactor dataset.py for improved data handling
Enhanced data fetching and processing logic in dataset.py to handle thinking states and improve error handling.
2025-09-12 15:55:43 +08:00
qianyu chen
7233ef5473 Update trainer.py 2025-09-12 15:54:38 +08:00
Dennis Huang
3acd3f9891 Update README 2025-08-06 14:31:54 +08:00
YuzaChongyi
2c0e7ff051 Update requirements.txt 2025-01-16 17:44:45 +08:00
Alexandra Hotti
4977fec2ff Update requirements.txt (#713)
Fixed typo in requirements
2025-01-15 14:40:46 +08:00
yiranyyu
53c0174797 Update to MiniCPM-o 2.6 2025-01-14 15:33:44 +08:00
fzc8578
4a087a8aec tiny fix 2025-01-11 13:58:19 +08:00
fzc8578
c5e82b1bc7 support video sft and auto save and load all files 2025-01-11 13:50:36 +08:00
Tianyu Yu
8464c94a7b Update dataset.py
Fix typo in a parameter name.
2024-10-22 16:08:52 +08:00
qianyu chen
cd64150b51 update finetuen for multi images sft (#462) 2024-08-15 11:24:50 +08:00
YuzaChongyi
791c977ab2 fix 2.6 slice placeholder 2024-08-11 13:20:29 +08:00
YuzaChongyi
251a4c20be Update readme.md 2024-08-11 12:11:01 +08:00
YuzaChongyi
270261f9d2 Update dataset.py
fix image_id_cnt
2024-08-06 18:55:13 +08:00
yiranyyu
b1a15299e6 Update to MiniCPM-V 2.6 2024-08-06 12:26:49 +08:00
qianyu chen
efae873a22 Update finetune_lora.sh 2024-07-25 12:05:11 +08:00
qianyu chen
247a576a6b Update finetune.py 2024-07-18 19:23:45 +08:00
qianyu chen
091236ad34 Update finetune_lora.sh 2024-07-17 14:37:18 +08:00
qianyu chen
6c58d38e9e Update readme.md 2024-07-17 10:10:36 +08:00
qianyu chen
cb8d4fc5a4 Update finetune.py 2024-07-17 09:30:35 +08:00
qianyu chen
dc68caefbd Update trainer.py 2024-07-17 09:30:28 +08:00
qianyu chen
e002c0e6ec zero3支持 (#273)
update for lora's modules_to_save
2024-07-15 10:32:17 +08:00
KabakaWilliam
7017aa1754 imported deepseed twice. Removed unnecesary extra import 2024-06-12 12:47:26 +01:00
qianyu chen
9bd93a281c update lora finetune inference bug (#224) 2024-06-07 18:00:22 +08:00
qianyu chen
74278de0f4 update q_lora code and memory cost with zero3 and offloading (#200) 2024-06-05 14:13:02 +08:00
qianyu chen
8d9c86a919 Update zero3 code and OOM FQAs (#188) 2024-05-31 12:44:21 +08:00
qianyu chen
e75512cb9a Update model_minicpmv.py for latest compatibility (#174) 2024-05-29 16:03:59 +08:00
YuzaChongyi
ae0f1e63ee Update finetune_lora.sh 2024-05-28 17:12:24 +08:00
YuzaChongyi
e1aa52f714 Update finetune_ds.sh 2024-05-28 17:11:48 +08:00
qianyu chen
5fdf2e0fd6 update finetuning code (#165) 2024-05-28 14:19:49 +08:00
qianyu chen
f592fedb2e Model Fine-tuning Memory Usage Statistics (#160) 2024-05-28 11:41:27 +08:00
qianyu chen
7e12387362 Update LoRA finetuning code (#154)
* update lora tuning

* updata lora fine-tuning code

* update finetuning lora code

* lora code

* lora finetuning code

* updating lora finetuning code

* update lora finetuning code

* Update Lora finetuning code

* Update LoRA finetuning code

* Update LoRA finetuning code
2024-05-27 19:02:59 +08:00
cjm
7868a4de27 update finetune sh 2024-05-23 10:27:00 +08:00
cjm
8b7277644b update finetune readme 2024-05-21 17:58:05 +08:00
cjm
76f8f4c376 fix finetune 2024-05-21 17:30:33 +08:00
yiranyyu
2c75097411 Update to MiniCPM-Llama3-V 2.5 2024-05-20 12:44:33 +08:00
qianyu chen
f6cbd4fb25 update finetuning code 2024-05-08 09:51:34 +08:00
qianyu chen
9f345c4020 add finetuning script 2024-05-07 22:29:44 +08:00
qianyu chen
fcacda295b upload fintune script 2024-05-07 22:28:42 +08:00