DocOwl1.5 training code?

[coder4nlp]

When will the training code be released?Thx.

[HAWLYQ]

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

[whalefa1I]

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

[HAWLYQ]

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

training codes with DeepSpeed is under debugging and testing ｡ﾟ･ (>﹏<) ･ﾟ｡

[coder4nlp]

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

training codes with DeepSpeed is under debugging and testing ｡ﾟ･ (>﹏<) ･ﾟ｡

@HAWLYQ So sad......｡ﾟ･ (>﹏<) ･ﾟ｡

[AR-javis]

@HAWLYQ can you test for deepspeed stage 3 integrations, specifically for deadlock issues while training/fine-tuning?

[HAWLYQ]

@HAWLYQ can you test for deepspeed stage 3 integrations, specifically for deadlock issues while training/fine-tuning?

Hi, @AR-javis , I'm debugging with deepspeed zero3~ I will try my best to release it within a week~

[coder4nlp]

where are the schedules?

[HAWLYQ]

where are the schedules?

Within this week~

[HAWLYQ]

Hi, @coder4nlp @whalefa1I @AR-javis We have released training codes for finetuning docowl1.5 in https://github.com/X-PLUG/mPLUG-DocOwl/tree/main/DocOwl1.5. It's temporarily supported by DeepSpeed zero2. We meet deadlock issues with zero3, if you have any suggestions to share with us, we will appreciate very much~

[coder4nlp]

@HAWLYQ Thank you very much!

[Coobiw]

hello, how about the venv requirements? I've not seen the requirements.txt.

[HAWLYQ]

hello, how about the venv requirements? I've not seen the requirements.txt.

Hi, @Coobiw , our environment is the same as mPLUG-Owl2, you can follow instructions at https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2 to prepare environments.