Distributed training

[thanhlong1997]

Hi, I want to train your XTTS-v2 in distributed mode since my data is too large. How can I do that ? thank you!!!

[NikitaKononov]

Hi, I want to train your XTTS-v2 in distributed mode since my data is too large. How can I do that ? thank you!!!

python -m trainer.distribute --script recipes/ljspeech/xtts_v2/train_gpt_xtts.py --gpus 0,1,2,3,4,5

But xtts scripts or Trainer framework is laggy and it doesn't work properly< you can check my issue

[NikitaKononov]

tried num_workers=0, >0, MP_THREADS_NUM and so on, nothing helps
lots of ram and shared memory