Training Process and GPU

[1024AILab]

Hello, I use 4 3090 gpu to train the model, but it throw error "cuda memory is out of range". Could you please tell me what's the type of gpu you use? and how long dose the training process will take? Thank you!

[zhengchen1999]

Hi.
Sorry for being late.
For DAT, 4 GPUs with a memory $\geq$ 40 Gb for training. I train the model on 4 A100s, and it takes 3 days.