Multi-GPU Demos

Scripts

Single GPU

$ python3 main.py

Data Parallel

$ python3 main_dp.py

Distributed Data Parallel

$ torchrun --standalone --nproc_per_node=NUM_GPUS main_ddp.py

or

$ python3 -m torch.distributed.launch --nproc_per_node=NUM_GPUS main_ddp.py

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
README.md		README.md
main.py		main.py
main_ddp.py		main_ddp.py
main_dp.py		main_dp.py