How to train models with multiple GPU nodes?

[sbmaruf]

Hi! I am trying to fine-tune T5 checkpoints using the repo. However the severs I'm using are 2 or 4 GPUs per node.
I see the GPU running instructions are here,

https://github.com/google-research/text-to-text-transfer-transformer#gpu-usage

Is there any way I can run the code in multiple GPU nodes?