Hugging Face Accelerate simplifies multi-GPU and multi-node training of ML models, offering streamlined parallelization for large-scale Deep Learning (DL) projects.

https://huggingface.co/docs/accelerate