Demystifying Distributed Data Parallel (DDP): A Journey from First Principles
A deep dive into the internals of Distributed Data Parallel (DDP) to understand how it works and how to optimize it.
Blog
Thoughts on machine learning, AI research, and building intelligent systems.