GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
By Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Mia Xu Chen, Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, Zhifeng Chen
Free
Added 7 months ago
Description
Suggested reading from Ilya Sutskever, OpenAI’s chief scientist, for John Carmack.