Towards accelerating model parallelism in distributed deep learning systems

• Hyeonseong Choi ,

  Contributed equally to this work with: Hyeonseong Choi, Byung Hyun Lee

  Roles Investigation, Software, Writing – original draft

  Affiliation Department of Computer Engineering, Korea Aerospace University, Goyang, South Korea

  ⨯
• Byung Hyun Lee ,

  Contributed equally to this work with: Hyeonseong Choi, Byung Hyun Lee

  Roles Data curation, Investigation, Writing – review & editing

  Affiliation Department of Electrical and Computer Engineering, Seoul, South Korea

  ⨯
• Se Young Chun ,

  Roles Conceptualization, Funding acquisition, Investigation, Writing – review & editing

  * E-mail: jlee@kau.ac.kr (JL); sychun@snu.ac.kr (SYC)

  ¶‡ SYC and JL also contributed equally to this work.

  Affiliations Department of Electrical and Computer Engineering, Seoul, South Korea, INMC & IPAI, Seoul National University, Seoul, South Korea

  https://orcid.org/0000-0001-8739-8960

  ⨯
• Jaehwan Lee

  Roles Conceptualization, Funding acquisition, Investigation, Project administration, Writing – review & editing

  * E-mail: jlee@kau.ac.kr (JL); sychun@snu.ac.kr (SYC)

  ¶‡ SYC and JL also contributed equally to this work.

  Affiliation Department of Computer Engineering, Korea Aerospace University, Goyang, South Korea

  https://orcid.org/0000-0001-6248-9567

  ⨯