PET: Parameter-efficient Knowledge Distillation on Transformer

• Hyojin Jeon,

  Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

  Affiliation Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea

  https://orcid.org/0000-0001-6404-9485

  ⨯
• Seungcheol Park,

  Roles Investigation, Validation, Writing – review & editing

  Affiliation Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea

  ⨯
• Jin-Gee Kim,

  Roles Investigation, Validation, Writing – review & editing

  Affiliation Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea

  ⨯
• U. Kang

  Roles Project administration, Supervision, Validation, Writing – review & editing

  * E-mail: ukang@snu.ac.kr

  Affiliation Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea

  https://orcid.org/0000-0002-8774-6950

  ⨯