Paying attention to attention: High attention sites as indicators of protein family and function in language models

• Gowri Nayar,

  Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft

  Affiliation Department of Biomedical Data Science, Stanford University, Stanford, California, United States of America

  https://orcid.org/0000-0001-5819-7115

  ⨯
• Alp Tartici,

  Roles Data curation, Methodology, Writing – review & editing

  Affiliation Department of Genetics, Stanford University, Stanford, California, United States of America

  ⨯
• Russ B. Altman

  Roles Resources, Supervision, Writing – review & editing

  * E-mail: Russ.Altman@stanford.edu

  Affiliations Department of Biomedical Data Science, Stanford University, Stanford, California, United States of America, Department of Genetics, Stanford University, Stanford, California, United States of America, Department of Medicine, Stanford University, Stanford, California, United States of America, Department of Bioengineering, Stanford University, Stanford, California, United States of America

  https://orcid.org/0000-0003-3859-2905

  ⨯