Short-term Hebbian learning can implement transformer-like attention

Ian T. Ellwood

doi:10.1371/journal.pcbi.1011843

Loading metrics

Open Access

Peer-reviewed

Research Article

Short-term Hebbian learning can implement transformer-like attention

Ian T. Ellwood

Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

* E-mail: ite2@cornell.edu

Affiliation Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, United States of America

https://orcid.org/0009-0001-0264-5959

⨯

Short-term Hebbian learning can implement transformer-like attention

Ian T. Ellwood

Published: January 26, 2024
https://doi.org/10.1371/journal.pcbi.1011843

About the Authors

Ian T. Ellwood

Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

* E-mail: ite2@cornell.edu

Affiliation Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, United States of America

https://orcid.org/0009-0001-0264-5959

Competing Interests

The authors have declared that no competing interests exist.

Subject Areas
?

For more information about PLOS Subject Areas, click here.
We want your feedback. Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help!

Action potentials
Is the Subject Area "Action potentials" applicable to this article?

Thanks for your feedback.
Neuronal dendrites
Is the Subject Area "Neuronal dendrites" applicable to this article?

Thanks for your feedback.
Axons
Is the Subject Area "Axons" applicable to this article?

Thanks for your feedback.
Neurons
Is the Subject Area "Neurons" applicable to this article?

Thanks for your feedback.
Synapses
Is the Subject Area "Synapses" applicable to this article?

Thanks for your feedback.
Machine learning
Is the Subject Area "Machine learning" applicable to this article?

Thanks for your feedback.
Calcium channels
Is the Subject Area "Calcium channels" applicable to this article?

Thanks for your feedback.
Ion channels
Is the Subject Area "Ion channels" applicable to this article?

Thanks for your feedback.