Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail

Eleni Vasilaki; Nicolas Frémaux; Robert Urbanczik; Walter Senn; Wulfram Gerstner

doi:10.1371/journal.pcbi.1000586

Loading metrics

Open Access

Peer-reviewed

Research Article

Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail

Eleni Vasilaki ,

* E-mail: E.Vasilaki@sheffield.ac.uk

Affiliations Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland, Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
⨯
Nicolas Frémaux,

Affiliation Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland
⨯
Robert Urbanczik,

Affiliation Department of Physiology, University of Bern, Bern, Switzerland
⨯
Walter Senn,

Affiliation Department of Physiology, University of Bern, Bern, Switzerland
⨯
Wulfram Gerstner

Affiliation Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland
⨯

Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail

Eleni Vasilaki,
Nicolas Frémaux,
Robert Urbanczik,
Walter Senn,
Wulfram Gerstner

Published: December 4, 2009
https://doi.org/10.1371/journal.pcbi.1000586

About the Authors

Eleni Vasilaki

* E-mail: E.Vasilaki@sheffield.ac.uk

Affiliations Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland, Department of Computer Science, University of Sheffield, Sheffield, United Kingdom

Nicolas Frémaux

Affiliation Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland

Robert Urbanczik

Affiliation Department of Physiology, University of Bern, Bern, Switzerland

Walter Senn

Affiliation Department of Physiology, University of Bern, Bern, Switzerland

Wulfram Gerstner

Affiliation Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland

Competing Interests

The authors have declared that no competing interests exist.

Author Contributions

Conceived and designed the experiments: EV WG. Performed the experiments: EV. Analyzed the data: EV. Wrote the paper: WG. Partially wrote the paper: EV. Participated in discussions: NF RU WS. Partially wrote the Methods section: RU WS.

Subject Areas
?

For more information about PLOS Subject Areas, click here.
We want your feedback. Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help!

Neurons
Is the Subject Area "Neurons" applicable to this article?

Thanks for your feedback.
Action potentials
Is the Subject Area "Action potentials" applicable to this article?

Thanks for your feedback.
Synapses
Is the Subject Area "Synapses" applicable to this article?

Thanks for your feedback.
Learning
Is the Subject Area "Learning" applicable to this article?

Thanks for your feedback.
Membrane potential
Is the Subject Area "Membrane potential" applicable to this article?

Thanks for your feedback.
Machine learning
Is the Subject Area "Machine learning" applicable to this article?

Thanks for your feedback.
Excitatory postsynaptic potentials
Is the Subject Area "Excitatory postsynaptic potentials" applicable to this article?

Thanks for your feedback.
Decision making
Is the Subject Area "Decision making" applicable to this article?

Thanks for your feedback.