In your well written article, you state:
"Ultimately, the calculation of information based on stimulus reconstruction gives a single
number corresponding to the information transmitted by a single neuron or an ensemble of
neurons for a particular stimulus ensemble. By repeating the calculation for different stimulus
ensembles, one can investigate how the channel capacity of particular neurons or neural
ensembles might depend on the stimulus statistics (e.g. for natural vs synthetic stimuli)."
This prompted me to wonder whether the neuron ensembles obey the Weber-Fechner law. Also it may be of interest to consider how the simple difference of weights is determined in your model (see: http://www.bio-balance.co... ).
Richard G. Lanzara, Ph.D.