Deep neural networks explain spiking activity in auditory cortex
Fig 2
Example cortical responses and ANN predictions.
A: (Left) Sequences of spike counts (50-ms bins) in response to an English sentence (“A tiny handful never did make the concert”; spectrogram above). Below are cortical responses to ten repetitions (gray) and their mean (black), and the prediction from the Whisper [base] ANN (green). (Right) the same as the left panel but for a different sentence (“A bullet, she answered”), ANN (wav2vec2, in yellow), and monkey. The locations of the recordings are indicated by color in B. B: Locations of recording sites across monkeys C (top row), B (bottom left), and F (bottom right). All recordings in right hemisphere except top left panel. The large circle indicates the location of the recording cylinder, within which the upper half plane corresponds roughly to primary auditory cortex (core); the lower half, non-primary (belt and parabelt). The approximate location of belt in each cylinder is between the two parallel lines.