Interactive reservoir computing for chunking information streams
Fig 2
Readout activity after learning detects multiple chunks.
(a) Top, Three chunks a-b-c-d (red), e-f-g-h (green), and i-j-k-l (blue) separated by random sequences are recurred at equal frequencies in input. Bottom, The three chunks are repeated without the intervals of random sequences. (b) Each reservoir was connected to three readout units. (c) Selective readout responses to the individual chunks (colored intervals) were self-organized. Input contained random sequences. The responses are colored according to their selectivity to the chunks. (d) The same chunks were repeated without breaks by random sequences. Previous models of chunking typically processed such input sequences. (e) Readout activities formed with (left) and without (right) random sequence intervals were averaged over the recurrence of chunk “a-b-c-d”. (f) Time evolution of average readout weights is shown at every step of learning with (gray) and without (black) random sequence intervals.