Recognizing Sequences of Sequences
Figure 1
Schematic of the generative model and recognition system.
This schematic shows the equations which define both the generation of stimuli (left, see Equation 2) and the recognition scheme based on a generative model. There are three levels; the phonemic and syllabic levels employ stable heteroclinic channels, while the acoustic level is implemented by a linear transform. corresponds to sound file extracts and
is the resulting sound wave. This sound wave is input to the recognition system, with a linear (forward) projection using the pseudo-inverse
. The recognition of the phonemic and syllabic level uses bottom-up and top-down message passing between the phonemic and syllabic level, following Equation 6.