Evolving spiking neural networks for audiovisual information processing

• DOI: 10.1016/j.neunet.2010.04.009
• Publication Date: 2010-05-06T08:50:35Z
• Authors: Simei Gomes Wysoski; Lubica Benuskova; Nikola Kasabov
• Keywords: Neurons; 03 medical and health sciences; Auditory Pathways; 0302 clinical medicine; Pattern Recognition, Physiological; Models, Neurological; 0202 electrical engineering, electronic engineering, information engineering; Humans; Computer Simulation; Visual Pathways; Neural Networks, Computer; 02 engineering and technology; Nerve Net

This paper presents a new modular and integrative sensory information system inspired by the way the brain performs information processing, in particular, pattern recognition. Spiking neural networks are used to model human-like visual and auditory pathways. This bimodal system is trained to perform the specific task of person authentication. The two unimodal systems are individually tuned and trained to recognize faces and speech signals from spoken utterances, respectively. New learning procedures are designed to operate in an online evolvable and adaptive way. Several ways of modelling sensory integration using spiking neural network architectures are suggested and evaluated in computer experiments.