Semantic learning in autonomously active recurrent neural networks

Details Semantic learning in autonomously active recurrent neural networks Semantic learning in autonomously active recurrent neural networks

2009-03-11

arxiv.org/abs/0903.1979v1

J. Algorithms in Cognition, Informatics and Logic, Vol. 81, 686 (2010)

Biology

Quantitative Biology

Neurons and Cognition

Journal of Algorithms in Cognition, Informatics and Logic, special issue on `Perspectives and Challenges for Recurrent Neural

Scientific paper

The human brain is autonomously active, being characterized by a self-sustained neural activity which would be present even in the absence of external sensory stimuli. Here we study the interrelation between the self-sustained activity in autonomously active recurrent neural nets and external sensory stimuli. There is no a priori semantical relation between the influx of external stimuli and the patterns generated internally by the autonomous and ongoing brain dynamics. The question then arises when and how are semantic correlations between internal and external dynamical processes learned and built up? We study this problem within the paradigm of transient state dynamics for the neural activity in recurrent neural nets, i.e. for an autonomous neural activity characterized by an infinite time-series of transiently stable attractor states. We propose that external stimuli will be relevant during the sensitive periods, {\it viz} the transition period between one transient state and the subsequent semi-stable attractor. A diffusive learning signal is generated unsupervised whenever the stimulus influences the internal dynamics qualitatively. For testing we have presented to the model system stimuli corresponding to the bars and stripes problem. We found that the system performs a non-linear independent component analysis on its own, being continuously and autonomously active. This emergent cognitive capability results here from a general principle for the neural dynamics, the competition between neural ensembles.

Affiliated with

Also associated with

No associations

Rating

Semantic learning in autonomously active recurrent neural networks does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Semantic learning in autonomously active recurrent neural networks, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Semantic learning in autonomously active recurrent neural networks will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-124003