D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks

Details D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks

2008-01-12

arxiv.org/abs/0801.1883v1

Computer Science

Neural and Evolutionary Computing

Scientific paper

We introduce a novel online Bayesian method for the identification of a family of noisy recurrent neural networks (RNNs). We develop Bayesian active learning technique in order to optimize the interrogating stimuli given past experiences. In particular, we consider the unknown parameters as stochastic variables and use the D-optimality principle, also known as `\emph{infomax method}', to choose optimal stimuli. We apply a greedy technique to maximize the information gain concerning network parameters at each time step. We also derive the D-optimal estimation of the additive noise that perturbs the dynamical system of the RNN. Our analytical results are approximation-free. The analytic derivation gives rise to attractive quadratic update rules.

Affiliated with

Also associated with

No associations

Rating

D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-605833