Dynamical transitions in the evolution of learning algorithms by selection

Details Dynamical transitions in the evolution of learning algorithms by selection Dynamical transitions in the evolution of learning algorithms by selection

2002-09-11

arxiv.org/abs/physics/0209048v1

Physics

Biological Physics

11 pages, 11 figures, 2 tables

Scientific paper

10.1103/PhysRevE.67.041912

We study the evolution of artificial learning systems by means of selection. Genetic programming is used to generate a sequence of populations of algorithms which can be used by neural networks for supervised learning of a rule that generates examples. In opposition to concentrating on final results, which would be the natural aim while designing good learning algorithms, we study the evolution process and pay particular attention to the temporal order of appearance of functional structures responsible for the improvements in the learning process, as measured by the generalization capabilities of the resulting algorithms. The effect of such appearances can be described as dynamical phase transitions. The concepts of phenotypic and genotypic entropies, which serve to describe the distribution of fitness in the population and the distribution of symbols respectively, are used to monitor the dynamics. In different runs the phase transitions might be present or not, with the system finding out good solutions, or staying in poor regions of algorithm space. Whenever phase transitions occur, the sequence of appearances are the same. We identify combinations of variables and operators which are useful in measuring experience or performance in rule extraction and can thus implement useful annealing of the learning schedule.

Affiliated with

Also associated with

No associations

Rating

Dynamical transitions in the evolution of learning algorithms by selection does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Dynamical transitions in the evolution of learning algorithms by selection, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Dynamical transitions in the evolution of learning algorithms by selection will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-160383