Improving Neural Network Generalization Ability Using Outlier Analysis and Voronoi Tessellation

Details Improving Neural Network Generalization Ability Using Outlier Analysis and Voronoi Tessellation Improving Neural Network Generalization Ability Using Outlier Analysis and Voronoi Tessellation

Dec 2005

adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2005aas...20713901h&link_type=abstract

American Astronomical Society Meeting 207, #139.01; Bulletin of the American Astronomical Society, Vol. 37, p.1393

Statistics

Computation

Scientific paper

Artificial neural networks (ANNs) serve to process, learn, and predict information using layers of interconnected computational units. The quality of the network's performance on such cases depends on its generalization ability, or the ability to recognize trends from the training data and employ what it has learned to make predictions on new test data.
Nonetheless, ANNs often perform poorly when applied to new cases dissimilar to those they have encountered, a flaw possibly attributed to data anomalies that adversely affect the training process. Therefore, it is important to develop methods to improve a neural network's generalization ability, since the quality of future predictions on a comprehensive set of all possible data is the ultimate determinant of a network's proficiency.
In this study we use the Sloan Digital Sky Survey data to ascertain whether the network's performance error was distributed throughout the data or concentrated in a single area. We isolate inputs and distinguish combinations of independent inputs that most significantly contribute to the overall error. We also investigate the consequences of training a network with a data set containing outliers and the effects of eliminating outliers on the error value generated by the testing process. Moreover, we examine the relationship between the size of a Voronoi cell and the magnitude of the disparity between the correct output (known distances) and predicted output of outliers. Given that a substantial correlation exists, we can utilize Voronoi tessellation to "warn" a network to detect outliers based on the high volume and low distribution of their Voronoi cells and to train carefully on such points such that the true generalization of the data is maintained.

Affiliated with

Also associated with

No associations

Rating

Improving Neural Network Generalization Ability Using Outlier Analysis and Voronoi Tessellation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Improving Neural Network Generalization Ability Using Outlier Analysis and Voronoi Tessellation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Improving Neural Network Generalization Ability Using Outlier Analysis and Voronoi Tessellation will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-1286260