Physics – Data Analysis – Statistics and Probability
Scientific paper
2000-10-25
Physics
Data Analysis, Statistics and Probability
To appear in Proceedings of Maximum Entropy and Bayesian Methods 1999. Check also: http://omega.albany.edu:8008/
Scientific paper
10.1063/1.1381851
Probability mass curves the data space with horizons. Let f be a multivariate probability density function with continuous second order partial derivatives. Consider the problem of estimating the true value of f(z) > 0 at a single point z, from n independent observations. It is shown that, the fastest possible estimators (like the k-nearest neighbor and kernel) have minimum asymptotic mean square errors when the space of observations is thought as conformally curved. The optimal metric is shown to be generated by the Hessian of f in the regions where the Hessian is definite. Thus, the peaks and valleys of f are surrounded by singular horizons when the Hessian changes signature from Riemannian to pseudo-Riemannian. Adaptive estimators based on the optimal variable metric show considerable theoretical and practical improvements over traditional methods. The formulas simplify dramatically when the dimension of the data space is 4. The similarities with General Relativity are striking but possibly illusory at this point. However, these results suggest that nonparametric density estimation may have something new to say about current physical theory.
No associations
LandOfFree
Optimal Recovery of Local Truth does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Optimal Recovery of Local Truth, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Optimal Recovery of Local Truth will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-105793