High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections

Details High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections

2011-04-19

arxiv.org/abs/1104.3665v1

Physics

Condensed Matter

Statistical Mechanics

Physical Review E: Statistical, Nonlinear, and Soft Matter Physics (2011) to appear

Scientific paper

We consider the problem of inferring the interactions between a set of N binary variables from the knowledge of their frequencies and pairwise correlations. The inference framework is based on the Hopfield model, a special case of the Ising model where the interaction matrix is defined through a set of patterns in the variable space, and is of rank much smaller than N. We show that Maximum Lik elihood inference is deeply related to Principal Component Analysis when the amp litude of the pattern components, xi, is negligible compared to N^1/2. Using techniques from statistical mechanics, we calculate the corrections to the patterns to the first order in xi/N^1/2. We stress that it is important to generalize the Hopfield model and include both attractive and repulsive patterns, to correctly infer networks with sparse and strong interactions. We present a simple geometrical criterion to decide how many attractive and repulsive patterns should be considered as a function of the sampling noise. We moreover discuss how many sampled configurations are required for a good inference, as a function of the system size, N and of the amplitude, xi. The inference approach is illustrated on synthetic and biological data.

Affiliated with

Also associated with

No associations

Rating

High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-182533