Physics – Condensed Matter – Disordered Systems and Neural Networks
Scientific paper
2009-09-10
Phys. Rev. E, 81 036104 (2010)
Physics
Condensed Matter
Disordered Systems and Neural Networks
8 pages, 3 figures
Scientific paper
We test four fast mean field type algorithms on Hopfield networks as an inverse Ising problem. The equilibrium behavior of Hopfield networks is simulated through Glauber dynamics. In the low temperature regime, the simulated annealing technique is adopted. Although performances of these network reconstruction algorithms on the simulated network of spiking neurons are extensively studied recently, the analysis of Hopfield networks is lacking so far. For the Hopfield network, we found that, in the retrieval phase favored when the network wants to memory one of stored patterns, all the reconstruction algorithms fail to extract interactions within a desired accuracy, and the same failure occurs in the spin glass phase where spurious minima show up, while in the paramagnetic phase, albeit unfavored during the retrieval dynamics, the algorithms work well to reconstruct the network itself. This implies that, as a inverse problem, the paramagnetic phase is conversely useful for reconstructing the network while the retrieval phase loses all the information about interactions in the network except for the case where only one pattern is stored. The performances of algorithms are studied with respect to the system size, memory load and temperature, sample-to-sample fluctuations are also considered.
No associations
LandOfFree
Reconstructing the Hopfield network as an inverse Ising problem does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Reconstructing the Hopfield network as an inverse Ising problem, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Reconstructing the Hopfield network as an inverse Ising problem will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-131295