Hocus-Socus: An Error Catastrophe for Complex Hebbian Learning Implies Neocortical Proofreading

Biology – Quantitative Biology – Neurons and Cognition

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

10 pages 3 figs main text,85 pages 1 fig Suppl text Originally submitted to Nature in June 2009 (but rejected)

Scientific paper

The neocortex is widely believed to be the seat of intelligence and "mind". However, it's unclear what "mind" is, or how the special features of neocortex enable it, though likely "connectionist" principles are involved *A. The key to intelligence1 is learning relationships between large numbers of signals (such as pixel values), rather than memorizing explicit patterns. Causes (such as objects) can then be inferred from a learned internal model. These relationships fall into 2 classes: simple pairwise or second-order correlations (socs), and complex, and vastly more numerous, higher-order correlations (hocsB), such as the product of 3 or more pixels averaged over a set of images. Thus if 3 pixels correlate, they may give an "edge". Neurons with "Hebbian" synapses (changing strength in response to input-output spike-coincidences) are sensitive to such correlations, and it's likely that learned internal models use such neurons. Because output firing depends on input firing via the relevant connection strengths, Hebbian learning provides, in a feedback manner, sensitivity to input correlations. Hocs are vital, since they express "interesting" structure2 (e.g. edges), but their detection requires nonlinear rules operating at synapses of individual neurons. Here we report that in single model neurons learning from hocs fails, and defaults to socs, if nonlinear Hebbian rules are not sufficiently connection-specific. Such failure would inevitably occur if a neuron's input synapses were too crowded, and would undermine biological connectionism. Since the cortex must be hoc-sensitive to achieve the type of learning enabling mind, we propose it uses known, detailed but poorly understood circuitry and physiology to "proofread" Hebbian connections. Analogous DNA proofreading allows evolution of complex genomes (i.e. "life").

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Hocus-Socus: An Error Catastrophe for Complex Hebbian Learning Implies Neocortical Proofreading does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Hocus-Socus: An Error Catastrophe for Complex Hebbian Learning Implies Neocortical Proofreading, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Hocus-Socus: An Error Catastrophe for Complex Hebbian Learning Implies Neocortical Proofreading will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-517230

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.