Self-Organised Factorial Encoding of a Toroidal Manifold

Details Self-Organised Factorial Encoding of a Toroidal Manifold Self-Organised Factorial Encoding of a Toroidal Manifold

2004-10-15

arxiv.org/abs/cs/0410036v2

Computer Science

Learning

46 pages, 11 figures, corrected equation 39

Scientific paper

It is shown analytically how a neural network can be used optimally to encode input data that is derived from a toroidal manifold. The case of a 2-layer network is considered, where the output is assumed to be a set of discrete neural firing events. The network objective function measures the average Euclidean error that occurs when the network attempts to reconstruct its input from its output. This optimisation problem is solved analytically for a toroidal input manifold, and two types of solution are obtained: a joint encoder in which the network acts as a soft vector quantiser, and a factorial encoder in which the network acts as a pair of soft vector quantisers (one for each of the circular subspaces of the torus). The factorial encoder is favoured for small network sizes when the number of observed firing events is large. Such self-organised factorial encoding may be used to restrict the size of network that is required to perform a given encoding task, and will decompose an input manifold into its constituent submanifolds.

Affiliated with

Also associated with

No associations

Rating

Self-Organised Factorial Encoding of a Toroidal Manifold does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Self-Organised Factorial Encoding of a Toroidal Manifold, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Self-Organised Factorial Encoding of a Toroidal Manifold will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-486525