摘要
We propose a neural network based autoassociative memory system for unsupervised learning. This system is intended to be an example of how a general information processing architecture, similar to that of neocortex, could be organized. The neural network has its units arranged into two separate groups called populations, one input and one hidden population. The units in the input population form receptive fields that sparsely projects onto the units of the hidden population. Competitive learning is used to train these forward projections. The hidden population implements an attractor memory. A back projection from the hidden to the input population is trained with a Hebbian learning rule. This system is capable of processing correlated and densely coded patterns, which regular attractor neural networks are very poor at. The system shows good performance on a number of typical attractor neural network tasks such as pattern completion, noise reduction, and prototype extraction.
学科与关键词
- A Gaussian Attractor Network for Memory and Recognition with Experience-Dependent LearningHu, Xiaolin*; Zhang, BoNeural Computation, 2010, 22(5): 1333-1357.被引 6
- Unsupervised learning by competing hidden unitsKrotov, Dmitry*; Hopfield, John J.*PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116(16): 7723-7731.被引 81
- High performance associative memory neural networkWang, J*; Mao, ZYIEEE International Conference on Robotics, Intelligent Systems and Signal Processing, Changsha, PEOPLES R CHINA, 2003-10-08 To 2003-10-13.
