Autoassociative memory

Background

Standard memories (data storage) are organized by being indexed by positional memory addresses which are also used for data retrieval.

Autoassociative memories are organized in such a way that data is stored in a graph like system with connection weights based on the number of inherent associative connections between two memories which makes it possible to query it using a memory already contained in the associative memory as query-key and retrieve that memory and closely connected memories at the same time. Hopfield networks have been shown to act as autoassociative memory since they are capable of remembering data by observing a portion of that data.

Iterative Autoassociative Net

In some cases, an auto-associative net does not reproduce a stored pattern the first time around, but if the result of the first showing is input to the net again, the stored pattern is reproduced. They are three further kinds: Recurrent linear auto-associator, Brain-State-in-a-Box net, and Discrete Hopfield net. The Hopfield Network is the most well known example of an autoassociative memory.

Hopfield Network

Main article: Hopfield network

Hopfield networks serve as content-addressable ("associative") memory systems with binary threshold nodes, and they have been shown to act as autoassociative since they are capable of remembering data by observing a portion of that data.

Heteroassociative memory

Heteroassociative memories, on the other hand, can recall an associated piece of datum from one category upon presentation of data from another category. For example: It is possible that the associative recall is a transformation from the pattern “banana” to the different pattern “monkey.”

Bidirectional associative memory (BAM)

Main article: Bidirectional associative memory

Bidirectional associative memories (BAM) are artificial neural networks that have long been used for performing heteroassociative recall.

Example

For example, the sentence fragments presented below are sufficient for most English-speaking adult humans to recall the missing information.

1. "To be or not to be, that is _____."
2. "I came, I saw, _____."

Many readers will realize the missing information is in fact:

1. "To be or not to be, that is the question."
2. "I came, I saw, I conquered."

This demonstrates the capability of autoassociative networks to recall the whole by using some of its parts.

References

References

1. Hopfield, J.J.. (1 April 1982). "Neural networks and physical systems with emergent collective computational abilities.". Proceedings of the National Academy of Sciences of the United States of America.
2. Jugal, Kalita. (2014). "Pattern Association or Associative Networks". University of Colorado.
3. (2008). "The Cambridge handbook of computational psychology". Cambridge University Press.
4. Golden, Richard M.. (1986-03-01). "The "Brain-State-in-a-Box" neural model is a gradient descent algorithm". Journal of Mathematical Psychology.
5. Coppin, Ben. (2004). "Artificial Intelligence Illuminated". Jones & Bartlett Learning.
6. Hirahara, Makoto. (2009). "Associative Memory". Springer.
7. Kosko, B.. (1988). "Bidirectional Associative Memories". IEEE Transactions on Systems, Man, and Cybernetics.