High performance associative memory models and weight dilution
Davey, N.; Adams, R.G.; Hunt, S.
Citation: Davey , N , Adams , R G & Hunt , S 2001 , ' High performance associative memory models and weight dilution ' . in Procs of Int Conf on Neural Information Processing : ICONIP'01 . vol. 2 , pp. 597-602 .
The consequences of diluting the weights of the standard Hopfield architecture associative memory model, trained using perceptron like learning rules, is examined. A proportion of the weights of the network are removed; this can be done in a symmetric and asymmetric way and both methods are investigated. This paper reports experimental investigations into the consequences of dilution in terms of: capacity, training times and size of basins of attraction. It is concluded that these networks maintain a reasonable performance at fairly high dilution rates.