Iterative Learning Reinforcement for Unsupervised Clustering with Discrete Recurrent Networks

Neural networks
Machine learning
Authors

Enrique Mérida Casermeiro

Domingo López-Rodríguez

Published

1 November 2005

Publication details

XI Conferencia de la Asociación Española para la Inteligencia Artificial 2005

Links

 



Abstract

In this paper, two important issues concerning pattern recognition by neural networks are studied: a new model of hebbian learning, as well as the effect of the network capacity when retrieving patterns and performing clustering tasks. Particularly, an explanation of the energy function when the capacity is exceeded: the limitation in pattern storage implies that similar patterns are going to be identified by the network, therefore forming different clusters.

This ability can be translated as an unsupervised learning of pattern clusters, with one major advantage over most clustering algorithms: the number of data classes is automatically learned, as confirmed by the experiments. Two methods to reinforce learning are proposed to improve the quality of the clustering, by enhancing the learning of patterns relationships.

As a related issue, a study on the net capacity, depending on the number of neurons and possible outputs, is presented, and some interesting conclusions are commented.

Citation

Please, cite this work as:

[ML05] E. Mérida-Casermeiro and D. López-Rodríguez. “Iterative Learning Reinforcement for Unsupervised Clustering with Discrete Recurrent Networks”. In: XI Conferencia de la Asociación Española para la Inteligencia Artificial 2005. AEPIA. 2005, pp. 61-70.

@inproceedings{merida2005iterative,
     title={Iterative Learning Reinforcement for Unsupervised Clustering with Discrete Recurrent Networks},
     author={Mérida-Casermeiro, E. and López-Rodríguez, D.},
     booktitle={XI Conferencia de la Asociación Española para la Inteligencia Artificial 2005},
     pages={61–70},
     year={2005},
     organization={AEPIA}
}