摘要
Extreme learning machine (ELM) has been put forward for single hidden layer feedforward networks. Because of its powerful modeling ability and it needs less human intervention, the ELM algorithm has been used widely in both regression and classification experiments. However, in order to achieve required accuracy, it needs many more hidden nodes than is typically needed by the conventional neural networks. This paper considers a new efficient learning algorithm for ELM with smoothing L-0 regularization. A novel algorithm updates weights in the direction along which the overall square error is reduced the most and then this new algorithm can sparse network structure very efficiently. The numerical experiments show that the ELM algorithm with smoothing L-0 regularization has less hidden nodes but better generalization performance than original ELM and ELM with L-1 regularization algorithms.
学科与关键词
- ELM Regularized Method for Classification ProblemsCarrasco, Juan J.*; Millan-Giraldo, Monica; Caravaca, Juan*; Escandoll-Montero, Pablo*; Martinez-Martinez, Jose M.*; Soria-Olivas, Emilio*International Journal on Artificial Intelligence Tools, 2016, 25(1): 1550026.被引 9
- Extreme Learning Machine with Elastic Net RegularizationGuo, Lihua*INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2020, 26(3): 421-427.被引 4
- Training an extreme learning machine by localized generalization error modelZhu, Hong; Tsang, Eric C. C.*; Zhu, JieSOFT COMPUTING, 2018, 22(11): 3477-3485.被引 13
