nav emailalert searchbtn searchbox tablepage yinyongbenwen piczone journalimg journalInfo journalinfonormal searchdiv searchzone qikanlogo popupnotification paper paperNew
2016, 03, v.48 51-56
A Smooth Extreme Learning Machine for Classification
Email:
DOI: 10.13705/j.issn.1671-6841.2016097
Published:   2016-10-17
Publication Date:   2016-10-17
Online:   2016-10-17
Mobile reading
Abstract:

Extreme learning machine( ELM) had a high learning speed and a good generalization ablity.Smoothing strategy was an important technology for non-smooth problems. By combining a smoothing technique with ELM,a smooth ELM( SELM) framework was proposed. Moreover,the Newton-Armijo algorithm was used to solve the SELM,and resulting algorithm converged globally and quadratically. The proposed SELM had less decision variables and better abitities to deal with nonlinear problems than the existing smooth support vector machine. Numerical experiments demonstrated that the speed of SELM was much faster than that of the existing ELM algorithms based on optimization theory. Compared with other popular support vector machines,the proposed SELM achieved better or similar generalization. The results demonstrated the feasibility and effectiveness of the proposed algorithm.

References

[1]HUANG G B,SIEW C K,ZHU Q Y.Extreme learning machine:theory and applications[J].Neurocomputing,2006,70(1/2/3):489-501.

[2]HUANG G B,DING X,ZHOU H.Optimization method based extreme learning machine for classification[J].Neurocomputing,2010,74(1/2/3):155-163.

[3]MATIAS T,SOUZA F,ARAUJO R,et al.Learning of a single-hidden layer feedforward neural network using an optimized extreme learning machine[J].Neurocomputing,2014,129(10):428-436.

[4]LIU X Y,GAO C H,LI P.A comparative analysis of support vector machines and extreme learning machines[J].Neural networks,2012,33(9):58-66.

[5]魏培文,段德全,孙印杰,等.基于SVM的生物医学事件触发词识别研究[J].信阳师范学院学报(自然科学版),2015,28(3):446-449.

[6]ALABDULMOHSIN I,MOUSTAPHA C,GAO X,et al.Large margin classification with indefinite similarities[J].Machine learning,2016,103(2):215-237.

[7]CHEN C,MANGASARIAN O L.A class of smoothing functions for nonlinear and mixed complementarity problems[J].Computational optimization and applications,1996,5(2):97-138.

[8]CHEN X J,DU S Q,ZHOU Y.A smoothing trust region filter algorithm for nonsmooth least squares problems[J].Science China-mathematics,2014,59(5):999-1014.

[9]BALASUNDARAM S,KAPIL D G.1-norm extreme learning machine for regression and multiclass classification using Newton method[J].Neurocomputing,2014,128(2):4-14.

[10]王小朋,刘翔峰.一种基于病态问题的修正牛顿法[J].河南科技大学学报(自然科学版),2015,36(1):86-91.

[11]LEE Y J,MANGASARIAN O L.SSVM:a smooth support vector machine[J].Computational optimization and applications,2001,20(1):5-22.

[12]TRIPATHY A,AGRAWAL A,RATH S K.Classification of sentiment reviews using n-gram machine learning approach[J].Expert systems with applications,2016,57(15):117-126.

[13]LIU Q,HE Q,SHI Z.Extreme support vector machine classifier[C]//Procceedings of the 12th Pacific-Asia conference on advances in knowledge discovery and data mining.Berlin,2008.

Basic Information:

DOI:10.13705/j.issn.1671-6841.2016097

China Classification Code:TP18

Citation Information:

[1]YANG Liming,ZHANG Siyun,REN Zhuo ,et al.A Smooth Extreme Learning Machine for Classification[J].Journal of Zhengzhou University(Natural Science Edition),2016,48(03):51-56.DOI:10.13705/j.issn.1671-6841.2016097.

Fund Information:

国家自然科学基金资助项目(11471010)

Published:  

2016-10-17

Publication Date:  

2016-10-17

Online:  

2016-10-17

quote

GB/T 7714-2015
MLA
APA
Search Advanced Search