Sage Journals: Discover world-class research

Abstract

In this paper, we develop a novel support vector algorithm with fuzzy hyperplane for pattern classification. We first introduce the concepts of fuzzy hyperplane and fuzzy linear separability. Then, the proposed approach seeks a fuzzy hyperplane that best separates the positive class from the negative class with the widest margin in the feature space. Further, the decision function of the proposed approach is generalized so the values assigned to the individuals fall within a specified range and indicate the membership degree of these individuals in a given category. This integration preserves the benefits of fuzzy set theory and SVM theory, where the use of the fuzzy hyperplane provides the SVM with effective means for capturing the approximate, imprecise nature of the real world. On the other hand, the SVM provides the advantage to minimize the structural risk and effectively generalize the unseen data. Experimental results are then presented which indicate the performance of the proposed approach.

Keywords

Support vector machine (SVM)maximal-margin classifier fuzzy set theory fuzzy classifier

Get full access to this article

View all access options for this article.

References

and Liang

, Fuzzy support vector machine based on within-class scatter for classification problems with outliers or noises, Neurocomputing 110, (2013), 101–110.

C.L.Blake andC.J.Merz,UCI repository ofMachine Learning Databases. Univ California, Dept Inform Comput Sci, Irvine, CA. 1998. [Online]. Available: http://kdd.ics.uci.edu/

Burges

C.J.C.

, A tutorial on support vector machines for pattern recognition, Data Mining and Knowledge Discovery 2(2) (1998), 955–974.

Chapelle

, Vapnik

, Bousquet

and Mukherjee

, Choosing multiple parameters for support vector machines, Machine Learning 46 (2002), 131–159.

Chiang

J.-H.

and Gader

, Recognition of handprinted numerals in VISA card application forms, Machine Vision and Applications 10 (1997), 144–149.

Chiang

J.-H.

and Hao

P.-Y.

, A new kernel-based fuzzy clustering approach: Support vector clustering with cell growing, IEEE Trans on Fuzzy Systems 11(4) (2003), 518–527.

Chiang

J.-H.

and Hao

P.-Y.

, Support vector learning mechanism for fuzzy rule-based modeling: A new approach, IEEE Trans on Fuzzy Systems 12(1) (2004), 1–12.

Cortes

and Vapnik

V.N.

, Support vector network, Machine Learning 20 (1995), 1–25.

Dubois

and Prade

, Operations on fuzzy number, Int J Syst Sci 9 (1978), 613–626.

10.

Hao

P.-Y.

and Chiang

J.-H.

, Fuzzy regression analysis by support vector learning approach, IEEE Trans on Fuzzy Systems 16(2) (2008), 428–441.

11.

Hao

P.-Y.

, New support vector algorithms with parametric insensitive/margin model, Neural Networks 23(1) (2010), 60–73.

12.

Hsu

C.W.

and Lin

C.J.

, A comparison of methods for multiclass support vector machines, IEEE Trans On Neural Networks 13 (2002), 415–425.

13.

Hull

J.J.

, A database for handwritten text recognition research, IEEE Trans on Pattern Analysis and Machine Intelligence 16 (1994), 550–554.

14.

A.-B.

, Chen

and Hua

, Fuzzy classifier based on fuzzy support vector machine, Journal of Intelligent and FuzzySystems 26 (1) (2013), 421–430.

15.

Kim

K.-J.

, Financial time series forecasting using support vector machines, Neurocomputing 55 (2003), 307–319.

16.

Klir

G.J.

and Yuan

, Fuzzy Sets and Fuzzy Logic: Theory and Applications Prentice-Hall: New Jersey, 1995.

17.

Lin

C.-F.

and Wang

S.-D.

, Fuzzy support vector machines, IEEE Transactions on Neural Networks 13 (2) (1995), 464–471.

18.

Lin

C.-F.

and Wang

S.-D.

, Training algorithms for fuzzy support vector machines with noisy data, Pattern Recognition Letters 25(14) (2004), 1647–1656.

19.

Lin

C.-T.

, Yeh

C.-M.

, Liang

S.-F.

, Chung

J.-F.

and Kumar

, Support vector based fuzzy neural network for pattern classification, IEEE Trans on Fuzzy Systems 14(1) (2006), 31–41.

20.

Michie

, Spiegelhalter

D.J.

and Taylor

C.C.

, Machine Learning, Neural and Statistical Classification, Ellis Horwood, 1994. Online: http://www.maths.leeds.ac.uk/charles/statlog/

21.

Negoita

C.V.

and Ralescu

D.A.

, Application of Fuzzy Sets to Systems Analysis, Birkhauser Verlag, 1975, pp. 12–24

22.

Prechelt

, PROBEN 1 –A set of neural network benchmark problems and benchmarking rules. Technical Report 21/94, Fakultat fur Informatik, Universitat Karlsruhe: D-76128, Karlsruhe, Germany, 1994.

23.

Schölkopf

, Smola

A.J.

, Williamson

and Bartlett

P.L.

, New support vector algorithms, Neural Computation 12(5) (1994), 1207–1245.

24.

Tankaka

, Uejima

and Asai

, Linear regression analysis with fuzzy model, IEEE Trans On Syst, Man, and Cyber 12(6) (1982), 903–907.

25.

Vapnik

V.N.

, The Nature of Statistical Learning Theory. Springer-Verlag: New York, 1995.

26.

Vapnik

V.N.

, Statistical Learning Theory Wiley, 1998

27.

Yager

R.R.

, On solving fuzzy mathematical relationships, Inform Contr 41 (1995), 29–55.

28.

Zadeh

L.A.

, The concept of linguistic variable and its application to approximate reasoning— I, Inform Sci 8 (1975), 199–249.