This article proposes the modified AHC (Agglomerative Hierarchical Clustering) algorithm which considers the feature similarity and is applied to the text clustering. The words which are given as features for encoding texts into numerical vectors are semantic related entities, rather than independent ones, and the synergy effect between the word clustering and the text clustering is expected by combining both of them with each other. In this research, we define the similarity metric between numerical vectors considering the feature similarity, and modify the AHC algorithm by adopting the proposed similarity metric as the approach to the text clustering. The proposed AHC algorithm is empirically validated as the better approach in clustering texts in news articles and opinions. The significance of this research is to improve the clustering performance by utilizing the feature similarities.
AbainiaK., OuamourS. and SayoudH., Neural Text Categorizer for topic identification of noisy Arabic Texts, Proceedings of 12th IEEE Conference on Computer Systems and Applications2015, 1–8.
2.
Ah-PineJ. and WangX., Similarity Based Hierarchical Clustering with an Application to Text Collections, Proceedings of International Symposium on Intelligent Data Analysis (2016), pp. 320–331.
3.
Baeza-YatesR., Ribeiro-NetoB., Modern Information Retrieval: The Concepts and Technology behind Search, Addison-Wesley, 2011.
4.
BrunM., SimaC., HuaJ., LoweyJ., CarrollB., SuhaE. and DoughertyaE.R., Model-based evaluation of clustering validation measures, Pattern Recognition40 (2007), 807–824.
5.
DhillonI.S., MallelaS. and KumarR., Enhanced Word Clustering for Hierarchical Text Classification, Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining2002, pp. 191–200.
6.
GamareP.S. and PatilG.A., Web document clustering using hybrid approach in data mining, International Journal of Advent Technology3(7) (2015), 92–87.
7.
GaoH., JiangJ., SheL. and FuY., A new agglomerative hierarchical clustering algorithm implementation based on the map reduce framework, International Journal of Digital Content Technology and its Applications4 (2010), 95–100.
8.
JoT., Neuro text categorizer: A new model of neural network for text categorization, The Proceedings of ICONIP (2000), 280–285.
9.
JoT., The Implementation of Dynamic Document Organization using Text Categorization and Text Clustering. PhD Dissertation of University of Ottawa. 2006.
10.
JoT., Table based single pass algorithm for clustering news articles, International Journal of Fuzzy Logic and Intelligent Systems8 (2008), 231–237.
11.
JoT., Neural text categorizer for exclusive text categorization, Journal of Information Processing Systems4 (2008), 77–86.
12.
JoT., Modification of classification algorithm in favor of text categorization, International Journal of Computer Science and Software Technology2 (2009), 13–23.
13.
JoT., Modification of clustering algorithms for text clustering, International Journal of Computer Science and Software Technology3 (2010), 21–33.
14.
JoT., NTC (Neural Text Categorizer): Neural network for text categorization, International Journal of Information Studies2 (2010), 83–96.
15.
JoT., NTSO (Neural Text Self Organizer): A new neural network for text clustering, Journal of Network Technology1 (2010), 31–43.
16.
JoT., Device and Method for Categorizing Electronic Document Automatically, 10-2009-0041272, 10-1071495, 2011.
17.
JoT., Normalized table matching algorithm as approach to text categorization, Soft Computing19 (2015), 839–849.
18.
JoT., Simulation of numerical semantic operations on string in text collection, International Journal of Applied Engineering Research10 (2015), 45585–45591.
19.
JoT. and JapkowiczN., Text clustering using NTSO, The Proceedings of IJCNN (2005), pp. 558–563.
20.
JoT. and LeeM., The evaluation measure of text clustering for the variable number of clusters, Lecture Notes in Computer Science2007(4492), 871–879.
21.
KateR.J. and MooneyR.J., Using String Kernels for Learning Semantic Parsers, Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics (2006), pp. 913–920.
22.
LeslieC.S., EskinE., CohenA., WestonJ. and NobleW.S., Mismatch string kernels for discriminative protein classification, Bioinformatics20 (2004), 467–476.
23.
LodhiH., SaundersC., Shawe-TaylorJ., CristianiniN. and WatkinsC., Text classification with string kernels, Journal of Machine Learning Research2 (2002), 419–444.
24.
MitchellT., Machine Learning, 1st ed 1997McGraw-Hill.
25.
PawarP.Y. and GawandeS.H., A comparative study on different types of approaches to text categorization, International Journal of Machine Learning and Computing2 (2012), 423–426.
26.
SebastianiF., Machine learning in automated text categorization, ACM Computing Survey (2002), 1–47.
27.
SlonimN. and TishbyN., The power of word clusters for text classification, Proceedings of 23rd European Colloquium on Information Retrieval Research (2001), pp. 200–200.
28.
WienerE.D., A Neural Network Approach to Topic Spotting in Text, Master Thesis, the Faculty of the Graduate School of the University of Colorado. 1995.
29.
YangY., An evaluation of statistical approaches to text categorization, Information Retrieval1 (1999), 69–90.
30.
ZhengY., ChengX., HuangR. and ManY., A comparative study on text clustering methods, Advanced Data Mining and Applications (2006), 644–651.
31.
ZhouE., ZhongN., LiY. and HuangJ., Hot Topic Detection in News Blog Based on W2T Methodology, Proceedings of International Conference on Wisdom Web of Things (2016), pp. 237–258.
