DOI: 10.5176/2251-1938_ORS16.11
Authors: Ashok Kumar, H C Taneja and Ashok K Chitkara
Abstract:
Information theoretic measures with their unique feature of smooth implementation are successfully applied in various areas such as physics, probability and statistics, communication theory and economics etc. They plays important role in data mining by improving the classifying algorithms. Further, they have been successfully used for classification and defining rules of any type of data with ID3 algorithm. In this paper, we have modified ID3 algorithm and used generalized entropy of order α and type β to derive some more refined rules from the resultant decision tree in context with the analysis of the health conditions in the States and Union Territories of India.
Keywords: Probability Distribution; Shannon Entropy; ID3 Algorithm; Decision Tree; Generalized Information Measure.
