A New Decision Tree Using Conditional Cumulative Residual Entropy

Decision tree algorithms like ID3 necessitate discretization when dealing with continuous values, which can result in loss of information. To tackle this issue, the present article introduces a novel decision tree referred to as Conditional Cumula- tive Residual Entropy (CCRDT), speci cally designed for situations where both the target variable and input information are continuous. The CCRDT tree employs conditional cumulative residual entropy as opposed to Shannon entropy in the in- formation gain criterion. The article proceeds to compare the outcomes of CCRDT with those of ID3 using a genuine data set. Additionally, the article deliberates on the notable characteristics of CCRDT, inclusive of its ability to surmount the prob- lem of information loss and facilitate simpler calculations. Furthermore, the article puts forth the notion of conditional cumulative residual entropy and its application in the context of decision tree algorithms. Ultimately, the article concludes that CCRDT represents a promising approach for decision tree learning involving con- tinuous variables, with potential applications in diverse elds such as data mining, machine learning, and pattern recognition.