Title :
Application of information theory to the construction of efficient decision trees
Author :
Hartmann, Carlos R P ; Varshney, Pramod K. ; Mehrotra, Kishan G. ; Gerberich, Carl L.
fDate :
7/1/1982 12:00:00 AM
Abstract :
The problem of conversion of decision tables to decision trees is treated. In most cases, the construction of optimal decision trees is an NP-complete problem and, therefore, a heuristic approach to this problem is necessary. In this heuristic approach, an application of information theoretic concepts to construct efficient decision trees for decision tables which may include "don\´t care" entries is made. In contrast to most of the existing heuristic algorithms, this algorithm is systematic and is intuitively appealing from an information theoretic standpoint. The algorithm has low design complexity and yet provides near-optimal decision trees.
Keywords :
Information theory; Trees; Algorithm design and analysis; Application software; Data processing; Decision trees; Dynamic programming; Heuristic algorithms; Information theory; NP-complete problem; Statistics; Testing;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.1982.1056522