Decision Tree and Ensemble Learning based on Ant Colony Optimization

Description

Preface......Page 3 Contents......Page 5 Classification Problem in ML......Page 8 Intro to Decision Trees......Page 10 Example......Page 11 Decision Tree Construction......Page 15 ACO as Part of Swarm Intelligence......Page 19 ACO Approach......Page 21 Example......Page 23 ACO Metaheuristic for Optimization Problems......Page 27 Conclusions......Page 29 Refs......Page 30 --- Adaptation of ACO to Decision Trees......Page 33 Introduction......Page 34 Decision Rules......Page 35 Decision Trees......Page 39 Other Algorithms......Page 42 Conclusions......Page 43 Refs......Page 44 Example......Page 50 Definition of ACDT Approach......Page 52 ML by Pheromone......Page 60 Computational Experiments......Page 63 Reinforcement Learning via Pheromone Maps......Page 65 Pheromone Trail & Heuristic Function......Page 70 Comparison with other Algorithms......Page 76 Statistical Analysis......Page 79 Conclusions......Page 82 Refs......Page 84 Evaluation of Classification......Page 86 Idea of Adaptive Goal Function......Page 88 Results of Experiments......Page 89 Refs......Page 94 Analysis of Hydrogen Bonds......Page 95 E-mail Foldering Problem......Page 99 Discovering Financial Data Rules......Page 102 Conclusions......Page 106 Refs......Page 107 --- Adaptation of ACO to Ensemble Methods......Page 108 Decision Forest as Ensemble of Classifiers......Page 109 Bagging......Page 110 Boosting......Page 111 Random Forest......Page 114 Evolutionary Computing Techniques in Ensemble Learning......Page 116 Refs......Page 118 Definition of ACDF Approach......Page 121 ACDF based on Random Forests......Page 122 Computational Experiments......Page 128 Example of Practical Application......Page 132 Conclusions......Page 135 Refs......Page 136 Adaptive ACDF......Page 137 Self-adaptive ACDF......Page 138 ACDF based on Boosting......Page 141 Computational Experiments......Page 142 Examination of Adaptation Parameter in ACDF......Page 144 Comparison with other Algorithms......Page 145 Statistical Analysis......Page 148 Example of Practical Application......Page 156 Conclusions......Page 157 Refs......Page 158 Final Remarks......Page 159 Future Directions......Page 160