An Ensemble of Classifiers using Weighted Instance Selection
Author(s):
Santosh N. Nagargoje, Prasad Kulkarni
Keywords:
Data mining, data reduction, instance selection, Classification, weighted instance selection, Reduced Nearest Neighbor
Abstract
The aim of proposed work is to analyze the Instance Selection Algorithm first. There are Weighted Instance Selection algorithms are available such as wDROP3 (weighted
Decremental Reduction Optimization Procedure 3), wRNN (weighted Reduced Nearest Neighbor), which reduces the Sample set applied. Then the multiclass Instance Selection is useful technique for reducing space and time complexity. This removes
irrelevant, noisy, superfluous instances from Training Set. Then the multiclass problem is solved by considering number of two class problem thus designing multiple two class classifiers and its combined output produces the result for it. The Boosting is use for providing weight for each instance of training set. The Designing of ensemble of classifiers is to combine all classifiers and learn by reduced training set. There are different techniques are available for designing an ensemble such as Bagging (Bootstrap Aggregating), Boosting (ADABOOST) and Error Correcting Output Code (ECOC) etc. The output of ensemble is better than the individual classifiers. The approach is tested with few benchmark data sets. It is found that Classification accuracy in the case of wDROP3 algorithm lies between 70% to 87%, but in case of wRNN algorithm lies between 61% to 89% and the Generalization accuracy in the
case of wDROP3 algorithm lies between 79% to 96%, but in wRNN algorithm it lies between 75% to 9 4%. Another observation, when increases number of Classifiers per Ensemble then accuracy improves by 0.5 to 1.5%
Article Details
Unique Paper ID: 142553
Publication Volume & Issue: Volume 2, Issue 3
Page(s): 96 - 102
Article Preview & Download
Share This Article
Conference Alert
NCSST-2023
AICTE Sponsored National Conference on Smart Systems and Technologies
Last Date: 25th November 2023
SWEC- Management
LATEST INNOVATION’S AND FUTURE TRENDS IN MANAGEMENT