Search results
Results from the WOW.Com Content Network
AdaBoost (short for Adaptive Boosting) is a statistical classification meta-algorithm formulated by Yoav Freund and Robert Schapire in 1995, who won the 2003 Gödel Prize for their work. It can be used in conjunction with many types of learning algorithm to improve performance.
Weka is a machine learning set of tools that offers variate implementations of boosting algorithms like AdaBoost and LogitBoost; R package GBM (Generalized Boosted Regression Models) implements extensions to Freund and Schapire's AdaBoost algorithm and Friedman's gradient boosting machine.
Viola–Jones is essentially a boosted feature learning algorithm, trained by running a modified AdaBoost algorithm on Haar feature classifiers to find a sequence of classifiers ,,...,. Haar feature classifiers are crude, but allows very fast computation, and the modified AdaBoost constructs a strong classifier out of many weak ones.
The multiplicative weights algorithm is also widely applied in computational geometry, [1] such as Clarkson's algorithm for linear programming (LP) with a bounded number of variables in linear time. [ 4 ] [ 5 ] Later, Bronnimann and Goodrich employed analogous methods to find Set Covers for hypergraphs with small VC dimension .
The exponential loss is convex and grows exponentially for negative values which makes it more sensitive to outliers. The exponentially-weighted 0-1 loss is used in the AdaBoost algorithm giving implicitly rise to the exponential loss.
He is best known for his work on the AdaBoost algorithm, an ensemble learning algorithm which is used to combine many "weak" learning machines to create a more robust one. [2] He and Robert Schapire received the Gödel Prize in 2003 for their joint work on AdaBoost. [3] In 2004 he was awarded the Paris Kanellakis Award. [4]
The original paper casts the AdaBoost algorithm into a statistical framework. [1] Specifically, if one considers AdaBoost as a generalized additive model and then applies the cost function of logistic regression , one can derive the LogitBoost algorithm.
His doctoral dissertation, The design and analysis of efficient learning algorithms, earned him the ACM Doctoral Dissertation Award in 1991. [1] In 1996, collaborating with Yoav Freund, he invented the AdaBoost algorithm, a breakthrough that led to their joint receipt of the Gödel Prize in 2003. Schapire was elected an AAAI Fellow in 2009. [2]