What is the difference between bagging and boosting?
- A Bagging trains models independently in parallel to reduce variance; boosting trains sequentially on errors to reduce bias
- B Boosting trains in parallel
- C Bagging reduces bias
- D They are the same technique
Answer
Bagging trains models independently in parallel to reduce variance; boosting trains sequentially on errors to reduce bias
Random Forest is bagging with trees. Gradient boosting fits each new tree to the residuals of the current ensemble.





