How does Random Forest reduce overfitting compared with a single tree?
- A It averages many decorrelated trees trained on bootstrap samples with random feature subsets
- B It uses fewer features
- C It prunes more aggressively
- D It trains sequentially
Answer
It averages many decorrelated trees trained on bootstrap samples with random feature subsets
Averaging independent models reduces variance, which is the defining property of bagging methods.





