forum.alglib.net

ALGLIB forum
It is currently Sun Dec 22, 2024 9:14 am

All times are UTC


Forum rules


1. This forum can be used for discussion of both ALGLIB-related and general numerical analysis questions
2. This forum is English-only - postings in other languages will be removed.



Post new topic Reply to topic  [ 2 posts ] 
Author Message
 Post subject: Random Forests (small number of features)
PostPosted: Sat Jan 15, 2011 4:10 pm 
Offline

Joined: Sat Jan 15, 2011 4:02 pm
Posts: 1
In a generic random forest model, if the number of available features used ("mtry") is small, then it is likely that few terminal nodes will be constructed for which the class membership of objects at the daughter nodes is pure. In fact, it is more likely that the entire tree may involve only one or two splits of objects, only because there are no more than 1 or 2 features available.

Has this been discussed in a papers (books) in terms of importance scores -- and the overall issues that the trees are not really trees but rather one-step splits?


Top
 Profile  
 
 Post subject: Re: Random Forests (small number of features)
PostPosted: Mon Jan 17, 2011 7:18 pm 
Offline
Site Admin

Joined: Fri May 07, 2010 7:06 am
Posts: 927
I think that it is in the very spirit of random decision forest - to build a lot of biased "simple" and random classifiers using subset of full sample. So although individual trees can be weak classifiers, forest as whole is stronger classifier.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 2 posts ] 

All times are UTC


Who is online

Users browsing this forum: Bing [Bot] and 54 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group