WEKA machine learning software discussion

Khan, Mahmood | 28 Jun 2012 11:00

multiple decision trees in weka

Hi Mark,

How can i run multiple decision tree in weka. I would like to generate a decision forest based on number of attributes.

For example if i have 7 non class attributes, i want to generate 7 trees. The first tree should select the best attribute (having highest gain ratio) as its root node, the second tree should be generated using second best attribute as its root node as so on. Any kind of help would be much appreciated, i need this very urgent.

Many Thanks in Advance

Regards,

Mahmood

LEGAL NOTICE
This email (and any attachment) is confidential and is intended for the use of the addressee(s) only. If you are not the intended recipient of this email, you must not copy, distribute, take any action in reliance on it or disclose it to anyone. Any confidentiality is not waived or lost by reason of mistaken delivery. Email should be checked for viruses and defects before opening. Charles Sturt University (CSU) does not accept liability for viruses or any consequence which arise as a result of this email transmission. Email communications with CSU may be subject to automated email filtering, which could result in the delay or deletion of a legitimate email before it is read at CSU. The views expressed in this email are not necessarily those of CSU.

Charles Sturt University in Australia The Chancellery, Panorama Avenue, Bathurst NSW Australia 2795 (ABN: 83 878 708 551; CRICOS Provider Numbers: 00005F (NSW), 01947G (VIC), 02960B (ACT)).
Charles Sturt University in Ontario 860 Harrington Court, Burlington Ontario Canada L7N 3N4 Registration: www.peqab.ca

Consider the environment before printing this email.

_______________________________________________
Wekalist mailing list
Send posts to: Wekalist <at> list.scms.waikato.ac.nz
List info and subscription status: https://list.scms.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

headers

Mark Hall | 2 Jul 2012 11:08

Re: multiple decision trees in weka

On 28/06/12 9:00 PM, Khan, Mahmood wrote:
> Hi Mark,
>
> How can i run multiple decision tree in weka. I would like to generate a
> decision forest based on number of attributes.
>
> For example if i have 7 non class attributes, i want to generate 7
> trees. The first tree should select the best attribute (having highest
> gain ratio) as its root node, the second tree should be generated using
> second best attribute as its root node as so on.  Any kind of help would
> be much appreciated, i need this very urgent.
>
> Many Thanks in Advance

You might have to implement this yourself. One thing you could try is 
using the Vote classifier with multiple FilteredClassifiers as base 
classifiers. You'd use a MultiFilter with AttributeSelection followed by 
Remove. The AttributeSelection filter would use GainRatio to rank (and 
thus re-order) all the attributes and then the Remove filter would 
remove increasing numbers of attributes from the top of the ranking. 
This should force the best and then second best etc. attribute to be 
chosen for the root of the tree in each subsequent classifier. Of 
course, there will one fewer attributes available to each subsequent 
tree (which might not be what you're wanting).

Cheers,
Mark.

_______________________________________________
Wekalist mailing list
Send posts to: Wekalist <at> list.scms.waikato.ac.nz
List info and subscription status: https://list.scms.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html