Monday, August 06, 2007

Attribute Selection With Weka

Uing the tab "Select attributes" in Weka to do some
wrapper-based feature subset selection. I encounter several different
search methods.

Greedy stepwise with parameters
"conservativeForwardSelection" = False
"searchBackwards" = False

It does forward selection starting from an empty set of
attributes. It stops adding attributes as soon as there
is no single addition that improves apon the current
best subset's merit score.


Greedy stepwise with parameter
"conservativeForwardSelection" = True, and
"searchBackwards" = False

It does the same and it will continue to add new features as
long as it does not decrease the merit of the current best subset.


BestFirst with parameter "direction" = Forward
BestFirst is a beam search. It allows backtracking to
explore other promising search paths.

The "More" button in the GenericObjectEditor
when selecting/altering parameters for
search methods in the Explorer.

No comments: