I'm working with a dataset of approximately 150,000 observations and 50 features, using SVM for the final model. To trim down the feature count, I decided to look into using RF so SVM optimization doesn't take too long. I'm currently using the TreeBagger implementation in Matlab and had a few questions. When investigating feature importances, … Read more
I have a set of x, y data I'm using to build a random forest. The x data is a vector of values that includes some NAs. So I use rfImpute to handle the missing data and create a random forest. Now I have a new unseen observation x (with an NA) and I want … Read more
A random forest is a collection of decision trees following the bagging concept. When we move from one decision tree to the next decision tree then how does the information learned by last decision tree move forward to the next? Because, as per my understanding, there is nothing like a trained model which gets created … Read more
There are two popular R packages to build random forests introduced by Breiman (2001): randomForest and randomForestSRC. I am noticing small, yet significant discrepancies in terms of accuracy between the two packages, even when I try to use the same input parameters. I understand we would expect a slightly different random forest, but in example … Read more
There are two popular R packages to build random forests introduced by Breiman (2001): randomForest and randomForestSRC. I am noticing small, yet significant discrepancies in terms of accuracy between the two packages, even when I try to use the same input parameters. I understand we would expect a slightly different random forest, but in example … Read more
There is a great deal of information on how unbalanced data sets may impact predictive accuracy in classification problems. Several solutions have been proposed (see here). My questions are: Can a highly skewed target distribution (i.e. when the response variable is continuous and not categorical) create similar problems in a regression random forest? The response … Read more
There is a great deal of information on how unbalanced data sets may impact predictive accuracy in classification problems. Several solutions have been proposed (see here). My questions are: Can a highly skewed target distribution (i.e. when the response variable is continuous and not categorical) create similar problems in a regression random forest? The response … Read more
Closed. This question is off-topic. It is not currently accepting answers. This question appears to be off-topic because EITHER it is not about statistics, machine learning, data analysis, data mining, or data visualization, OR it focuses on programming, debugging, or performing routine operations within a statistical computing platform. If the latter, you could try the … Read more
Closed. This question is off-topic. It is not currently accepting answers. This question appears to be off-topic because EITHER it is not about statistics, machine learning, data analysis, data mining, or data visualization, OR it focuses on programming, debugging, or performing routine operations within a statistical computing platform. If the latter, you could try the … Read more
I am using random Forest in R and only want to Plot the OOB Error. When I do plot(myModel, log = "y") I get a diagram where each of my class is a line. On the x-axis are the ntree while on the x-Axis there is the Error rate. When I try plot(myModel$err.rate, log = … Read more