- Home
- Interview Questions
- Data Science
Exploding gradients are a problem where large error gradients accumulate and result in very large updates to neural network model weights during training.” At an extreme, the values of weights can become so large as to overflow and result in NaN values. This has the effect of your model being unstable and unable to learn from your training data.
There are four types of kernels in SVM.
1. Linear Kernel
2. Polynomial kernel
3. Radial basis kernel
4. Sigmoid kernel
SVM stands for support vector machine, it is a supervised machine learning algorithm which can be used for both Regression and Classification. If you have n features in your training dataset, SVM tries to plot it in n-dimentional space with the value of each feature being the value of a particular coordinate. SVM uses hyper planes to seperate out different classes based on the provided kernel function.
When we remove sub-nodes of a decision node, this procsss is called pruning or opposite process of splitting.
Random forest is a versatile machine learning method capable of performing
both regression and classification tasks. It is also used for dimentionality
reduction, treats missing values, outlier values. It is a type of ensemble learning
method, where a group of weak models combine to form a powerful model.
In Random Forest, we grow multiple trees as opposed to a single tree. To
classify a new object based on attributes, each tree gives a classification. The
forest chooses the classification having the most votes(Over all the trees in the
forest) and in case of regression, it takes the average of outputs by different
trees.