machine learning - OpenGenus IQ

L1 and L2 Regularization Methods

A regression model that uses L1 regularization technique is called Lasso Regression and model which uses L2 is called Ridge Regression. The key difference between these two is the penalty term. Lasso shrinks the less important feature’s coefficient to zero

Artificial Intelligence

Gradient descent

Gradient descent algorithm is one of the most popuarl algorithms for finding optimal parameters for most machine learning models including neural networks. The basic method that this algorithm uses is to find optimal values for the parameters that define your ‘cost function’.

Artificial Intelligence

Regularization

Regularization is a method used to reduce the variance of your model and increase the bias. It is used when your model overfits the training data. Another method to do regularization is called Lasso regression. This is the solution to Biase-Variance Dilemma.

Artificial Intelligence

Cross Validation

Cross Validation is a procedure used to evaluate your machine learning model on limited sample of data. With the help of this, we can actually tell how well our model performs on unseen data. Other variants are stratified cross validation and leave one out cross validation. Learn through an example

Artificial Intelligence

Decision Trees

Decision Tree is a popular machine learning algorithm mainly used for classification. Concepts of entropy and information gain are required to apply decision tree for a data set. It is used for non-linear classification and regression Learn through an example