We explored the various types of activation functions that are used in Machine Learning including Identity function, Binary Step, Sigmoid, Tanh, ReLU, Leaky ReLU and SoftMax function. Activation function help the network use the useful information and suppress the irrelevant data points