Activation Functions in Deep Learning
An activation function in deep learning is a nonlinear transformation applied to the node output before passing it to the consequent layers in neural networks. Artificial Neural Networks (ANN) consist of multiple layers interconnected. Mainly there will be an input layer, output layer and one or more hidden layers. Inspired by the biological neural networks, …