Archives for activation functions

23 Jan

What Are Activation Functions And When To Use Them

image-2233
image-2233

  These action potentials can be thought of as activation functions in the case of neural networks. The path that needs to be fired depends on the activation functions in the preceding layers just like any physical movement depends on the action potential at the neuron level. Deep neural networks are trained, by updating and…

The post What Are Activation Functions And When To Use Them appeared first on Analytics India Magazine.

12 Sep

The Number Game Behind Advanced Activation Functions In Machine Learning

image-134
image-134

With artificial intelligence being implemented in almost every sector, it is important to understand the maths behind how it functions so accurately. Activation functions are at the end of every hidden layer of a neural network and it plays a key part in updation of weights. The main function is to introduce a non-linearity in […]

The post The Number Game Behind Advanced Activation Functions In Machine Learning appeared first on Analytics India Magazine.