Deep learning applications usually involve complex optimisation problems that are often difficult to solve analytically. Often the objective function itself may not be in analytically closed-form, which means that the objective function only permits function evaluations without any gradient evaluations. This is where Zeroth-Order comes in. Optimisation corresponding to the above types of problems falls…

The post Zeroth-Order Optimisation And Its Applications In Deep Learning appeared first on Analytics India Magazine.