Archives for gradient descent

01 Apr

What is momentum in a Neural network and how does it work?

In a neural network, there is the concept of loss, which is used to calculate performance. The higher the loss, the poorer the performance of the neural network, that is why we always try to minimize the loss so that the neural network performs better.

22 Mar

How to perform gradient-based optimization using Autograd?

Yugesh Verma artificial intelligence

Autograd is a python package that can provide us with a way to differentiate Numpy and Python code. It is a library for gradient-based optimization. Using this package we can work with a large subset of features of python including loops, ifs, recursion, and closures. Also, this package is capable of taking multiple step-wise derivatives of functions.

29 Sep

Addressing The Vanishing Gradient Problem: A Guide For Beginners

Yugesh Verma analytics

when the elements of the gradient become exponentially small so that the update of the parameters with the gradient becomes almost insignificant

22 Sep

Convex Optimisation Algorithm & The Unique Problem Of Rocket Landings

Dr. Nivash Jeevanandam artificial intelligence

Space exploration is being propelled forward by Convex Optimization Algorithm.

03 Jun

Does Deep Learning Suffer From Too Many Optimizers?

Ram Sagar ADAM

“There is no single optimizer that dominates its competitors across all tasks.” Critics often call machine learning ‘glorified statistics’. There is some merit to the argument. The fundamental function of any machine learning model is pattern recognition, which relies on the principles of convergence; the methods of fitting data to the model. To that end,…

The post Does Deep Learning Suffer From Too Many Optimizers? appeared first on Analytics India Magazine.

02 Nov

Understanding XGBoost Algorithm In Detail

Jayita Bhattacharyya Boosting Algorithm

In this article, I’ll be discussing how XGBoost works internally to make decision trees and deduce predictions.

The post Understanding XGBoost Algorithm In Detail appeared first on Analytics India Magazine.

01 Nov

Complete Guide To Exploding Gradient Problem

Bhavishya Pandit Developers Corner

Neural Networks have surely saved us many at times, the way we have used them for different use cases if simply phenomenal. This concept of deep learning was in talks for decades but because of computational issues, it was side talked for a few years. Deep Learning has got its hype again, many think that…

The post Complete Guide To Exploding Gradient Problem appeared first on Analytics India Magazine.

23 Sep

Gradient Descent – Everything You Need To Know With Implementation In Python

Rohit Dwivedi deep learning

Through this article, we will discuss more optimizers and the most commonly used optimizer gradient descent. We will explore how it works and will check its implementation in python.

The post Gradient Descent – Everything You Need To Know With Implementation In Python appeared first on Analytics India Magazine.

27 Sep

6 Techniques From Leading AI Scientists To Optimise Deep Neural Networks

Ambika Choudhury deep neural networks

Inspired by human brains, Artificial Neural Networks (ANN) are now being utilised by enterprises across the globe to solve a number of complex computing tasks like speech recognition, computer vision, stock market prediction, among others. In this article, we list down 6 techniques which can be used to optimise deep neural networks. 1| Stochastic Gradient…

The post 6 Techniques From Leading AI Scientists To Optimise Deep Neural Networks appeared first on Analytics India Magazine.

28 May

Why Learning Rate Is Crucial In Deep Learning

Ram Sagar Adagrad

A key balancing act in machine learning is choosing an appropriate level of model complexity: if the model is too complex, it will fit the data used to construct the model very well but generalise poorly to unseen data (overfitting); if the complexity is too low the model won’t capture all the information in the…

The post Why Learning Rate Is Crucial In Deep Learning appeared first on Analytics India Magazine.

1 2 Next »