due to the large size and computational complexities of the models and data, the performance of networks is reduced. Parallel and distributed deep learning approaches can be helpful in improving the performance.