Archives for training data

29 Mar

Council Post: Data-centric AI in Intelligent Document Automation

image-38809
image-38809

Data-centric AI is an emerging approach that places data at the forefront of AI development. Rather than focusing only on developing sophisticated models or endlessly refining such models, data-centric AI emphasises the importance of quality data in training the models effectively. This approach can be particularly useful in the field of unstructured document processing, where ensuring the quality of training data could be a huge challenge.

The post Council Post: Data-centric AI in Intelligent Document Automation appeared first on Analytics India Magazine.

13 Jul

Garbage In, Garbage Out: The Problem Of Data Labeling

In 2018, Amazon built a machine learning (ML) algorithm for hiring new candidates. However, because of substantial gender bias, it was scrapped soon. The fault did not lay in the algorithm but in the data that it was trained on.  The ML algorithm was trained on Amazon’s previous hiring data. However, since the tech giant…

The post Garbage In, Garbage Out: The Problem Of Data Labeling appeared first on Analytics India Magazine.

10 Jul

Training Models With Over 100 Billion Parameters

image-13915
image-13915

Following the announcement of open source release of DeepSpeed library and Zero Redundancy Optimiser (ZeRO), Microsoft, in mid of this year, announced its upgrade, in order to train large neural networks, with ZeRO-2. Training large scale models often comes with several challenges, such as hardware limitations and tradeoffs with computation and efficiency. Thus, to overcome…

The post Training Models With Over 100 Billion Parameters appeared first on Analytics India Magazine.

01 Jul

How Having Bigger AI Models Can Have A Detrimental Impact On Environment

The COVID crisis has skyrocketed the applications of artificial intelligence — from tackling this global pandemic, to being a vital tool in managing various business processes. Despite its benefits, AI has always been scrutinised for its ethical concerns like existing biases and privacy issues. However, this technology also has some significant sustainability issues – it…

The post How Having Bigger AI Models Can Have A Detrimental Impact On Environment appeared first on Analytics India Magazine.

01 Jul

How Having Bigger AI Models Can Have A Detrimental Impact On Environment

The COVID crisis has skyrocketed the applications of artificial intelligence — from tackling this global pandemic, to being a vital tool in managing various business processes. Despite its benefits, AI has always been scrutinised for its ethical concerns like existing biases and privacy issues. However, this technology also has some significant sustainability issues – it…

The post How Having Bigger AI Models Can Have A Detrimental Impact On Environment appeared first on Analytics India Magazine.

27 Dec

How Training AI Models In Simulated Environments Is Helping Researchers

The entire AI training process occurs during the simulation and without needing to go through the tedious process of data collection that is both difficult and expensive. While artificial intelligence is impacting the world in different ways, the capability of machine learning algorithms profoundly relies upon the data. Reinforcement learning specifically where the model learns…

The post How Training AI Models In Simulated Environments Is Helping Researchers appeared first on Analytics India Magazine.