Archives for natural language models
06
Dec
Top 10 Alternatives to GPT-3


There are many other language models with either lesser or more number of parameters, that can be suitable for your NLP tasks
The post Top 10 Alternatives to GPT-3 appeared first on Analytics India Magazine.
Integrating a core NLP functionality or solution with other modules is essential to make it impactful.
10
Feb
Microsoft, NVIDIA test waters for a large-scale generative language model with promising results


We believe that our results and findings can help, shape, and facilitate future research in foundational, large-scale pretraining.
The key is that 1T was never ‘trained to convergence.’


MT-NLG has 3x the number of parameters compared to the existing largest models – GPT-3, Turing NLG, Megatron-LM and others.
Recently, 55 researchers from more than 40 research labs and academia (including Intel, Microsoft, Google Research) worldwide came together to introduce GEM, a benchmark for natural language generation (NLG). GEM is claimed to be a living benchmark for evaluation of NLG models. The benchmark allows models to be implemented in a large set of corpora…
The post Why Tech Giants Introduced Their Own Benchmark for NLP appeared first on Analytics India Magazine.

