Archives for EleutherAI

12 Jul

EleutherAI’s GPT-J vs OpenAI’s GPT-3

image-24197
image-24197

OpenAI’s not so open GPT-3 has an open-source cousin GPT-J, from the house of EleutherAI. Check out the source code on Colab notebook and a free web demo here.  EleutherAI, founded by Connor Leahy, Leo Gao, and Sid Black, is a research group focused on AI alignment, scaling and open-source AI research. In March 2021,…

The post EleutherAI’s GPT-J vs OpenAI’s GPT-3 appeared first on Analytics India Magazine.

04 Apr

GPT-Neo: The Open-Source Cure For GPT-3 FOMO

image-21442
image-21442

GPT-3 was the largest language model when OpenAI released it last year. Now, Google Brain’s 1.6 trillion parameters language model (as opposed to GPT-3’s 175 billion parameters) has replaced GPT-3 as the largest language model. Both GPT-3 and Google Brain model are transformer-based neural networks. Developers across the world were waiting for the arrival of…

The post GPT-Neo: The Open-Source Cure For GPT-3 FOMO appeared first on Analytics India Magazine.

04 Apr

GPT-Neo: The Open-Source Cure For GPT-3 FOMO

image-21444
image-21444

GPT-3 was the largest language model when OpenAI released it last year. Now, Google Brain’s 1.6 trillion parameters language model (as opposed to GPT-3’s 175 billion parameters) has replaced GPT-3 as the largest language model. Both GPT-3 and Google Brain model are transformer-based neural networks. Developers across the world were waiting for the arrival of…

The post GPT-Neo: The Open-Source Cure For GPT-3 FOMO appeared first on Analytics India Magazine.