In 2017, Google researchers announced Transformers to the world in a NIPS paper titled “Attention is All You Need”. The self-attention mechanism-based novel neural network architecture has since been used in several NLP applications, GPT-3 being a good case in point. Transformers–thanks to their ability to integrate information over long time horizons and scale to…

The post How Transformers Are Making Headway In Reinforcement Learning appeared first on Analytics India Magazine.