Archives for BigBird

04 Sep

BigBird – Google’s ‘Brahmastra’ For NLP Supremacy?

image-15390
image-15390

Google transformer-based models like BERTshowcased immense success with NLP tasks; however, came with a significant limitation of quadratic dependency in-memory storage for the sequence length. A lot of this could be attributed to its full attention mechanism for sequence lengths. Such a self-attention mechanism can create several challenges for processing longer text sequences. Thus to…

The post BigBird – Google’s ‘Brahmastra’ For NLP Supremacy? appeared first on Analytics India Magazine.