Recently, researchers from Facebook AI introduced a Transformer architecture, that is known to be with more memory as well as time-efficient, called Linformer. According to the researchers, Linformer is the first theoretically proven linear-time Transformer architecture. For a few years now, the number of parameters in Natural Language Processing (NLP) transformers has grown drastically, from…

The post Meet Linformer: The First Ever Linear-Time Transformer Architecture By Facebook appeared first on Analytics India Magazine.