GIT is pre-trained using the BERT encoder and KERMIT objective on an unsupervised LM task.

The post  What’s Generative Insertion Transformer? appeared first on Analytics India Magazine.