Archives for attention mechanism

22 Aug

Hands-on Guide to Effective Image Captioning Using Attention Mechanism

image-25453
image-25453

Before 2015 when the first attention model was proposed, machine translation was based on the simple encoder-decoder model, a stack of  RNN and LSTM layers. The encoder is used to process the entire sequence of input data into a context vector. This is expected to be a good summary of input data. The final stage of the encoder is the initial stage of the decoder. 

The post Hands-on Guide to Effective Image Captioning Using Attention Mechanism appeared first on Analytics India Magazine.

21 Mar

How To Detect Objects With Detection Transformers?

image-21042
image-21042

DETR(Detection Transformer) is an end to end object detection model that does object classification and localization i.e boundary box detection. It is a simple encoder-decoderTransformer with a novel loss function that allows us to formulate the complex object detection problem as a set prediction problem.

The post How To Detect Objects With Detection Transformers? appeared first on Analytics India Magazine.