Skip to content

dot_product_attention

allennlp.modules.attention.dot_product_attention

[SOURCE]


DotProductAttention

@Attention.register("dot_product")
class DotProductAttention(Attention)

Computes attention between a vector and a matrix using dot product.

Reference: Attention Is All You Need (Vaswani et al, 2017)

Registered as an Attention with name "dot_product".