< Back to Article

Orthogonal position representations for transformer in neural machine translation

Fig 5

Visualization of position-wise cosine similarity of different position embeddings.

Lighter denotes the higher similarity.

doi: https://doi.org/10.1371/journal.pone.0334443.g005