Semantic textual similarity based on deep learningCan it improve matching and retrieval for Translation Memory tools?

  1. Ranasinghe, Tharindu
  2. Mitkov, Ruslan
  3. Orăsan, Constantin
  4. Caro Quintana, Rocío
Book:
Corpora in Translation and Contrastive Research in the Digital Age: Recent advances and explorations
  1. Lavid-López, Julia (ed. lit.)
  2. Maíz-Arévalo, Carmen (ed. lit.)
  3. Zamorano-Mansilla, Juan Rafael (ed. lit.)

Publisher: John Benjamins

ISBN: 978-90-272-0918-4

Year of publication: 2021

Pages: 101-124

Type: Book chapter

DIALNET GOOGLE SCHOLAR

Abstract

This study proposes an original methodology to underpin the operation of new generation Translation Memory (TM) systems where the translations to be retrieved from the TM database are matched not on the basis of Levenshtein (edit) distance but by employing innovative Natural Language Processing (NLP) and Deep Learning (DL) techniques. Three DL sentence encoders were experimented with to retrieve TM matches in English-Spanish sentence pairs from the DGT TM dataset. Each sentence encoder was compared with Okapi which uses edit distance to retrieve the best match.1 The automatic evaluation shows the benefit of the DL technology for TM matching and holds promise for the implementation of the TM tool itself, which is our next project.

Data source: Dialnet