Automatic Identification of Document Translations in Large Multilingual Document Collections

Computer Science – Computation and Language

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

This technology is used daily to link related news items across languages in the multilingual news analysis system NewsExplore

Scientific paper

Texts and their translations are a rich linguistic resource that can be used to train and test statistics-based Machine Translation systems and many other applications. In this paper, we present a working system that can identify translations and other very similar documents among a large number of candidates, by representing the document contents with a vector of thesaurus terms from a multilingual thesaurus, and by then measuring the semantic similarity between the vectors. Tests on different text types have shown that the system can detect translations with over 96% precision in a large search space of 820 documents or more. The system was tuned to ignore language-specific similarities and to give similar documents in a second language the same similarity score as equivalent documents in the same language. The application can also be used to detect cross-lingual document plagiarism.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Automatic Identification of Document Translations in Large Multilingual Document Collections does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Automatic Identification of Document Translations in Large Multilingual Document Collections, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Automatic Identification of Document Translations in Large Multilingual Document Collections will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-691122

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.