Computer Science – Computation and Language
Scientific paper
2006-09-12
Proceedings of the International Conference 'Recent Advances in Natural Language Processing' (RANLP'2003), pp. 401-408. Borove
Computer Science
Computation and Language
This technology is used daily to link related news items across languages in the multilingual news analysis system NewsExplore
Scientific paper
Texts and their translations are a rich linguistic resource that can be used to train and test statistics-based Machine Translation systems and many other applications. In this paper, we present a working system that can identify translations and other very similar documents among a large number of candidates, by representing the document contents with a vector of thesaurus terms from a multilingual thesaurus, and by then measuring the semantic similarity between the vectors. Tests on different text types have shown that the system can detect translations with over 96% precision in a large search space of 820 documents or more. The system was tuned to ignore language-specific similarities and to give similar documents in a second language the same similarity score as equivalent documents in the same language. The application can also be used to detect cross-lingual document plagiarism.
Ignat Camelia
Pouliquen Bruno
Steinberger Ralf
No associations
LandOfFree
Automatic Identification of Document Translations in Large Multilingual Document Collections does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Automatic Identification of Document Translations in Large Multilingual Document Collections, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Automatic Identification of Document Translations in Large Multilingual Document Collections will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-691122