Computer Science – Digital Libraries
Scientific paper
2011-05-22
Computer Science
Digital Libraries
67 pages, 2 figures, 4 tables, 2 algorithms
Scientific paper
Correction of Noisy Natural Language Text is an important and well studied problem in Natural Language Processing. It has a number of applications in domains like Statistical Machine Translation, Second Language Learning and Natural Language Generation. In this work, we consider some statistical techniques for Text Correction. We define the classes of errors commonly found in text and describe algorithms to correct them. The data has been taken from a poorly trained Machine Translation system. The algorithms use only a language model in the target language in order to correct the sentences. We use phrase based correction methods in both the algorithms. The phrases are replaced and combined to give us the ?final corrected sentence. We also present the methods to model different kinds of errors, in addition to results of the working of the algorithms on the test set. We show that one of the approaches fail to achieve the desired goal, whereas the other succeeds well. In the end, we analyze the possible reasons for such a trend in performance.
No associations
LandOfFree
Correction of Noisy Sentences using a Monolingual Corpus does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Correction of Noisy Sentences using a Monolingual Corpus, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Correction of Noisy Sentences using a Monolingual Corpus will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-329988