Minimum Entropy Aproach to Word Segmentation Problems

Details Minimum Entropy Aproach to Word Segmentation Problems Minimum Entropy Aproach to Word Segmentation Problems

2000-08-29

arxiv.org/abs/physics/0008232v1

Physics

Biological Physics

13 pages, 4 figures

Scientific paper

10.1016/S0378-4371(00)00545-8

Given a sequence composed of a limit number of characters, we try to "read" it as a "text". This involves to segment the sequence into "words". The difficulty is to distinguish good segmentation from enormous number of random ones.Aiming at revealing the nonrandomness of the sequence as strongly as possible, by applying maximum likelihood method, we find a quantity called Segmentation Entropy that can be used to fulfill the duty. Contrary to commonplace where maximum entropy principle was applied to obtain good solution, we choose to {\em minimize} the segmentation entropy to obtain good segmentation. The concept developed in this letter can be used to study the noncoding DNA sequences, e.g., for regulatory elements prediction, in eukaryote genomes.

Affiliated with

Also associated with

No associations

Rating

Minimum Entropy Aproach to Word Segmentation Problems does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Minimum Entropy Aproach to Word Segmentation Problems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Minimum Entropy Aproach to Word Segmentation Problems will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-269115