Best-first Model Merging for Hidden Markov Model Induction

Details Best-first Model Merging for Hidden Markov Model Induction Best-first Model Merging for Hidden Markov Model Induction

1994-05-10

arxiv.org/abs/cmp-lg/9405017v1

Computer Science

Computation and Language

63 pages

Scientific paper

This report describes a new technique for inducing the structure of Hidden Markov Models from data which is based on the general `model merging' strategy (Omohundro 1992). The process begins with a maximum likelihood HMM that directly encodes the training data. Successively more general models are produced by merging HMM states. A Bayesian posterior probability criterion is used to determine which states to merge and when to stop generalizing. The procedure may be considered a heuristic search for the HMM structure with the highest posterior probability. We discuss a variety of possible priors for HMMs, as well as a number of approximations which improve the computational efficiency of the algorithm. We studied three applications to evaluate the procedure. The first compares the merging algorithm with the standard Baum-Welch approach in inducing simple finite-state languages from small, positive-only training samples. We found that the merging procedure is more robust and accurate, particularly with a small amount of training data. The second application uses labelled speech data from the TIMIT database to build compact, multiple-pronunciation word models that can be used in speech recognition. Finally, we describe how the algorithm was incorporated in an operational speech understanding system, where it is combined with neural network acoustic likelihood estimators to improve performance over single-pronunciation word models.

Affiliated with

Also associated with

No associations

Rating

Best-first Model Merging for Hidden Markov Model Induction does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Best-first Model Merging for Hidden Markov Model Induction, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Best-first Model Merging for Hidden Markov Model Induction will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-288997