Mathematics – Statistics Theory
Scientific paper
2004-06-11
Mathematics
Statistics Theory
15 pages, 1 PostScript figure; in review by "Computational Statistics and Data Analysis"; citation 15 activated 20 pages, 1.5-
Scientific paper
We study modifications of the Viterbi Training (VT) algorithm to estimate emission parameters in Hidden Markov Models (HMM) in general, and in mixure models in particular. Motivated by applications of VT to HMM that are used in speech recognition, natural language modeling, image analysis, and bioinformatics, we investigate a possibility of alleviating the inconsistency of VT while controlling the amount of extra computations. Specifically, we propose to enable VT to asymptotically fix the true values of the parameters as does the EM algorithm. This relies on infinite Viterbi alignment and an associated with it limiting probability distribution. This paper, however, focuses on mixture models, an important case of HMM, wherein the limiting distribution can always be computed exactly; finding such limiting distribution for general HMM presents a more challenging task under our ongoing investigation. A simulation of a univariate Gaussian mixture shows that our central algorithm (VA1) can dramatically improve accuracy without much cost in computation time. We also present VA2, a more mathematically advanced correction to VT, verify by simulation its fast convergence and high accuracy; its computational feasibility remains to be investigated in future work.
Koloydenko Alexey
Lember Jüri
No associations
LandOfFree
Adjusted Viterbi training does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Adjusted Viterbi training, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Adjusted Viterbi training will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-106537