You are here

Consistent Estimation of the Order of Hidden Markov Chains

Type: 
Conference Paper›Invited and refereed articles in conference proceedings
Authored by:
Baras, John S., Finesso, Lorenzo.
Conference date:
September 26-28, 1991
Conference:
Stochastic Theory and Adaptive Control Workshop, Lecture Notes In Control and Information Sciences 184, pp. 26-39
Full Text Paper: 
Abstract: 

The structural parameters of many statistical models can be estimated maximizing a penalized version of the likelihood function. We use this idea to construct strongly consistent estimators of the order of Hidden Markov Chain models. The specification of the penalty term requires precise information on the rate of growth of the maximized likelihood ratio. We find an upper bound to the rate using results from Information Theory. We give sufficient conditions on the penalty term to avoid overestination and underestimation of the order. Examples of penalty terms that generate strongly consistent estimators are also given.