(eng): Markov chains are black box models ideal for describing stochastic digitised systems. Although the identification of their parameters can be a relatively easy task to perform, the dimensionality involved become undesirable large. This significant drawback can be overcome by exploiting smoothness of the underlying system. The paper present a novel hybrid off-line algorithm to locate areas which merit detailed model description. It comprises Bayesian parameter estimation and Mean tracking algorithm.