(eng): The main motivation of the present paper is to design a statistically well justified and biologically compatible neural network model and to suggest a theoretical interpretation of the high parallelism of biological neural networks. We consider a probabilistic approach to neural networks in the framework of statistical pattern recognition. The complete method based on EM algorithm has been applied to recognize unconstrained handwritten numerals from the database of the Concordia University Montreal.