Přejít k hlavnímu obsahu


Conference Paper (international conference)

Automatic Evaluation of Speech Therapy Exercises Based on Image Data

Bílková Zuzana, Novozámský Adam, Dominec Adam, Greško Šimon, Zitová Barbara, Paroubková Markéta

: Image Analysis and Recognition : 16th International Conference, ICIAR 2019, Waterloo, ON, Canada, August 27–29, 2019, p. 397-404 , Eds: Karray Fakhri , Campilho Aurélio, Yu Alfred

: Image Analysis and Recognition. ICIAR 2019 /16./, (Waterloo, CA, 20190827)

: TJ01000181, GA TA ČR

: Lip movement detection, Tongue segmentation, Speech therapy

: 10.1007/978-3-030-27202-9_36

: http://library.utia.cas.cz/separaty/2019/ZOI/bilkova-0508623.pdf

(eng): The presented paper proposes a new method for unique automatic evaluation of speech therapy exercises, one part of the future software system for speech therapy support. The method is based on the detection of the lips and tongue movements, which will help to evaluate the quality of the exercise implementation. Four different types of exercises are introduced and the corresponding features, capturing the quality of the movements, are shown. The method was tested using manually annotated data and the proposed features were evaluated and analyzed. At the second part, the tongue detection is proposed based on the convolutional neural network approach and preliminary results were shown.

: JC

: 10201