ISi Speech – Individualized speech recognition for rehabilitation of persons with significantly reduced speech intelligibility

The ability to speak is a key competency for participating in society. Any restriction in speech capability due to age, illness or disabilities results in the risk of social withdrawal for many of those affected. In the ISi-Speech project, a training system is being developed on the basis of computer-assisted speech recognition that allows affected persons to independently train their speech capability. A motivation and feedback system will support the individual training situation. The system is initially intended for persons with significantly reduced speech intelligibility due to a neurological illness such as Parkinson’s disease, multiple sclerosis or dysarthria after a stroke. In the next step, the ISi-Speech technology will be extended to include other clinical pictures or applications.

Responsibilities of Fraunhofer IDMT

In this project, the Division Hearing, Speech and Audio Technology of the Fraunhofer IDMT is conducting research into algorithms and strategies for robust speech recognition of impaired user speech. For this purpose, a database will be created in the form of a speech corpus for impaired speech. The existing speech recognition technology will be extended by components for evaluation of articulation and modules for reliable detection of impaired speech.


  • SpeechCare, Leverkusen (Koordination)
  • Hochschule für Gesundheit, Bochum
  • Linguwerk, Dresden
  • Technische Universität Dortmund
  • Deutsche Parkinson Vereinigung DPV (assoziiert)




Federal Ministry of Education and Research Germany

Further information:


Follow-up project THERESIAH

Digital therapysystem to train hearing and articulation for highly hearing-impaired persons.


Connected Health

The Connected Health group develops mobile sensor-based health systems.