Work Package 2

Cognitive listening effort in adverse conditions is increasingly conceived as a crucial component of speech communication and language learning. This work package will explore various means to make communication easier and help children with hearing impairment to optimise their cognitive resources for interaction and learning. Multimodality is a primary means to provide enhanced input, associating the degraded auditory input to vision (for both lipreading and spatial hearing, and with the possible addition of manual linguistic cues) but also somatosensory information on the speaker’s gestures. Various tools for cognitive training together with innovative speech technologies will also be explored to enhance communication and learning.

5. Temporal course of auditory, labial, and manual signals in Cued Speech perception

6. Exploiting the somatosensory function in hearing impaired subjects for understanding and rehabilitating the perceptuo-motor loop in speech communication

7. Improving integration of audio-visual speech cues in children with hearing impairment

8. Effortful listening and auditory learning in children with hearing impairment

9. Theory of mind, language and cognitive skills in deaf and deafblind children (Usher syndrome) fitted with cochlear implants

10. Automatic recognition and generation of Cued Speech using deep learning