Multisensory perception and learning

The research on multisensory perception concentrates on audiovisual interactions. An important topic is the investigation the audiovisual nature of speech and its utility in learning. That is, the articulatory movements that produce the auditory signal are partially visible on the talker’s face, and observing them enhances speech comprehension. Even though this is well known, audiovisual speech has been used surprisingly little in speech and language training. Therefore, we aim to chart the instances in which it can offer learning benefits. We also study audiovisual semantic memory, that is, how different combinations of natural visual images and auditory sounds, or spoken and written words can enhance memory performance.