MUTABLE: Multimodal Translation with the Blind
A postdoctoral research project at University of Helsinki, funded by Academy of Finland
Project duration: 2017-2019
How are cognitive operations related to translating (e.g. problem solving, processing of source and target texts) displayed in the interaction between translating team members? How are the cognitive displays shared via different communication modes, such as speech, gestures, and gaze?
How does translating emerge and evolve as an interactive process between social actors?
What kind of expertise does the team bring in the translation process? How does the perception-related asymmetry between its members – some are sighted whereas others are blind – affect interaction and translation? Is blindness a resource rather than a handicap?
MUTABLE studies the interactive translation process by analyzing team audio description in which sighted and blind describers work on an audio description face-to-face. In the project, the particular topics of interest are the interface between cognition and interaction, the use of multimodal resources while translating, and the organisation of work in and the expertise of perceptually asymmetrical teams. The main research data are video recordings of authentic audio description processes in Austria, Finland and Germany.
The project’s results increase knowledge of translating as a multimodal and interactive process and of interaction between sighted and non-sighted persons. The project highlights the role of interaction and users in the making of translation. The project’s findings can help identifying visually-impaired persons’ expertise in relation to translation and multimodal communication. This new knowledge can be applied to foster inclusion in the society as well as diversity at workplace.
In the video below, Maija Hirvonen interviews (in Finnish) two Finnish audio describers (one sighted and one blind) about their process of creating audio descriptions and working together: