11-733 Multilingual Speech-to-Speech Translation Lab

6 units, Carnegie Mellon University

Building speechtospeech translation systems S2S is an extremely complex task, involving research in Automatic Speech Recognition ASR, Machine Translation MT, Natural Language Understanding NLU, as well as TexttoSpeech TTS and doing this for many languages doesnt make it easier. Although substantial progress has been made in each of these areas over the last years, the integration of the invididual ASR, MT, NLU, and TTS components to build a good S2S system is still a very challenging task. The seminar course on Multilingual SpeechtoSpeech Translation will cover important recent work in the areas of ASR, MT, NLU, and TTS with a special focus on language portable approaches and discuss solutions for rapidly building stateoftheart speechtospeech translation systems. In the beginning sessions the instructors and other invited lecturers will give a brief introduction into the broad field. We will select papers on particular topics to read by each week. While everyone will do all readings and participate in the discussions, one person is assigned per session to present the basic ideas of the topic specific papers and lead the concluding discussion.

Prerequisites: none listed

Courseweave needs JavaScript to show sections, workloads and planning tools.