ACOUSTIC-TO-ARTICULATORY INVERSION USING AN EPISODIC MEMORY

Modeling and Analysis of Speech Production

Presented by: Sebastien Demange, Author(s): Sebastien Demange, LORIA / INRIA, France; Slim Ouni, University Nancy 2, France

This paper presents a new acoustic-to-articulatory inversion method based on an episodic memory which is an interesting model for two reasons. First, it does not rely on any assumptions about the mapping function but rather it relies of real synchronized acoustic and articulatory data streams. Second, the memory structurally embeds the naturalness of the articulatory dynamics. We introduce the concept of generative episodic memory which enables the production of unseen articulatory trajectories according to the acoustic signals to be inverted. The proposed memory is evaluated on the MOCHA corpus. The results show its effectiveness and are very encouraging since they are comparable to those of recently proposed methods.

You need the Flash Player.

Share:

Download subtitles | Enlarge video

1. slide