Towards an articulatory-driven neural vocoder

Preliminary results for speech synthesis from estimated articulatory trajectories.

Read the paper
Spectrogram color scale
LPCNet resynthesisReconstruction using EMA dataReconstruction using articulatory data
item_0578, LPCNet resynthesis spectrogram
item_0578, Reconstruction using EMA data spectrogram
item_0578, Reconstruction using articulatory data spectrogram
item_0939, LPCNet resynthesis spectrogram
item_0939, Reconstruction using EMA data spectrogram
item_0939, Reconstruction using articulatory data spectrogram
item_0993, LPCNet resynthesis spectrogram
item_0993, Reconstruction using EMA data spectrogram
item_0993, Reconstruction using articulatory data spectrogram
item_1006, LPCNet resynthesis spectrogram
item_1006, Reconstruction using EMA data spectrogram
item_1006, Reconstruction using articulatory data spectrogram
item_1069, LPCNet resynthesis spectrogram
item_1069, Reconstruction using EMA data spectrogram
item_1069, Reconstruction using articulatory data spectrogram