Decode, move and speak!

Self-supervised learning of speech units, gestures and sounds relationships using vocal imitation.

Read the paper
Condition
Spectrogram color scale
Original soundModel reconstruction
Original sound spectrogram for item 1
Spectrogram for item 1, Articulatory synthesizer
Original sound spectrogram for item 2
Spectrogram for item 2, Articulatory synthesizer
Original sound spectrogram for item 3
Spectrogram for item 3, Articulatory synthesizer
Original sound spectrogram for item 4
Spectrogram for item 4, Articulatory synthesizer
Original sound spectrogram for item 5
Spectrogram for item 5, Articulatory synthesizer
Original sound spectrogram for item 6
Spectrogram for item 6, Articulatory synthesizer