Self-supervised learning of speech units, gestures and sounds relationships

This is a demo page accompanying the paper “Decode, move and speak! Self-supervised learning of speech units, gestures and sounds relationships using vocal imitation.”

Condition:




Spectrograms colorbar
Original sound Articulatory synthesizer
Original sound spectrogram for item 1
Spectrogram for item 1 on condition Articulatory synthesizer
Original sound spectrogram for item 2
Spectrogram for item 2 on condition Articulatory synthesizer
Original sound spectrogram for item 3
Spectrogram for item 3 on condition Articulatory synthesizer
Original sound spectrogram for item 4
Spectrogram for item 4 on condition Articulatory synthesizer
Original sound spectrogram for item 5
Spectrogram for item 5 on condition Articulatory synthesizer
Original sound spectrogram for item 6
Spectrogram for item 6 on condition Articulatory synthesizer