Google WaveNet: Neural Network-generated Text-2-Speech

Gepostet vor 5 Monaten, 16 Tagen in #Tech #AI #AlgoCulture #Language

Share: Twitter Facebook Mail


Google hat seine Neural Networks auf Stimmerzeugung trainiert und ein neues Verfahren zur Synthetisierung von Sprache erfunden. Die Ergebnisse sind deutlich besser, als das, was man bisher von Text-2-Speech-Synthesis so kennt:

Die füttern ihr WaveNet mit Lautsprache, bis zu einer „echten“ Text-2-Speech-Anwendung fehlt also noch ein kleines Stück (und das Teil ist ohnehin eher… langsam: „it takes 90 minutes to synthesize one second of audio.“)

Interessant: Da die Algorithmen aber auch auf Audio-Samples trainiert sind, können sie auch einfach losreden ohne Text-Input und die Ergebnisse hier beinhalten dann auch „menschliche Spuren“ in der Kunst-Stimme, also Atmen, Lispeln und subtile Schmatzer:

Discover Mag: Google DeepMind’s WaveNet AI Sounds Human, Rocks the Piano
Technology Review: Face of a Robot, Voice of an Angel? – DeepMind’s use of neural networks to synthesize speech could finally make computers sound more human.

generating speech with computers — a process usually referred to as speech synthesis or text-to-speech (TTS) — is still largely based on so-called concatenative TTS, where a very large database of short speech fragments are recorded from a single speaker and then recombined to form complete utterances. This makes it difficult to modify the voice (for example switching to a different speaker, or altering the emphasis or emotion of their speech) without recording a whole new database.

This has led to a great demand for parametric TTS, where all the information required to generate the data is stored in the parameters of the model, and the contents and characteristics of the speech can be controlled via the inputs to the model. So far, however, parametric TTS has tended to sound less natural than concatenative, at least for syllabic languages such as English. Existing parametric models typically generate audio signals by passing their outputs through signal processing algorithms known as vocoders.

WaveNet changes this paradigm by directly modelling the raw waveform of the audio signal, one sample at a time. As well as yielding more natural-sounding speech, using raw waveforms means that WaveNet can model any kind of audio, including music. […]

Here are some samples from all three systems so you can listen and compare yourself:

[…] If we train the network without the text sequence, it still generates speech, but now it has to make up what to say. As you can hear from the samples below, this results in a kind of babbling, where real words are interspersed with made-up word-like sounds:

[…] By changing the speaker identity, we can use WaveNet to say the same thing in different voices:

[…] Since WaveNets can be used to model any audio signal, we thought it would also be fun to try to generate music. Unlike the TTS experiments, we didn’t condition the networks on an input sequence telling it what to play (such as a musical score); instead, we simply let it generate whatever it wanted to. When we trained it on a dataset of classical piano music, it produced fascinating samples like the ones below:

Pix2Pix: Neural Network Katzen-Compositing als Browsertoy

Schönes Spielzeug von Christopher Hesse, der ein Neural Network auf Bild-Paaren trainiert hat und mit dem man nun Katzen, Schuhe…

Automatic Handgun Detection via Machine Learning

The latest Step into an OCP-approved Ed-209-compatible Future: Automatic Handgun Detection Alarm in Videos Using Deep Learning (PDF). Usage Guide:…

RechtsLinks 17.2.2017: Fuckopoulos at Maher, PewDiePie is a racist SuperNazi from hell, Trump is 4chan

Pic: Lie Lie Land von Bambi First things first: Milo Fuckopoulos ist heute abend bei Bill Maher: „Yiannopoulos will be…

ALF-Trump and other algorithmic Abominations

Großartiger neuer Twitter-Feed von Chris Rodley: Algorithmic Horror – Concept art for horror movies generated by an algorithm mit so…

Algorithmic Shape Collages

Interessantes Paper der Uni Hong Kong über automatisierte Shape Collagen (mit geilem Titel auch): Pyramid of Arclength Descriptor for Generating…

Where Slang Comes From

Schönes Posting von Matt Daniels über 2016er Slang: Where Slang Comes From – Emerging slang, identified by searches for words’…

RechtsLinks 12.2.2017: Seeßlen über die Sprache der Rechten und eine Tour der pro-authoritaristischen Neo-Reaktion

The Atlantic: Behind the Internet's Anti-Democracy Movement – White House chief strategist Steve Bannon is reportedly a reader of neoreactionary…


Ganz großartiger Bot von Andrew Heumann: Tweet2Form: The Formalist Tweetbot. Das Teil versteht 11 verschiedene Befehle für 3D-Transformationen, führt die…

Semiotics of Pepe

PBS Idea Channel über die Semiotik von Pepe: „Feels several different ways, man“. Bücher-Wiki über die im Clip angesprochene Polysemie:…

Cybernetic Serendipity 1968

Nice Walkthrough for the 1968 Cybernetic Serendipity-Exhibition at the Institute of Contemporary Arts in London. Some cool, early, experimental Machine-Typography…

Der Sünden-Bot

Mein Buddy Gregor macht wieder Unfug mit Tweetie-Bots, diesmal eine Metapher auf die panische Scheindebatte über den Angriff der killeralienmutant…