Posts tagged generative

Better Language Models and Their Implications

gpt2, ML, AI, text, text-generation, generative, OpenAI, 2019

GPT-2 displays a broad set of capabilities, including the ability to generate conditional synthetic text samples of unprecedented quality, where we prime the model with an input and have it generate a lengthy continuation. In addition, GPT-2 outperforms other language models trained on specific domains (like Wikipedia, news, or books) without needing to use these domain-specific training datasets. On language tasks like question answering, reading comprehension, summarization, and translation, GPT-2 begins to learn these tasks from the raw text, using no task-specific training data. While scores on these downstream tasks are far from state-of-the-art, they suggest that the tasks can benefit from unsupervised techniques, given sufficient (unlabeled) data and compute.

via https://blog.openai.com/better-language-models/

WaveNet: A Generative Model for Raw Audio

audio, music, speech, synthesis, rnn, cnn, deepmind, generative, wavenets

This post presents WaveNet, a deep generative model of raw audio waveforms. We show that WaveNets are able to generate speech which mimics any human voice and which sounds more natural than the best existing Text-to-Speech systems, reducing the gap with human performance by over 50%. We also demonstrate that the same network can be used to synthesize other audio signals such as music, and present some striking samples of automatically generated piano pieces.

via https://deepmind.com/blog/wavenet-generative-model-raw-audio/

Paul Prudence interviews Mitchell Whitelaw

art, generative, futurism, utopianism, dystopianism, interview, paul prudence, mitchell whitelaw

It might be argued that some of the main themes infused in generative art are those to do with a kind of techno-utopianism and futurism. Have you come across any generative artworks that deal with dystopian themes or have a sense of anachronism about them? More importantly are the technologies and software used in creating these artworks inherently defining their aesthetics?

http://teemingvoid.blogspot.com.au/2012/01/interview-with-paul-prudence-for-neural.html