‘AI music’ tag

Gwern Branwen

See Also
Gwern
- “GPT-2 Preference Learning for Music Generation”, Gwern 2019
Links
Miscellaneous
Link Bibliography

[Warning: JavaScript Disabled!]

[For support of key website features (link annotation popups/popovers & transclusions, collapsible sections, backlinks, tablesorting, image zooming, sidenotes etc), you must enable JavaScript.]

Gwern

“GPT-2 Preference Learning for Music Generation”, Gwern 2019

GPT-2 Preference Learning for Music Generation

Links

“SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound”, Liu et al 2024

SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound

“Long-Form Music Generation With Latent Diffusion”, Evans et al 2024

Long-form music generation with latent diffusion

“OpenVoice: Versatile Instant Voice Cloning”, Qin et al 2023

OpenVoice: Versatile Instant Voice Cloning

“A Disney Director Tried—And Failed—To Use an AI Hans Zimmer to Create a Soundtrack”, Heikkilä 2023

A Disney director tried—and failed—to use an AI Hans Zimmer to create a soundtrack

“Whisper-AT: Noise-Robust Automatic Speech Recognizers Are Also Strong General Audio Event Taggers”, Gong et al 2023

Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers

“High-Fidelity Audio Compression With Improved RVQGAN”, Kumar et al 2023

High-Fidelity Audio Compression with Improved RVQGAN

“Voice Conversion With Just Nearest Neighbors”, Baas et al 2023

Voice Conversion With Just Nearest Neighbors

“SoundStorm: Efficient Parallel Audio Generation”, Borsos et al 2023

SoundStorm: Efficient Parallel Audio Generation

“ImageBind: One Embedding Space To Bind Them All”, Girdhar et al 2023

ImageBind: One Embedding Space To Bind Them All

“TANGO: Text-To-Audio Generation Using Instruction-Tuned LLM and Latent Diffusion Model”, Ghosal et al 2023

TANGO: Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model

“CLaMP: Contrastive Language-Music Pre-Training for Cross-Modal Symbolic Music Information Retrieval”, Wu et al 2023

CLaMP: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval

“Speak, Read and Prompt (SPEAR-TTS): High-Fidelity Text-To-Speech With Minimal Supervision”, Kharitonov et al 2023

Speak, Read and Prompt (SPEAR-TTS): High-Fidelity Text-to-Speech with Minimal Supervision

“Msanii: High Fidelity Music Synthesis on a Shoestring Budget”, Maina 2023

Msanii: High Fidelity Music Synthesis on a Shoestring Budget

“Archisound: Audio Generation With Diffusion”, Schneider 2023

Archisound: Audio Generation With Diffusion

“Rock Guitar Tablature Generation via Natural Language Processing”, Casco-Rodriguez 2023

Rock Guitar Tablature Generation via Natural Language Processing

“VALL-E: Neural Codec Language Models Are Zero-Shot Text to Speech Synthesizers”, Wang et al 2023

VALL-E: Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

“High Fidelity Neural Audio Compression”, Défossez et al 2022

High Fidelity Neural Audio Compression

“Hierarchical Diffusion Models for Singing Voice Neural Vocoder”, Takahashi et al 2022

Hierarchical Diffusion Models for Singing Voice Neural Vocoder

“RealSinger: Ultra-Realistic Singing Voice Generation via Stochastic Differential Equations”, Anonymous 2022

RealSinger: Ultra-Realistic Singing Voice Generation via Stochastic Differential Equations

“AudioLM: a Language Modeling Approach to Audio Generation”, Borsos et al 2022

AudioLM: a Language Modeling Approach to Audio Generation

“MeloForm: Generating Melody With Musical Form Based on Expert Systems and Neural Networks”, Lu et al 2022

MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks

“AI Composer Bias: Listeners like Music Less When They Think It Was Composed by an AI”, Shank et al 2022

AI composer bias: Listeners like music less when they think it was composed by an AI

“Musika! Fast Infinite Waveform Music Generation”, Pasini & Schlüter 2022

Musika! Fast Infinite Waveform Music Generation

“Multitrack Music Transformer: Learning Long-Term Dependencies in Music With Diverse Instruments”, Dong et al 2022

Multitrack Music Transformer: Learning Long-Term Dependencies in Music with Diverse Instruments

“BigVGAN: A Universal Neural Vocoder With Large-Scale Training”, Lee et al 2022

BigVGAN: A Universal Neural Vocoder with Large-Scale Training

“CLAP: Learning Audio Concepts From Natural Language Supervision”, Elizalde et al 2022

CLAP: Learning Audio Concepts From Natural Language Supervision

“Tradformer: A Transformer Model of Traditional Music Transcriptions”, Casini & Sturm 2022

Tradformer: A Transformer Model of Traditional Music Transcriptions

“SymphonyNet: Symphony Generation With Permutation Invariant Language Model”, Liu et al 2022

SymphonyNet: Symphony Generation with Permutation Invariant Language Model

“It’s Raw! Audio Generation With State-Space Models”, Goel et al 2022

It’s Raw! Audio Generation with State-Space Models

“General-Purpose, Long-Context Autoregressive Modeling With Perceiver AR”, Hawthorne et al 2022

General-purpose, long-context autoregressive modeling with Perceiver AR

“FIGARO: Generating Symbolic Music With Fine-Grained Artistic Control”, Rütte et al 2022

FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control

“Steerable Discovery of Neural Audio Effects”, Steinmetz & Reiss 2021

Steerable discovery of neural audio effects

“Semi-Supervised Music Tagging Transformer”, Won et al 2021

Semi-Supervised Music Tagging Transformer

“AudioCLIP: Extending CLIP to Image, Text and Audio”, Guzhov et al 2021

AudioCLIP: Extending CLIP to Image, Text and Audio

“MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis”, Tae et al 2021

MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis

“PriorGrad: Improving Conditional Denoising Diffusion Models With Data-Dependent Adaptive Prior”, Lee et al 2021

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

“DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism”, Liu et al 2021

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism

“Symbolic Music Generation With Diffusion Models”, Mittal et al 2021

Symbolic Music Generation with Diffusion Models

“Interacting With GPT-2 to Generate Controlled and Believable Musical Sequences in ABC Notation”, Geerlings & Meroño-Peñuela 2020

Interacting with GPT-2 to Generate Controlled and Believable Musical Sequences in ABC Notation

“AI Song Contest: Human-AI Co-Creation in Songwriting”, Huang et al 2020

AI Song Contest: Human-AI Co-Creation in Songwriting

“HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis”, Kong et al 2020

HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

“DeepSinger: Singing Voice Synthesis With Data Mined From the Web”, Ren et al 2020

DeepSinger: Singing Voice Synthesis with Data Mined From the Web

“Learning Music Helps You Read: Using Transfer to Study Linguistic Structure in Language Models”, Papadimitriou & Jurafsky 2020

Learning Music Helps You Read: Using Transfer to Study Linguistic Structure in Language Models

“Pony Voice Event—What People Forced Ponies to Say!”, Daily 2020

Pony Voice Event—What People Forced Ponies to Say!

“15.ai”, Fifteen-kun & Project 2020

15.ai

“Pop Music Transformer: Beat-Based Modeling and Generation of Expressive Pop Piano Compositions”, Huang & Yang 2020

Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions

“Writing the Next American Hit: Using GPT-2 to Explore the Possibility of Creating Successful AI-Generated Song Lyrics Possibility of Creating Successful AI-Generated Song Lyric”, Barrio 2020

Writing the Next American Hit: Using GPT-2 to Explore the Possibility of Creating Successful AI-Generated Song Lyrics Possibility of Creating Successful AI-Generated Song Lyric

“Encoding Musical Style With Transformer Autoencoders”, Choi et al 2019

Encoding Musical Style with Transformer Autoencoders

“GPT-2 Folk Music”, Gwern & Presser 2019

GPT-2 Folk Music

“Parallel WaveGAN: A Fast Waveform Generation Model Based on Generative Adversarial Networks With Multi-Resolution Spectrogram”, Yamamoto et al 2019

Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram

“Low-Dimensional Embodied Semantics for Music and Language”, Raposo et al 2019

Low-dimensional Embodied Semantics for Music and Language

“MuseNet: a Deep Neural Network That Can Generate 4-Minute Musical Compositions With 10 Different Instruments, and Can Combine Styles from Country to Mozart to the Beatles”, Payne 2019

MuseNet: a deep neural network that can generate 4-minute musical compositions with 10 different instruments, and can combine styles from country to Mozart to the Beatles

“Generative Modeling With Sparse Transformers: We’ve Developed the Sparse Transformer, a Deep Neural Network Which Sets New Records at Predicting What Comes next in a Sequence—Whether Text, Images, or Sound. It Uses an Algorithmic Improvement of the attention Mechanism to Extract Patterns from Sequences 30× Longer Than Possible Previously”, Child & Gray 2019

Generative Modeling with Sparse Transformers: We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence—whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30× longer than possible previously

“Music Transformer: Generating Music With Long-Term Structure”, Huang et al 2018

Music Transformer: Generating Music with Long-Term Structure

“FloWaveNet: A Generative Flow for Raw Audio”, Kim et al 2018

FloWaveNet: A Generative Flow for Raw Audio

“Piano Genie”, Donahue et al 2018

Piano Genie

“Music Transformer”, Huang et al 2018

Music Transformer

“This Time With Feeling: Learning Expressive Musical Performance”, Oore et al 2018

This Time with Feeling: Learning Expressive Musical Performance

“The Challenge of Realistic Music Generation: Modelling Raw Audio at Scale”, Dieleman et al 2018

The challenge of realistic music generation: modelling raw audio at scale

“The Sound of Pixels”, Zhao et al 2018

The Sound of Pixels

“Efficient Neural Audio Synthesis”, Kalchbrenner et al 2018

Efficient Neural Audio Synthesis

“Generating Structured Music through Self-Attention”, Huang et al 2018

Generating Structured Music through Self-Attention

“Towards Deep Modeling of Music Semantics Using EEG Regularizers”, Raposo et al 2017

Towards Deep Modeling of Music Semantics using EEG Regularizers

“Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models”, Guimaraes et al 2017

Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models

“Neural Audio Synthesis of Musical Notes With WaveNet Autoencoders”, Engel et al 2017

Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders

“Tuning Recurrent Neural Networks With Reinforcement Learning”, Jaques et al 2017

Tuning Recurrent Neural Networks with Reinforcement Learning

“SampleRNN: An Unconditional End-To-End Neural Audio Generation Model”, Mehri et al 2016

SampleRNN: An Unconditional End-to-End Neural Audio Generation Model

“WaveNet: A Generative Model for Raw Audio”, Oord et al 2016

WaveNet: A Generative Model for Raw Audio

“The Abc Music Standard 2.1: §3.1.1: `X:`—Reference Number”, Walshaw 2011

The abc music standard 2.1: §3.1.1: X:—reference number

“Staring Emmy Straight in the Eye—And Doing My Best Not to Flinch”, Hofstadter & Cope 2001

Staring Emmy Straight in the Eye—And Doing My Best Not to Flinch

“Connectionist Music Composition Based on Melodic, Stylistic, and Psychophysical Constraints [Technical Report CU-CS–495–90]”, Mozer 1990

Connectionist Music Composition Based on Melodic, Stylistic, and Psychophysical Constraints [Technical report CU-CS–495–90]

Sort By Magic

Annotations sorted by machine learning into inferred 'tags'. This provides an alternative way to browse: instead of by date order, one can browse in topic order. The 'sorted' list has been automatically clustered into multiple sections & auto-labeled for easier browsing.

Beginning with the newest annotation, it uses the embedding of each annotation to attempt to create a list of nearest-neighbor annotations, creating a progression of topics. For more details, see the link.