April 2020 News
April 2020 Gwern.net newsletter with links on music generation, data augmentation, terrorism, Matt Lakeman, and 1 documentary review.
April 2020’s Gwern.net newsletter is now out; previous, March 2020 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
Media
Links
Genetics:
Everything Is Heritable:
Recent Evolution:
“The Genomics of Human Local Adaptation”, Rees et al 2020 (review)
AI:
Jukebox, OpenAI
(Dhariwal et al 2020; full sample dataset; Github) Followup to MuseNet showing remarkable synthesis of raw audio with joint music+voice-singing using a hierarchy of Sparse Transformers in a VQ-VAE trained on n = 1.2m with lyrics/artist/genre metadata.

The technology combination of OA’s Jukebox music generating NN.
“Zoom In: An Introduction to Circuits: By studying the connections between neurons, we can find meaningful algorithms in the weights of neural networks”, Olah et al 2020 (reverse-engineering small parts of CNN classifiers)
RL:
“Reinforcement Learning with Augmented Data”, Laskin et al 2020/“Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels”, Kostrikov et al 2020; “CURL: Contrastive Unsupervised Representations for Reinforcement Learning”, Srinivas et al 2020 (all more sample-efficient than Dreamer/MuZero; the semi-supervised revolution comes to RL)
“Dream to Control (Dreamer): Learning Behaviors by Latent Imagination”, Hafner et al 2020 (blog; PlaNet followup; no real comparison with MuZero or Agent57 available & already outperformed by model-free methods?)
“Suphx: Mastering Mahjong with Deep Reinforcement Learning”, Li et al 2020
Matters Of Scale:
“2019 trends in GPU price per FLOPS”, AI Impacts 2020
“Blender: Recipes for building an open-domain chatbot”, Roller et al 2020 (blog; “The larger model achieves a better performance in fewer steps, consistent with other works…”)
Statistics/Meta-Science:
“Impact of Valid Selection Procedures on Work-Force Productivity”, Schmidt et al 197947ya (how to directly convert context-less statistical prediction metrics like R2 into decisions/payoffs)
“The Stewart Retractions: A Quantitative and Qualitative Analysis”, Pickett 2020 (forensic statistics)
“F—k Nuance”, Healy 2017
Politics/religion:
“Smart, Qualified People Behind The Scenes Keeping America Safe: ‘We Don’t Exist’”
“The Story Of Thanksgiving Is A Science-Fiction Story”, Scott Alexander
“Let There Be Light!”, David Feuer 200125ya (attempted psychiatry among the Hasidim of Brooklyn)
“When Pixels Collide” (the Reddit /r/place April Fools was “The Ultimate Showdown of Ultimate Destiny”)
Psychology/biology:
“Why do human beings keep getting diseases from bats?”, Trevor Klee (why so many bat-borne viruses? Perhaps adaptation to flight forcing a reduced adaptive immune system—pace Hedrick 2004 on the dubious benefits of an adaptive immune system)
“Showing that you care: The evolution of health altruism”, Hanson 200818ya (it is more important to seem good than to do good)
“Different Worlds”, Scott Alexander (“nothing makes sense except in light of inter-individual variation”)
Schizoid personality disorder (note that Henry Darger is more like schizotypal personality disorder than schizoid)
“Are humans constantly but subconsciously smelling themselves?”, Perl et al 2020
“How mammals stay healthy in nature: the evolution of behaviors to avoid parasites and pathogens”, Hart & Hart 2018 (why do cats/dogs eat grass? Possibly parasite resistance: Huffman et al 1996/Huffman & Caton 2001; Sueda et al 2008/Hart 2008; Hart et al 2019)
Technology:
“Cleaning up after WWII” (a photo anthology)
“A New Breed of Drug Dealer Has Turned Buying Drugs into a Treasure Hunt: Most Russian drug dealers don’t hand off drugs anymore—they stash them in geotagged hiding spots ready for pickup by online buyers” (update on Hydra/RAMP DNMs)
“Safecracker Meets Safecracker”, Richard Feynman 198541ya (Surely You’re Joking, Mr. Feynman!)
Economics:
Philosophy:
“Constructing a Logic of Plausible Inference: A Guide to Cox’s Theorem”, van Horn 200323ya (WP)
“Anthropic Shadow: Observation Selection Effects and Human Extinction Risks”, Ćirković et al 2010
Fiction:
“Galileo’s discovery of scaling laws”, Peterson 200224ya (physics & Dante fanfics; commentary; see also Haldane’s “On Being the Right Size”)
Misc:
Review of Atlas of Oblique Maps: A Collection of Landform Portrayals of Selected Areas of the World (warning: 282MB PDF; collection of gorgeous hand-drawn oblique projection created for the US Geological Survey)
“Everything on ‘Naked and Afraid’ Is Real—and I Lived It: When the Discovery Channel invited me to audition for its popular survival-challenge reality show, I knew it was going to be rough. What followed was one of the most intense experiences of my life.”, Blair Braverman (Naked and Afraid)
“The Eponymous Mr. Ponzi” (profile of Charles Ponzi)
Best Of Matt Lakeman:
“Hillbilly Elegy—The Culture of White American Poverty”; “The New Epidemic—My Experience of Losing a Friend to Heroin”
“An Attempt at Explaining, Blaming, and Being Very Slightly Sympathetic Toward Enron” (cf. Timing on thin lines)
“Disaster Artist—Insanity is No Shortcut to Inspiration” (Sestero’s book on Tommy Wiseau’s The Room)
“The Phantom’s Pain—A Metal Gear Solid V Narrative Analysis” (how can MGS:V be ‘the tragedy of Big Boss’ when you turn out to be playing his body double?)
Film/TV
Music
“Friday Night Phantasy” (Swing Holic Band; SWING HOLIC VOL.2 {M3-22}) [jazz]
“Deeper and Deeper” (Swing Holic Band; SWING HOLIC VOL.2 {M3-22}) [jazz]
“Starlight Spark” (鈴丸; STARLIGHT SPARK {C90}) [jazz]
“When I Wake Up” (TUNO桐音 feat. Luo Tianyi & Yuezheng Ling; Travel For Lights (Last Version) {2017}) [pop]
“要有光” (TUNO桐音 feat. Luo Tianyi & Yuezheng Ling; Travel For Lights (Last Version) {2017}) [trance]
“Back To You” (TUNO桐音; Travel For Lights (Last Version) {2017}) [trance]
“True Lie” (にせもの feat. Namine Ritsu; postgazer {VM35}) [shoegaze]
“Shoegazer” (ぴぼ feat. Nizimine Kakoi; postgazer {VM35}) [shoegaze]
MLP:
“Second Hoof Medley” (Exiark; Echoes {2019}) [electronic]
“Zenith” (Frozen Night feat. Velvet R. Wings; Echoes {2019}) [orchestral]
“Who Knows” (4EverfreeBrony feat. Milkymomo, EileMonty & MEMJ0123; Echoes {2019}) [acoustic]
“Smile Song Chiptune” (VoltPon3; Chiptune Pony {201313ya}) [chiptune]
“Love Is In Bloom Chiptune” (VoltPon3; Chiptune Pony {201313ya}) [chiptune]
“Winter Wrap Up Remix” (VoltPon3; Chiptune Pony {201313ya}) [chiptune]
“Art of the Dress Chiptune” (VoltPon3; Chiptune Pony {201313ya}) [chiptune]
Misc:
“Somebody That I Used to Know (80s Remix)” (Gotye feat. kimbra {2017}) [pop]
“Never Be Alone” (TheFatRat {201511ya}) [trance]