N/A
2017-03-31–2021-01-04
finished
certainty: log
importance: 0
This is the April 2017 edition of the Gwern.net newsletter; previous, March 2017 (archives). This is a summary of the revision-history RSS feed, overlapping with my Changelog & /
Writings
Media
Links
Recent evolution:
“Soft sweeps are the dominant mode of adaptation in the human genome”, Schrider & Kern 2017 (Detection of 2000 instances of recent human selection, half of which are specific to individual human populations, and many of which affect the central nervous system. Note this doesn’t cover polygenic selection, so it’s a very loose lower bound on how much recent human evolution there has been.)
“Comparative Genomic Evidence For Self-Domestication In Homo sapiens”, Theofanopoulou et al 2017 (gene-culture co-evolution in selection for cognitive traits involved in domestication?)
“Adaptation to infectious disease exposure in indigenous Southern African populations”, Owers et al 2017 (recent human evolution leading to between-group differences)
“Investigating the case of human nose shape and climate adaptation”, Zaidi et al 2017 (Recent human evolution leading to between-group differences: local adaptations of noses to local climates.)
“Ancient genomic changes associated with domestication of the horse”, Librado et al 2017 (media; more recent evolution in complex behavioral traits in mammals: the neural crest shows up, again)
Everything Is Heritable:
- “Polygenic prediction of the phenome, across ancestry, in emerging adulthood”, Docherty et al 2017
- “Syphilis in Renaissance Europe: rapid evolution of an introduced sexually transmitted disease?”, Knell 2003 (still an open question, apparently)
- “Welcome to Pleistocene Park: In Arctic Siberia, Russian scientists are trying to stave off catastrophic climate change—by resurrecting an Ice Age biome complete with lab-grown woolly mammoths”
- “Intersection of diverse neuronal genomes and neuropsychiatric disease: The Brain Somatic Mosaicism Network”, McConnell et al 2017 (Towards explaining non-shared-environment effects on intelligence, psychiatric disorders, and other cognitive traits—developmental noise such as post-conception mutations in individual cells or groups of cells)
- “Tuberculosis-resistant cows developed for the first time using CRISPR technology”
- “How Humans Are Shaping Our Own Evolution”
AI:
“Recurrent Environment Simulators”, Chiappa et al 2017 (towards deep model-based planning; related discussion)
“Using Human Brain Activity to Guide Machine Learning”, Fong et al 2017
If I’m understanding this right, it can be seen as related to Hinton’s ‘dark knowledge’ and knowledge distillation in NNs: you use a teacher NN to provide additional supervision on the image classification problem by indicating hard & easy examples and also what is the ‘right’ probability to assign to all the wrong classifications in order to refine the loss function. In this case, the SVM is guided by the human brain fMRI activations which indicate which instances are hard/
easy and so which ones it should concentrate on (an error on a hard instance should lead to smaller adjustments than an error on an easy one). This sort of supervision could be quite interesting if you think about its use for AI risk problems—moral dilemmas, for example. “In-Datacenter Performance Analysis of A Tensor Processing Unit [TPU]”, Jouppi et al 2017 (the nitty-gritty on what Google’s TPUs can and cannot do)
“Communication-Efficient Learning of Deep Networks from Decentralized Data”, McMahan et al 2017 (distributed NN backpropagation turns out to be not just possible but easy, obviating the need for companies like Google to harvest all your data onto their servers)
“Visual Attribute Transfer through Deep Image Analogy”, Liao et al 2017 (supplemental examples of style transfer/
image analogies )“Artist Agent: A Reinforcement Learning Approach to Automatic Stroke Generation in Oriental Ink Painting”, Xie et al 2012 (RL is good for art experiments like this because many artistic criteria tend to be ‘global’ and non-differentiable or local—RMSE on pixels is not a good criterion.)
“Understanding Synthetic Gradients and Decoupled Neural Interfaces”, Czarnecki et al 2017
“Machine Learning Predicts Laboratory Earthquakes”, Rouet-Leduc et al 2017 (media; since debunked as data leakage?)
Sorting 2 Metric Tons of Lego with CNNs (HN); details on the software implementation
Statistics/
- “How readers understand causal and correlational expressions used in news headlines”, Adams et al 2017 (people do not understand the difference between correlation and causation)
Politics/
- Robert Caro on political power and Lyndon Johnson
- “Historical Dynamics & contingent conditions of religion”
- 66 failed social interventions
- “‘London Bridge is down’: the secret plan for the days after the Queen’s death”
Psychology/
- “Sex Differences In The Adult Human Brain: Evidence From 5,216 UK Biobank Participants”, Ritchie et al 2017
- “Effect of Alternate-Day Fasting on Weight Loss, Weight Maintenance, and Cardioprotection Among Metabolically Healthy Obese Adults: A Randomized Clinical Trial”, Trepanowski et al 2017 (worse compliance for intermittent fasting than caloric restriction)
- “A randomized controlled trial to establish effects of short-term rapamycin treatment in 24 middle-aged companion dogs”, Urfer et al 2017
- “On Being One’s Own Rabbit: The Story of a Skirmish in the War on Disease [Tetany]”, J.B.S. Haldane 1927, Possible Worlds And Other Essays
- “In Support of Yak Shaving”
- “Shorn Scalps and Perceptions of Male Dominance”, Mannes 2012
Technology:
- PowerPoint is Turing-complete (video)
- “A Mind Is Born” (256-byte C64 demo)
Economics:
Books
Nonfiction:
- Moon Dust: In Search of the Men Who Fell to Earth, Smith 2005 (review)
Fiction:
- The Adventures of Dr. McNinja (the long-running series comes to an end; having read it since ~2008, it’s surprising to reread the whole series and realize that in between all the humorous action drama like banditos riding raptors or surfing a robotic Dracula back from the Moon, was lurking a fairly complex & well-thought-out time-travel SF story with very long callbacks and a bittersweet ending, with writing that improves as much as the art does over its 2006–2017 run. In some respects, it’s a little dated—looking back, I recognize it as something of an artifact of the ’00s Western Internet culture in being part of a ninja fad along with Real Ultimate Power, Ninja Burger, Megatokyo etc—but I’m still impressed at how Hastings makes it all come together, suggesting either he planned it out much further back than I ever expected or is a master of retcons. It is not the greatest time-travel story ever, or greatest martial arts story, but I will always enjoy reading action with a brain. It is no surprise to me that I would enjoy Hasting’s later Unbelievable Gwenpool.)
Film/TV
Animated:
Live-action:
Music
Touhou:
- “Bullet Raid” (玖原 イヅナ; PHANTASY STAR SYMPHONY {C91}) [orchestral]
- “KICKING TRICK (24BL EDM Remix)” (24BL feat. 3L; Descending from the Skies She Appears as a Goddess {C91}) [Jpop]
- “A Love Canon (FS Remix)” (Babbe feat. Renko; memories II {C91}) [Jpop]
Doujin:
- “たまゆらのかぜ” (ハム; よなごみさん家のおうちカフェ {C91}) [folk]
- “Life is Journey” (Junk; AD:PIANO IV Monochrome {C91}) [instrumental]
- “Smooth Call” (古川''good-cool''竜也; AD:PIANO IV Monochrome {C91}) [jazz]
- “Acheron” (qurter; AD:PIANO IV Monochrome {C91}) [trance]
- “Closer” (Avans; AD:PIANO IV Monochrome {C91}) [electronic]
- “Proud” (黒魔; AD:PIANO IV Monochrome {C91}) [instrumental]
- “Higher (Original Mix)” (ITM; KOEBUTIC MUSIC FES. {C91}) [electronic]
- “drAg.” (Na/
sh; KOEBUTIC MUSIC FES. {C91}) [electronic] - “Pear flowers ~梨衣しょんの花~” (アクリロ; KOEBUTIC MUSIC FES. {C91}) [instrumental]
- “Calm forest” (だ; KOEBUTIC MUSIC FES. {C91}) [instrumental]
- “七色の日常” (マンダリン; KOEBUTIC MUSIC FES. {C91}) [classical]
Link Bibliography
Bibliography of page links in reading order (with annotations when available):
“March 2017 News”, (2017-02-23):
N/A
“Gwern.net newsletter archives”, (2013-12-01):
Newsletter tag: archive of all issues back to 2013 for the gwern.net newsletter (monthly updates, which will include summaries of projects I’ve worked on that month (the same as the changelog), collations of links or discussions from my subreddit, and book/movie reviews.)
“Changelog”, (2013-09-15):
This page is a changelog for Gwern.net: a monthly reverse chronological list of recent major writings/
changes/ additions. Following my writing can be a little difficult because it is often so incremental. So every month, in addition to my regular /
r/ subreddit submissions, I write up reasonably-interesting changes and send it out to the mailing list in addition to a compilation of links & reviews (archives).Gwern “/r/gwern subreddit”, (2018-10-01):
A subreddit for posting links of interest and also for announcing updates to gwern.net (which can be used as a RSS feed). Submissions are categorized similar to the monthly newsletter and typically will be collated there.
“Tea/Water Experiment: Blinded Randomized Racing-Arms Experiment of Mineral Water Taste”, (2017-04-04):
The kind of water used in tea is claimed to make a difference in the flavor: mineral water being better than tap water or distilled water. However, mineral water is vastly more expensive than tap water. To test the claim, I run a preliminary test of pure water to see if any water differences are detectable at all. Compared my tap water, 3 distilled water brands (Great Value, Nestle Pure Life, & Poland Spring), 1 osmosis-purified brand (Aquafina), and 3 non-carbonated mineral water brands (Evian, Voss, & Fiji) in a series of n = 67 blinded randomized comparisons of water flavor. The comparisons are modeled using a Bradley-Terry competitive model implemented in Stan; comparisons were chosen using an adaptive Bayesian best-arm sequential trial (racing) method designed to locate the best-tasting water in the minimum number of samples by preferentially comparing the best-known arm to potentially superior arms. Blinding & randomization are achieved by using a Lazy Susan to physically randomize two identical (but marked in a hidden spot) cups of water. The final posterior distribution indicates that some differences between waters are likely to exist but are small & imprecisely estimated and of little practical concern.
“Soft sweeps are the dominant mode of adaptation in the human genome”, (2017-04-27):
The degree to which adaptation in recent human evolution shapes genetic variation remains controversial. This is in part due to the limited evidence in humans for classic “hard selective sweeps,” wherein a novel beneficial mutation rapidly sweeps through a population to fixation. However, positive selection may often proceed via “soft sweeps” acting on mutations already present within a population. Here we examine recent positive selection across six human populations using a powerful machine learning approach that is sensitive to both hard and soft sweeps. We found evidence that soft sweeps are widespread and account for the vast majority of recent human adaptation. Surprisingly, our results also suggest that linked positive selection affects patterns of variation across much of the genome, and may increase the frequencies of deleterious mutations. Our results also reveal insights into the role of sexual selection, cancer risk, and central nervous system development in recent human evolution.
“Comparative genomic evidence for self-domestication in Homo sapiens”, (2017-04-09):
This study identifies and analyzes statistically significant overlaps between selective sweep screens in anatomically modern humans and several domesticated species. The results obtained suggest that (paleo-) genomic data can be exploited to complement the fossil record and support the idea of self-domestication in Homo sapiens, a process that likely intensified as our species populated its niche. Our analysis lends support to attempts to capture the “domestication syndrome” in terms of alterations to certain signaling pathways and cell lineages, such as the neural crest.
http:/
/ journals.plos.org/ plosgenetics/ article?id=10.1371/ journal.pgen.1006616 https:/
/ www.nytimes.com/ 2017/ 04/ 27/ science/ horses-genetics-domestication-scythians.html “Syphilis in renaissance Europe: rapid evolution of an introduced sexually transmitted disease?”, (2004):
When syphilis first appeared in Europe in 1495, it was an acute and extremely unpleasant disease. After only a few years it was less severe than it once was, and it changed over the next 50 years into a milder, chronic disease. The severe early symptoms may have been the result of the disease being introduced into a new host population without any resistance mechanisms, but the change in virulence is most likely to have happened because of selection favouring milder strains of the pathogen. The symptoms of the virulent early disease were both debilitating and obvious to potential sexual partners of the infected, and strains that caused less obvious or painful symptoms would have enjoyed a higher transmission rate.
https:/
/ www.theatlantic.com/ magazine/ archive/ 2017/ 04/ pleistocene-park/ 517779/ “Recurrent Environment Simulators”, (2017-04-07):
Models that can simulate how environments change in response to actions can be used by agents to plan and act efficiently. We improve on previous environment simulators from high-dimensional pixel observations by introducing recurrent neural networks that are able to make temporally and spatially coherent predictions for hundreds of time-steps into the future. We present an in-depth analysis of the factors affecting performance, providing the most extensive attempt to advance the understanding of the properties of these models. We address the issue of computationally inefficiency with a model that does not need to generate a high-dimensional image at each time-step. We show that our approach can be used to improve exploration and is adaptable to many diverse environments, namely 10 Atari games, a 3D car racing environment, and complex 3D mazes.
“Using Human Brain Activity to Guide Machine Learning”, (2017-03-16):
Machine learning is a field of computer science that builds algorithms that learn. In many cases, machine learning algorithms are used to recreate a human ability like adding a caption to a photo, driving a car, or playing a game. While the human brain has long served as a source of inspiration for machine learning, little effort has been made to directly use data collected from working brains as a guide for machine learning algorithms. Here we demonstrate a new paradigm of "neurally-weighted" machine learning, which takes fMRI measurements of human brain activity from subjects viewing images, and infuses these data into the training process of an object recognition learning algorithm to make it more consistent with the human brain. After training, these neurally-weighted classifiers are able to classify images without requiring any additional neural data. We show that our neural-weighting approach can lead to large performance gains when used with traditional machine vision features, as well as to significant improvements with already high-performing convolutional neural network features. The effectiveness of this approach points to a path forward for a new class of hybrid machine learning algorithms which take both inspiration and direct constraints from neuronal data.
“Communication-Efficient Learning of Deep Networks from Decentralized Data”, (2016-02-17):
Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image models can automatically select good photos. However, this rich data is often privacy sensitive, large in quantity, or both, which may preclude logging to the data center and training there using conventional approaches. We advocate an alternative that leaves the training data distributed on the mobile devices, and learns a shared model by aggregating locally-computed updates. We term this decentralized approach Federated Learning.
We present a practical method for the federated learning of deep networks based on iterative model averaging, and conduct an extensive empirical evaluation, considering five different model architectures and four datasets. These experiments demonstrate the approach is robust to the unbalanced and non-IID data distributions that are a defining characteristic of this setting. Communication costs are the principal constraint, and we show a reduction in required communication rounds by 10-100× as compared to synchronized stochastic gradient descent.
“Visual Attribute Transfer through Deep Image Analogy”, (2017-05-02):
We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as color, tone, texture, and style) from one image to another. For example, one image could be that of a painting or a sketch while the other is a photo of a real scene, and both depict the same type of scene.
Our technique finds semantically-meaningful dense correspondences between two input images. To accomplish this, it adapts the notion of "image analogy" with features extracted from a Deep Convolutional Neutral Network for matching; we call our technique Deep Image Analogy. A coarse-to-fine strategy is used to compute the nearest-neighbor field for generating the results. We validate the effectiveness of our proposed method in a variety of cases, including style/texture transfer, color/style swap, sketch/painting to photo, and time lapse.
https:/
/ liaojing.github.io/ html/ data/ analogy_supplemental.pdf “Artist Agent: A Reinforcement Learning Approach to Automatic Stroke Generation in Oriental Ink Painting”, (2012-06-18):
Oriental ink painting, called Sumi-e, is one of the most appealing painting styles that has attracted artists around the world. Major challenges in computer-based Sumi-e simulation are to abstract complex scene information and draw smooth and natural brush strokes. To automatically find such strokes, we propose to model the brush as a reinforcement learning agent, and learn desired brush-trajectories by maximizing the sum of rewards in the policy search framework. We also provide elaborate design of actions, states, and rewards tailored for a Sumi-e agent. The effectiveness of our proposed approach is demonstrated through simulated Sumi-e experiments.
“Understanding Synthetic Gradients and Decoupled Neural Interfaces”, (2017-03-01):
When training neural networks, the use of Synthetic Gradients (SG) allows layers or modules to be trained without update locking—without waiting for a true error gradient to be backpropagated—resulting in Decoupled Neural Interfaces (DNIs). This unlocked ability of being able to update parts of a neural network asynchronously and with only local information was demonstrated to work empirically in Jaderberg et al (2016). However, there has been very little demonstration of what changes DNIs and SGs impose from a functional, representational, and learning dynamics point of view. In this paper, we study DNIs through the use of synthetic gradients on feed-forward networks to better understand their behaviour and elucidate their effect on optimisation. We show that the incorporation of SGs does not affect the representational strength of the learning system for a neural network, and prove the convergence of the learning system for linear and deep linear models. On practical problems we investigate the mechanism by which synthetic gradient estimators approximate the true loss, and, surprisingly, how that leads to drastically different layer-wise representations. Finally, we also expose the relationship of using synthetic gradients to other error approximation techniques and find a unifying language for discussion and comparison.
“Machine Learning Predicts Laboratory Earthquakes”, (2017-02-19):
Forecasting fault failure is a fundamental but elusive goal in earthquake science. Here we show that by listening to the acoustic signal emitted by a laboratory fault, machine learning can predict the time remaining before it fails with great accuracy. These predictions are based solely on the instantaneous physical characteristics of the acoustical signal, and do not make use of its history. Surprisingly, machine learning identifies a signal emitted from the fault zone previously thought to be low-amplitude noise that enables failure forecasting throughout the laboratory quake cycle. We hypothesize that applying this approach to continuous seismic data may lead to significant advances in identifying currently unknown signals, in providing new insights into fault physics, and in placing bounds on fault failure times.
http:/
/ 80000hours.org/ blog/ 66-social-interventions-gone-wrong https:/
/ www.theguardian.com/ uk-news/ 2017/ mar/ 16/ what-happens-when-queen-elizabeth-dies-london-bridge “Sex differences in the adult human brain: Evidence from 5,216 UK Biobank participants”, (2017-04-04):
Sex differences in human brain structure and function are of substantial scientific interest because of sex-differential susceptibility to psychiatric disorders [1,2,3] and because of the potential to explain sex differences in psychological traits [4]. Males are known to have larger brain volumes, though the patterns of differences across brain subregions have typically only been examined in small, inconsistent studies [5]. In addition, despite common findings of greater male variability in traits like intelligence [6], personality [7], and physical performance [8], variance differences in the brain have received little attention. Here we report the largest single-sample study of structural and functional sex differences in the human brain to date (2,750 female and 2,466 male participants aged 44-77 years). Males had higher cortical and sub-cortical volumes, cortical surface areas, and white matter diffusion directionality; females had thicker cortices and higher white matter tract complexity. Considerable overlap between the distributions for males and females was common, and subregional differences were smaller after accounting for global differences. There was generally greater male variance across structural measures. The modestly higher male score on two cognitive tests was partly mediated via structural differences. Functional connectome organization showed stronger connectivity for males in unimodal sensorimotor cortices, and stronger connectivity for females in the default mode network. This large-scale characterisation of neurobiological sex differences provides a foundation for attempts to understand the causes of sex differences in brain structure and function, and their associated psychological and psychiatric consequences.
http:/
/ lesswrong.com/ r/ discussion/ lw/ oql/ in_support_of_yak_shaving/ https:/
/ www.andrew.cmu.edu/ user/ twildenh/ PowerPointTM/ Paper.pdf https:/
/ www.theatlantic.com/ technology/ archive/ 2017/ 04/ the-tragedy-of-google-books/ 523320/ https:/
/ www.amazon.com/ Moondust-Search-Men-Fell-Earth/ dp/ 0007155425 “Real Ultimate Power”, (2020-12-22):
The Official Ninja Webpage: Real Ultimate Power is a satire website. It was launched in 2002 by the pseudonymous Robert Hamburger. Written using the persona of a 13-year-old boy, the site is a parody of adolescent fascination with Ninjas. Warren St. John, columnist for The New York Times described it as "a satirical ode to the masculine prowess of ninjas".
“Ninja Burger”, (2020-12-28):
Ninja Burger (忍者バーガー) is a parody website started in late 1999, purporting that a sect of noble ninja have taken to secretly delivering fast food meals, anywhere, anytime, within 30 minutes or less. Failure to deliver within the ascribed time limit results in seppuku. Some of Ninja Burger's rivals include Pirate Pizza, Otaku Bell, and Samurai Burger. The site riffs on many of the same points as Real Ultimate Power, another ninja parody website.
“Megatokyo”, (2020-12-28):
Megatokyo (メガトーキョー) is an English-language webcomic created by Fred Gallagher and Rodney Caston. Megatokyo debuted on August 14, 2000, and has been written and illustrated solely by Gallagher since July 17, 2002. Gallagher's style of writing and illustration is heavily influenced by Japanese manga. Megatokyo is freely available on its official website. The stated schedule for updates is Tuesday and Friday, but they typically are posted just once or twice a month on non-specific days. Recently, this schedule has slipped further, due to the health issues of Sarah Gallagher (Seraphim), Fred's wife. Megatokyo was also published in book-format by CMX, although the first three volumes were published by Dark Horse. For February 2005, sales of the comic's third printed volume were ranked third on BookScan's list of graphic novels sold in bookstores, then the best showing for an original English-language manga.
“Unbelievable Gwenpool”, (2020-12-28):
The Unbelievable Gwenpool, more commonly called Unbelievable Gwenpool, is a comic book series published by Marvel Comics, featuring Gwenpool as its main protagonist. The series was a spin-off from the character's feature in a Howard the Duck comic, and was Gwenpool's first solo series. The series lasted 26 issues, #1-25 and a special #0 that collected her intro material. The series ran from June 2016 to April 2018.
“The Tale of the Princess Kaguya”, (2020-12-28):
The Tale of the Princess Kaguya is a 2013 Japanese animated fantasy drama film co-written and directed by Isao Takahata, based on The Tale of the Bamboo Cutter, a 10th-century Japanese literary tale. It was produced by Studio Ghibli for Nippon Television Network, Dentsu, Hakuhodo DYMP, Walt Disney Japan, Mitsubishi, Toho and KDDI, and distributed by Toho.
https:/
/ www.dropbox.com/ s/ okqgmpdc7x6okyq/ itm-koebuticmusicfes-higheroriginalmix.ogg?dl=0 https:/
/ www.dropbox.com/ s/ 3qmnbyrvewum7qu/ nash-koebuticmusicfes-drag.ogg?dl=0 https:/
/ www.dropbox.com/ s/ 4zwnjfd8pu1mb4a/ %E3%81%A0-koebuticmusicfes-calmforest.ogg?dl=0 “Gwern.net newsletter (Substack subscription page)”, (2013-12-01):
Subscription page for the monthly gwern.net newsletter. There are monthly updates, which will include summaries of projects I’ve worked on that month (the same as the changelog), collations of links or discussions from my subreddit, and book/movie reviews. You can also browse the archives since December 2013.