Overview

Continuing the 2015 trends, 2016 was a banner year for AI & genetics.

In AI, demonstrating the potential for rapid advance, AlphaGo went from low professional level as of October 2015 to world champion level, crushing Lee Sedol 4-1 with substantial margin, and just when everyone had forgotten, then a refined (presumably pure self-play) version of AlphaGo went 60-0 in blitz matches online with many of the top Go players (including Ke Jie). The translation RNNs finally made their long-awaited appearance in commercial production with Google Translate, making for the largest jump in translation quality in decades, bringing many translation pairs up to surprisingly high quality (even Japanese⟺English translations are now semi-comprehensible, as opposed to the status quo total gibberish); combined with the rapid progress in voice transcription and the surprising results of human-level lipreading, one can now imagine a NN-powered Babelfish (which, combined with HUDs, could be revolutionary for the deaf & hearing-impaired). Generative adversarial networks (GANs) remained a central topic of AI research, with better theoretical understanding (linking them to reinforcement learning), and many tweaks and incremental refinements increasing the size of feasible generated images (eg StackGAN’s large bird/flower image generation capability); however, GANs currently have not delivered any meaningful increases on any applied tasks & remain a solution in search of a problem, so that is something to hope for in 2017—demonstration that the unsupervised or generative aspects of GANs can be usefully employed for planning or something. Perhaps the most exciting work in 2016 was the long-term work on architecture in providing large-scale memory mechanisms (in the form of efficient external memory or encoded into the weights of large expanding or sharded NNs), in learning to train large-scale NNs (“synthetic gradients”), and in a particularly surprising set of papers, demonstrating that NNs+reinforcement-learning can efficiently learn how to design NN architectures & units. (This was not something anyone doubted could be done, but previous RL work suggested that it was years away & no one could manage it without whole GPU farms; but as far as Google was concerned… “You see, I told you it couldn’t be done without turning the whole country into a factory. You have done just that.”) Since NNs do not decay like biological neurons, and are not hard-limited by skull volumes or calories, and since all tasks share mutual information & form informative priors for each other critical to sample-efficient learning, there is a lot of inherent pressure towards large growing multi-task NNs which do transfer learning & can optimize at multiple levels end-to-end; as GPU RAM limits lift, we’ll see more of these. Aside from the important work in “NNs all the way down” vein, reinforcement learning grew in importance and it is increasingly common to use RL methods to control memory or network components, interact with an environment (often broadly interpreted, as anything which can be turned into a tree, which goes far beyond games like Go or chess & includes theorem proving or program optimization), or learn to optimize a non-differentiable reward/loss function, and I am excited to see planning re-emerge as a theme after the dominance of model-free methods over the past 3 years; we will see more of that in 2017, doubtless, especially as some of the architectural tweaks from 2016 (some of which claim as much as an order of magnitude improvement on ALE sample-efficiency) get tried out & reused.

In genetics, the growth of UK Biobank and the introduction of LD score regression & other summary-statistic-only methods continued driving large-scale results; the study of human genetic correlations made an absurd amount of progress in 2016, demonstrating shared genetic influences on countless phenotypic traits and pervasive intercorrelations of good traits and disease traits, respectively. Detecting recent human evolution has been difficult due to lack of ancient DNA to compare with, but the supply of that has grown steadily, permitting some specific examples to be nailed down, and a new method based on contemporary whole genomes may blow the area wide open as whole genomes have recently crossed the $1,000 mark and in coming years, scientific projects & medical biobanks will shift over to whole genomes. Another possible field explosion is “genome synthesis”—I was astonished to learn that it is now feasible to synthesize from scratch entire chromosomes of arbitrary design, and that a human genome could potentially be synthesized for ~$1,000,000,000, which would render totally obsolete any considerations of embryo selection/CRISPR/iterated embryo selection, with an active advocacy effort for a genome synthesis project to be launched. 2017 will bring further discoveries of how humans have adapted to local environments and their societies over the past centuries & millennia. Honorable mentions should also go to the steady (and disquieting) progress towards iterated embryo selection, and a scattering of results from the continuously-growing-sample-sizes GWASes: as predicted, the education/intelligence hits have increased drastically as sample size increased, and the historically difficult targets of personality & depression have finally yielded some more hits. One particularly intriguing GWAS focused on violence & criminal behavior with good results, so that trait will yield as well to further study. Past GWASes continued to be applied; the results of Belsky et al 2016 will come as no surprise, but will frustrate the critics who insist that all non-disease results are methodological artifacts or merely reflect population structure. CRISPR progress continues as expected, with the first uses in humans in 2016 by Chinese & American scientists.

Less cosmically, one of the big tech stories of 2016 was the rollout of consumer VR—successful but not epochal, clearly the (or at least, a) future of gaming but no killer app. Oculus had a rocky launch caused by its decision to launch prematurely, without motion controls, which the launch of HTC/Valve’s Vive made clear is not an optional feature for truly compelling VR (and my own brief experience with an Oculus Rift at a Best Buy demo left me longing, after just 20 seconds in The Climb, for hand tracking), but the lack of motion controls & compelling content made for a slow launch. The Vive had a better launch with excellent motion controls & tracking, the comparable Oculus Touch controls only really shipping half a year later in December, demonstrating why Oculus launched when it did—it was either bite the bullet of a bad launch, or let Vive rule unopposed. Somewhat to my surprise, Sony’s quiet Project Morpheus launched successfully as PlayStation VR, making for 3 high-quality competing VR headsets/ecosystems. (Sony had not seemed serious about the whole VR thing so I doubted it would launch in 2016 or at all.) While most gamers, much less people, do not feel a burning need for getting into VR at the moment (myself included, as I think the screen resolutions need improvement), what is notable is what didn’t happen: we did not see widespread reports of vomiting, of people swearing off VR forever, of VR being discarded as a 3D-TV-like gimmick, of developers flooding in & getting burned, of sales plummeting and being well below the million-mark, of the initial trickle of games sputtering out… In short, of any of the things that the naysayers predicted would doom consumer VR. The worst that the early adopters, critics, and regular people have to say is that there are not enough good games (decreasingly true by the end of 2016), that the headsets and GPUs cost too much (true but will predictably be fixed as time passes), that the Oculus Rift lacked motion controls (fixed as of December 2016), and the resolution is too low / devices are wired / require external tracking (likely improved substantially in the second generation, possibly fixed entirely by the third or fourth)—nothing fatal or important, in other words. So it looks like VR is here to stay! It’s nice that at least one part of my childhood’s future has finally happened.

Links

Genetics:

• Everything is heritable:

  1. “Top 10 Replicated Findings From Behavioral Genetics”, Plomin et al 2016
  2. “The Genetics of Success: How Single-Nucleotide Polymorphisms Associated With Educational Attainment Relate to Life-Course Development”, Belsky et al 2016; “Genome-wide association study of cognitive functions and educational attainment in UK Biobank (n=112151)”, Davies et al 2016; “Genome-wide association study identifies 74 [162] loci associated with educational attainment”, Okbay et al 2016b; “Predicting educational achievement from DNA”, Selzam et al 2016 (supplement; polygenic scores now predict 3.5% of intelligence, 7% of family SES, and 9% of education)
  3. “Molecular genetic contributions to social deprivation and household income in UK Biobank (n=112,151)”, Hill et al 2016 (correlation graph); “Genetic link between family socioeconomic status and children’s educational achievement estimated from genome-wide SNPs”, Krapohl & Plomin 2016
  4. “Genome-wide association study of antisocial personality disorder”, Rautiainen et al 2016 (GWAS hits on crime)
  5. “Genetic risk for autism spectrum disorders and neuropsychiatric variation in the general population”, Robinson et al 2016
  6. “Schizophrenia and subsequent neighborhood deprivation: revisiting the social drift hypothesis using population, twin and molecular genetic data”, Sariaslan et al 2016 (good use of polygenic scores for confirmation)
  7. “Ultra-rare disruptive and damaging mutations influence educational attainment in the general population”, Ganna et al 2016; “Cognitive Performance Among Carriers of Pathogenic Copy Number Variants: Analysis of 152,000 UK Biobank Subjects”, Kendall et al 2016
  8. “Older fathers’ children have lower evolutionary fitness across four centuries and in four populations”, Arslan et al 2016

• Recent human evolution:

  1. “Detection of human adaptation during the past 2,000 years”, Field et al 2016
  2. “Population structure of UK Biobank and ancient Eurasians reveals adaptation at genes influencing blood pressure”, Galinsky et al 2016
  3. “Going global by adapting local: A review of recent human adaptation”, Fan et al 2016
  4. “Genetic evidence for natural selection in humans in the contemporary United States”, Beauchamp 2016

• CRISPR:

  1. “Improved CRISPR-Cas9: Safe and Effective?”: “High-fidelity CRISPR-Cas9 nucleases with no detectable genome-wide off-target effects”/“Rationally engineered Cas9 nucleases with improved specificity”
  2. “Introducing precise genetic modifications into human 3PN embryos by CRISPR/Cas-mediated genome editing”, Kang et al 2016 (see also Liang et al 2015)
  3. “The Genome Project-Write”, Boeke et al 2016 (media)
  4. “CRISPR gene-editing tested in a person for the first time”
  5. “Engineering the Perfect Baby”

• Pleiotropy

  1. “Shared genetic aetiology between cognitive functions and physical and mental health in UK Biobank (n=112151) and 24 GWAS consortia”, Hagenaars et al 2016; “Detection and interpretation of shared genetic influences on 42 human traits”, Pickrell et al 2016; “An Atlas of Genetic Correlations across Human Diseases and Traits”, Bulik-Sullivan et al 2015; “Phenome-wide Heritability Analysis of the UK Biobank”, Ge et al 2016
  2. “Genetic relationship between five psychiatric disorders estimated from genome-wide SNPs”, Psychiatric Genomics Consortium 2013; “Analysis of shared heritability in common disorders of the brain”, Anttila et al 2016; “Genome-wide analyses for personality traits identify six genomic loci and show correlations with psychiatric disorders”, Lo et al 2016; “Genetic variants associated with subjective well-being, depressive symptoms, and neuroticism identified through genome-wide analyses”, Okbay et al 2016a; “Association between stressful life events and psychotic experiences in adolescence: evidence for gene-environment correlations”, Shakoor et al 2016; “Associations between Polygenic Risk for Psychiatric Disorders and Substance Involvement”, Carey et al 2016
  3. “Shared genetic aetiology of puberty timing between sexes and with health-related outcomes”, Day et al 2015; “Physical and neurobehavioral determinants of reproductive onset and success”, Day et al 2016
  4. “LD Hub: a centralized database and web interface to perform LD score regression that maximizes the potential of summary level GWAS data for SNP heritability and genetic correlation analysis”, Zheng et al 2016
  5. “The Causal Effects of Education on Health, Mortality, Cognition, Well-being, and Income in the UK Biobank”, Davies et al 2016
  6. “Association between polygenic risk scores for attention-deficit hyperactivity disorder and educational and cognitive outcomes in the general population”, Stergiakouli et al 2016
  7. “Educational attainment and personality are genetically intertwined”, Mottus et al 2016

AI:

1. “Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation”, Johnson et al 2016; “Found in translation: More accurate, fluent sentences in Google Translate”

2. “Hybrid computing using a neural network with dynamic external memory”, Graves et al 2016 (blog); scaling to extremely large external memories: “Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes”, Rae et al 2016

3. “Progressive Neural Networks”, Rusu et al 2016a; “Sim-to-Real Robot Learning from Pixels with Progressive Nets”, Rusu et al 2016b; “Overcoming catastrophic forgetting in neural networks”, Kirkpatrick et al 2016 (see also “Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning”, Parisotto et al 2015)

4. “Decoupled Neural Interfaces using Synthetic Gradients”, Jaderberg et al 2016 (DeepMind explainer; potentially allows for extreme parallelization of neural nets across GPUs)

5. “Outrageously large neural networks: the sparsely-gated mixture-of-experts layer”, Shazeer et al 2016

6. “One-shot Learning with Memory-Augmented Neural Networks”, Santoro et al 2016

7. “Programming with a Differentiable Forth Interpreter”, Riedel et al 2016; “DeepCoder: Learning to Write Programs”, Balog et al 2016; “Learning to superoptimize programs”, Bunel et al 2016; DeepMath/“HolStep: A Machine Learning Dataset for Higher-order Logic Theorem Proving”, Kaliszyk et al 2016 (continuing the AlphaGo theme of tree search+NN heuristics; see also “Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning”, Guo et al 2014)

8. “WaveNet: A Generative Model for Raw Audio”

9. “Achieving Human Parity in Conversational Speech Recognition”, Xiong et al 2016

10. “Lip Reading Sentences in the Wild”, Chung et al 2016 (video); “LipNet: Sentence-level Lipreading”, Assael et al 2016 (video)

11. reinforcement learning:

    1. “Mastering the game of Go with deep neural networks and tree search”, Silver et al 2016
    2. “Neural architecture search with reinforcement learning”, Zoph & Le 2016; “Designing Neural Network Architectures using Reinforcement Learning”, Baker et al 2016; “Learning to reinforcement learn”, Wang et al 2016
    3. “Value Iteration Networks”, Tamar et al 2016; “The Predictron: End-To-End Learning and Planning”, Silver et al 2016
    4. “Unifying Count-Based Exploration and Intrinsic Motivation”, Bellemare et al 2016 (Video)
    5. “Asynchronous Methods for Deep Reinforcement Learning (A3C)”, Mnih et al 2016
    6. “Reinforcement Learning with Unsupervised Auxiliary Tasks”, Jaderberg et al 2016; “Loss is Its Own Reward: Self-supervision for Reinforcement Learning”, Shelhamer et al 2016
    7. “Uncertainty in Deep Learning”, Gal 2016
    8. “Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection”, Levine et al 2016 (video); “Deep Reinforcement Learning for Robotic Manipulation”, Gu et al 2016 (video; blog)

Statistics/meta-science:

1. “When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis”, Scannell & Bosley 2016

2. “Online Controlled Experiments: Introduction, Learnings, and Humbling Statistics”, Kohavi 2012

3. “Underreporting in Psychology Experiments: Evidence From a Study Registry”, Franco et al 2015 (previously: Franco et al 2014)

4. how often does correlation=causation?

   • “Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies”, Ioannidis et al 2001
   • “Comparison of Effects in Randomized Controlled Trials With Observational Studies in Digestive Surgery”, Shikata et al 2006
   • “A Comparison of Approaches to Advertising Measurement: Evidence from Big Field Experiments at Facebook”, Gordon et al 2016

5. “Peer review: Troubled from the start”; “Saving Science: Science isn’t self-correcting, it’s self-destructing. To save the enterprise, scientists must come out of the lab and into the real world.”

6. “The Bitter Fight Over the Benefits of Bilingualism”

7. “How Kalman Filters Work, Part 1”

8. “Generalized Network Psychometrics: Combining Network and Latent Variable Models”, Epskamp et al 2016

9. “Statistically Controlling for Confounding Constructs Is Harder than You Think”, Westfall & Yarkoni 2016 (Even a structural equation model (SEM) which explicitly incorporates measurement error may still have enough leakage to render ‘controlling’ misleading. See also Stouffer 1936/Thorndike 1942/Kahneman 1965.)

10. “Preventing future offending of delinquents and offenders: what have we learned from experiments and meta-analyses?”, Mackenzie & Farrington 2015

Psychology:

1. “When Lightning Strikes Twice: Profoundly Gifted, Profoundly Accomplished”, Makel et al 2016; “Ann Roe’s scientists: original published papers”; “From Terman to Today: A Century of Findings on Intellectual Precocity”, Lubinski 2016

2. “Heads or tails: the impact of a coin toss on major life decisions and subsequent happiness”, Levitt 2016

3. “A Meta-Analysis of Blood Glucose Effects on Human Decision Making”, Orquin & Kurzban 2016; “Is Ego-Depletion a Replicable Effect? A Forensic Meta-Analysis of 165 Ego Depletion Articles”

4. Do Portia spiders have a mind? (commentary)

5. “Childhood forecasting of a small segment of the population with large economic burden”, Caspi et al 2016 (“Figure 4: The Big Footprint of Multiple-High-Cost-Users”; for the genetic version, see Belsky et al 2016)

6. Psychedelics & psychological well-being (media):

   • “The paradoxical psychological effects of lysergic acid diethylamide (LSD)”, Carhart-Harris et al 2016
   • “Psilocybin produces substantial and sustained decreases in depression and anxiety in patients with life-threatening cancer: A randomized double-blind trial”, Griffiths et al 2016
   • “Rapid and sustained symptom reduction following psilocybin treatment for anxiety and depression in patients with life-threatening cancer: a randomized controlled trial”, Ross et al 2016
   • “Survey study of challenging experiences after ingesting psilocybin mushrooms: Acute and enduring positive and negative consequences”, Carbonaro et al 2016
   • “Psilocybin for anxiety and depression in cancer care? Lessons from the past and prospects for the future”, Nutt 2016

Biology:

1. “Aldehyde-stabilized cryopreservation”, McIntyre & Fahy 2015 wins the Small Mammal Brain Preservation Prize by passing their evaluation (commentary)
2. “Effects of Initiating Moderate Alcohol Intake on Cardiometabolic Risk in Adults With Type 2 Diabetes: A 2-Year Randomized, Controlled Trial”, Gepner et al 2015
3. “Long-Term Outcomes Associated with Traumatic Brain Injury in Childhood and Adolescence: A Nationwide Swedish Cohort Study of a Wide Range of Medical and Social Outcomes”, Sariaslan et al 2016
4. “Effect of Calorie Restriction on Mood, Quality of Life, Sleep, and Sexual Function in Healthy Nonobese Adults: The CALERIE 2 Randomized Clinical Trial”, Martin et al 2016
5. “Evolution of the Human Brain: From Matter to Mind”, Hofman 2015
6. “What sparked the Cambrian explosion?”

Politics/religion:

1. “The Iron Law Of Evaluation And Other Metallic Rules”, Rossi 1987
2. “The Strategic Consequences of Chinese Racism: A Strategic Asymmetry for the United States”, Anonymous & Anonymous 2013
3. “A Bigger Problem Than ISIS? The Mosul Dam is failing. A breach would cause a colossal wave that could kill as many as a million and a half people”
4. “Okhrana: The Paris Operations of the Russian Imperial Police”
5. “Once Upon a Jihad” / “Experiencing Ecstasy: How Bad It Is to Be 20 Years Old” / “My Year in San Francisco’s $2 Million Secret Society Startup”
6. “Introduction to the Economics of Religion”, Iannaccone 1998
7. “How a detachment of U.S. Army soldiers smoked out the original Ku Klux Klan”
8. “The Unbelievable Tale of Jesus’s Wife”, King’s response
9. “Wealth, Health, and Child Development: Evidence from Administrative Data on Swedish Lottery Players”, Cesarini et al 2016
10. “At Tampa Bay farm-to-table restaurants, you’re being fed fiction” (Qui vult decipi decipiatur.)

Technology:

1. “The Mastermind”
2. “The Moral Character of Cryptographic Work”, Rogaway 2015
3. “Stargate Physics 101”
4. “Lessons Learned from 30 Years of MINIX”, Tanenbaum 2016
5. “The Slow Winter”, Mickens
6. “Strategy Letter V”
7. “DDoSCoin: Cryptocurrency with a Malicious Proof-of-Work”, Wustrow & VanderSloot 2016
8. “Beaver: A Decentralized Anonymous Marketplace with Secure Reputation”, Soska et al 2016
9. “Sam Altman’s Manifest Destiny: Is the head of Y Combinator fixing the world, or trying to take over Silicon Valley?”
10. “The Distribution of Users’ Computer Skills: Worse Than You Think”

Economics:

1. “The life of American workers in 1915”
2. “Typhoid Fever, Water Quality, and Human Capital Formation”, Beach et al 2016; “When It Rains It Pours: The Long-run Economic Impacts of Salt Iodization in the United States”, Adhvaryu et al 2016; “The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments”, Fryer 2016
3. “Going for the Gold: The Economics of the Olympics”, Baade & Matheson 2016
4. “The Long-Term Effects of Cash Assistance”, Price & Song 2016
5. Abuse of ‘arbitration’ clauses in international trade treaties to escape criminal liability
6. “The View from Above: Applications of Satellite Data in Economics”, Donaldson & Storeygard 2016
7. “Adam Smith, Watch Prices, and the Industrial Revolution”, Kelly & Grada 2016 (commentary)
8. “Patents and innovation in economic history”, Moser 2016
9. “Elephants and Mammoths: Can Ice Ivory Save Blood Ivory?”, Farah & Boyce 2015
10. “The Case Against Everyone’s Favorite Tax Break: The Mortgage Interest Deduction”

Philosophy:

1. “Logical Induction”, Garrabrant et al 2016
2. “Time Travel and Computing”, Moravec 1991
3. “Towards an integration of deep learning and neuroscience”, Marblestone et al 2016
4. “Probing the Improbable: Methodological Challenges for Risks with Low Probabilities and High Stakes”, Ord et al 2008
5. “Not By Empathy Alone”
6. “Technology will destroy human nature”
7. “Trying to See Through: A Unified Theory of Nerddom”

Fiction:

1. Ted Chiang:

   1. “Exhalation”
   2. “Seventy-Two Letters”
   3. “Hell is the Absence of God”
   4. “The Merchant and the Alchemist’s Gate”

2. There Is No Anti-Memetics Division, by Sam Hughes

3. “Spring and Fall”, by Gerard Manley Hopkins

4. “Suminoe Beach”, by Kuramochi Chitose

5. “Poverty”, by Moon Byung-ran

6. “Design”, by Robert Frost

7. Sanderson’s First Law

Books

Nonfiction:

1. Lucretius’s On the Nature of Things
2. Don’t Sleep, There Are Snakes: Life and Language in the Amazonian Jungle, Everett 2009 (on the Pirahã people; review)
3. A Life of Sir Francis Galton (review)
4. The Sports Gene, Epstein
5. Fortune’s Formula, Poundstone 2005 (review)
6. Montaillou: The Promised Land of Error, Le Roy Ladurie 1975
7. The Theory of Special Operations, McRaven 1992 (review)
8. Titan: The Life of John D. Rockefeller, Sr., Chernow (review)
9. The Genius Factory, Plotz 2005
10. The Riddle of the Labyrinth, Fox

Fiction:

1. Poems of Gerard Manley Hopkins, by Gerard Manley Hopkins (review)

TV/movies

Nonfiction movies:

1. A Beautiful Planet
2. The Kingdom of Dreams and Madness

Fiction:

1. Florence Foster Jenkins

Anime:

1. The Tale of Princess Kaguya
2. Short Peace
3. Death Parade
4. The Wind Rises
5. Basilisk (review)
6. Chirin no Suzu/Ringing Bell (review)