--- title: 2017 News created: 2017-11-30 description: Annual summary of 2017 Gwern.net newsletters, selecting my best writings, the best 2017 links by topic, and the best books/movies/anime I saw in 2017. status: finished previous: /newsletter/2017/12 next: /newsletter/2018/01 confidence: log cssExtension: dropcaps-de-zs backlink: False ... This is the 2017 summary edition of [the Gwern.net newsletter](https://gwern.substack.com/ "'Gwern.net newsletter (Substack subscription page)', Branwen 2013") ([archives](/doc/newsletter/index)), summarizing the best of the monthly 2017 newsletters:
#. [January](/newsletter/2017/01 "'January 2017 News', Branwen 2016") #. [February](/newsletter/2017/02 "'February 2017 News', Branwen 2017") #. [March](/newsletter/2017/03 "'March 2017 News', Branwen 2017") #. [April](/newsletter/2017/04 "'April 2017 News', Branwen 2017") #. [May](/newsletter/2017/05 "'May 2017 News', Branwen 2017") #. [June](/newsletter/2017/06 "'June 2017 News', Branwen 2017") #. [July](/newsletter/2017/07 "'July 2017 News', Branwen 2017") #. [August](/newsletter/2017/08 "'August 2017 News', Branwen 2017") #. [September](/newsletter/2017/09 "'September 2017 News', Branwen 2017") #. [October](/newsletter/2017/10 "'October 2017 News', Branwen 2017") #. [November](/newsletter/2017/11 "'November 2017 News', Branwen 2017") #. [December](/newsletter/2017/12 "'December 2017 News', Branwen 2017")
Previous annual newsletters: [2016](/newsletter/2016/13 "'2016 News', Branwen 2016"), [2015](/newsletter/2015/13 "'2015 News', Branwen 2016"). # Writings **Posts**: #. [The Kelly Coin-Flipping Problem: Exact Solutions via Decision Trees](/coin-flip "Decision-theoretic analysis of how to optimally play Haghani & Dewey 2016's double-or-nothing coin-flipping game with an edge and ceiling better than using the Kelly Criterion. Computing and following an exact decision tree increases earnings by $6.6 over a modified KC.") #. ["'Story Of Your Life' Is Not A Time-Travel Story"](/story-of-your-life "Famous Ted Chiang SF short story 'Story Of Your Life' is usually misinterpreted as, like the movie version, being about time-travel/precognition; I explain it is instead an exploration of the psychology of timeless physics interpretations.") #. ["Banner Ads Considered Harmful"](/banner "9 months of daily A/B-testing of Google AdSense banner ads on Gwern.net indicates banner ads decrease total traffic substantially, possibly due to spillover effects.") #. [On the history of the tank/neural-net urban legend](/tank "AI folklore tells a story about a neural network trained to detect tanks which instead learned to detect time of day; investigating, this probably never happened.") #. [Efficiently calculating the average maximum datapoint from a sample of Gaussians](/order-statistic "'Calculating The Gaussian Expected Maximum', Branwen 2016") Site traffic ([July 2017-January 2018](/traffic#july-2017---january-2018)) was up: 326,852 page-views by 155,532 unique users. # Media ## Overview **AI/genetics/VR/Bitcoin/general**: **AI**: as I hoped in 2016, 2017 saw a re-emergence of model-based RL with various deep approaches to learning reasoning, meta-RL, and environment models. Using relational logics and doing planning over internal models and zero/few-shot learning are no longer things "deep learning can't do". My selection for the single biggest breakthrough of the year was when AlphaGo racked up a second major intellectual victory with the demonstration by Zero that using a simple expert iteration algorithm (with MCTS as the expert) does not only solve the long-standing problem of NN self-play being wildly unstable (dating back to attempts to failed attempts to extend TD-Gammon to non-backgammon domains in the 1990s), but also allows superior learning to the complicated human-initialized AGs---in both wallclock time & end strength, which is deeply humbling. 2000 years of study and tens of millions of active players, and that's all it takes to surpass the best human Go players ever in the supposedly uniquely human domain of subtle global pattern recognition. Not to mention chess. ([Silver et al 2017a](/doc/reinforcement-learning/model/alphago/2017-silver.pdf#deepmind "Mastering The Game of Go without Human Knowledge"), [Silver et al 2017b](https://arxiv.org/abs/1712.01815#deepmind "Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm").) Expert iteration is an intriguingly general and underused design pattern, which I think may prove useful, especially if people can remember that it is *not* limited to two-player games but is a general method for solving any MDP. The second most notable would be GAN work: Wasserstein GAN losses ([Arjovsky et al 2017](https://arxiv.org/abs/1701.07875 "WGAN: Wasserstein GAN")) considerably ameliorated the instability issues when using GANs with various architectures, and although WGANs can still diverge or fail to learn, they are not so much of a black art as the original DCGANs tended to be. This probably helped with later GAN work in 2017, such as the invention of the CycleGAN architecture ([Zhu et al 2017](https://junyanz.github.io/CycleGAN/ "CycleGAN: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks")) which accomplishes magical & bizarre kinds of learning such as learning, using horse and zebra images, to turn an arbitrary horse image into a zebra & vice-versa, or your face into a car or a bowl of ramen soup. "Who ordered *that*?" I didn't, but it's delicious & hilarious anyway, and suggests that GANs really will be important in unsupervised learning because they appear to be learning a lot about their domains. Additional demonstrations like being able to translate between human languages given only *mono*lingual corpuses merely emphasize that lurking power---I still feel that CycleGAN should not work, much less high-quality neural translation without any translation pairs, but it does. The path to larger-scale photorealistic GANs was discovered by Nvidia's ProGAN paper ([Karras et al 2017](https://arxiv.org/abs/1710.10196#nvidia "ProGAN: Progressive Growing of GANs for Improved Quality, Stability, and Variation")): essentially StackGAN's approach of layering several GANs trained incrementally as upscalers does work (as I expected), but you need much more GPU-compute to reach 1024x1024-size photos and it helps if each new upscaling GAN is only gradually blended in to avoid the random initialization destroying everything previously learned (analogous to transfer learning needing low learning rates or to freeze layers). Time will tell if the ProGAN approach is a one-trick pony for GANs limited to photos. Finally, GANs started turning up as useful components in semi-supervised learning in the GAIL paradigm ([Ho & Ermon 2016](https://arxiv.org/abs/1606.03476 "Generative Adversarial Imitation Learning (GAIL)")) for deep RL robotics. I expect GANs are still a while off from being productized or truly critical for anything---they remain a solution in search of a problem, but less so than I commented last year. Indeed, from AlphaGo to GANs, 2017 was the year of deep RL ([subreddit traffic](https://www.reddit.com/r/reinforcementlearning/comments/7noder/meta_rrl_subreddit_traffic_substantial_increase/) octupled). Papers tumbled out constantly, accompanied by ambitious commercial moves: Jeff Dean laid out a vision for using NNs/deep RL essentially everywhere inside Google's software stack, Google began full self-driving services in Phoenix, while noted researchers like Pieter Abbeel founded robotics startups betting that deep RL has finally cracked imitation & few-shot learning. I can only briefly highlight, in deep RL, continued work on [meta-RL](https://www.reddit.com/r/reinforcementlearning/search?q=flair%3AMetaRL&restrict_sr=on&sort=top&t=year) & neural net architecture search with fast weights, relational reasoning & logic modules, zero/few-shot learning, deep environment models (critical for planning), and [robot](https://www.reddit.com/r/reinforcementlearning/search?q=flair%3ARobot&sort=top&restrict_sr=on&t=year) progress in sample efficiency/[imitation learning](https://www.reddit.com/r/reinforcementlearning/search?q=flair%3AI&restrict_sr=on&t=year)/[model-based](https://www.reddit.com/r/reinforcementlearning/search?q=flair%3AM+flair%3ARobot&restrict_sr=on&sort=top&t=year) & off-policy learning, in addition to the integration of GANs a la GAIL. What will happen if every year from now on sees as much progress in deep reinforcement learning as we saw in 2017? (Suppose deep learning ultimately *does* lead to a Singularity; how would it look any different than it does now?) One thing missing from 2017 for me was use of very large NNs using expert mixtures, synthetic gradients, or other techniques; in retrospect, this may reflect hardware limitations as non-Googlers increasingly hit the limits of what can be iterated on reasonably quickly using just 1080tis or P100s. So I am intrigued by the increasing availability of Google's second-generation TPUs (which can do training) and by discussions of multiple maturing NN accelerator startups which might break Nvidia's costly monopoly and offer 100s of teraflops or petaflops at non-AmaGoogBookSoft researcher/hobbyist budgets. Genetics in 2017 was a straight-line continuation of 2016: the UKBB dataset came online and is fully armed & operational, with exomes now following (and whole-genomes soon), resulting in the typical flurries of papers on everything which is heritable (which is everything). Genetic engineering had a banner year between CRISPR and older methods in the pipeline---it seemed like every week there was a new mouse or human trial curing something or other, to the point where I lost track and the NYT has begun reporting on clinical trials being delayed by lack of virus manufacturing capacity. (A good problem to have!) Genome synthesis continues to greatly concern me but nothing newsworthy happened in 2017 other than, presumably, continuing to get cheaper on schedule. Intelligence research did not deliver any particularly amazing results as the SSGAC paper has apparently been delayed to 2018 (with a glimpse in [Plomin & von Stumm 2018](/doc/iq/2018-plomin.pdf "The new genetics of intelligence")), but we saw two critical methodological improvements which I expect to yield fruit in 2017--2018: first, as genetic correlation researchers have noted for years, genetic correlations should be able to boost power considerably by correcting for measurement error & increasing effective sample size by appropriate combination of polygenic scores, and MTAG demonstrates this works well for intelligence ([Hill et al 2017b](https://www.biorxiv.org/content/10.1101/160291.full "A combined analysis of genetically correlated traits identifies 107 loci associated with intelligence") increases PGS to ~7% & [Hill et al 2018](https://www.nature.com/articles/s41380-017-0001-5 "A combined analysis of genetically correlated traits identifies 187 loci and a role for neurogenesis and myelination in intelligence") to ~10%); second, Hsu's lasso predictions were proven true by [Lello et al 2017](https://www.biorxiv.org/content/10.1101/190124.full "Accurate Genomic Prediction Of Human Height") demonstrating the creation of a polygenic score explaining most SNP heritability/predicting 40% of height variance. The use of these two simultaneously with SSGAC & other datasets ought to boost IQ PGSes to >10% and possibly much more. Perhaps the most notable single development was the resolution of the long-standing dysgenics question using molecular genetics: has the demographic transition in at least some Western countries led to decreases in the genetic potential for intelligence (mean polygenic score), as suggested by most but not all phenotypic analyses of intelligence/education/fertility? Yes, in Iceland/USA/UK, dysgenics has indeed done that on a meaningful scale, as shown by straightforward calculations of mean polygenic score by birth decade & genetic correlations. More interestingly, the increasing availability of ancient DNA allows for preliminary analyses of how polygenic scores change over time: over tens of thousands of years, human intelligence & disease traits appear to have been slowly selected against (consistent with most genetic variants being harmful & under purifying selection) but that trend reversed at some point relatively recent. For 2016, I noted that the main story of VR was that it hadn't failed & was modestly successful; 2017 saw the continuation of this trend as it climbs into its "trough of productivity"---the media hype has popped and for 2017, VR just kept succeeding and building up an increasingly large library of games & applications, while the price continued to drop dramatically (as everyone should have realized but didn't) with the Oculus now ~[$300]($2017). So much for "motion sickness will kill VR again" or "VR is too expensive for gamers". Perhaps the major surprise for me was that Sony's quiet & noncommittal approach to its headset (which made me wonder if it would be launched at all) masked a huge success, as PSVR has sold into the millions of units and is probably the most popular 'real' VR solution despite its technical drawbacks compared to Vive/Oculus. There continues to be no killer app, but the many upcoming hardware improvements like 4K displays or wireless headsets or eye tracking+foveated-rendering will continue increasing quality while prices drop and libraries continue to build up; if there is any natural limit to the VR market, I haven't seen any sign of it yet. So for 2018--2019, I wonder if VR will simply continue to grow gradually with mobile smartphone VR solutions eating the lunch of full headsets, or if there will be a breakout moment where the price, quality, library, and a killer app hit a critical combination? Bitcoin underwent one of its periodic 'bubbles', complete with the classic accusations that this time Bitcoin will surely go to zero, the fee spikes mean Bitcoin will never scale ("nobody goes there anymore, it's too popular"), people can't use it to pay for anything, it's a clear scam because of various peoples' foolishness like taking out mortgages to gamble on further increases, Coinbase is run by fools & knaves, random other altcoins have bubbled too & will doubtless replace Bitcoin soon, Bitcoin has failed to achieve any libertarian goals and is now a plaything of the rich, people who were wrong about Bitcoin every time from [$1]($2011) in 2011 to now will claim to be right morally, the PoW security is wasteful, etc---one could copy-paste most articles or comments from the last bubble (or the one before that, or before that) into this one with no change other than the numbers. As such, while I have benefited from it, there is little worth saying about it other than to note its existence with bemusement, and reflect on how far Bitcoin & cryptocurrencies have come since I first began using them in 2011: Even if Bitcoin goes to zero now, it's unleashed an incredible Cambrian explosion of cryptography applications and economics crossovers. Cryptoeconomists are going to spend decades digesting proof-of-work, proof-of-stake, slashing, Truthcoin/HiveMind/Augur, zk-SNARKs and zk-STARKs, Mimblewimble, TrueBit, scriptless scripts & other applications of Schnorr signatures, Turing-complete contracts, observed cryptomarkets like the DNMs... You can go through [Tim May's](https://en.wikipedia.org/wiki/Timothy_C._May) [_Cyphernomicon_](https://en.wikipedia.org/wiki/Timothy_C._May) and each section corresponds to a project made possible only via Bitcoin's influence. Bitcoin had more influence in its first 5 years than Chaum's digital cash has had in 30 years. Cryptography will never be the same. The future's so bright I gotta wear mirrorshades. A short note on politics: Donald Trump's presidency and its backlash in the form of Girardian scapegoating (sexual harassment scandals & social-media purges) have received truly disproportionate coverage and have become almost an addiction. They have distracted from important issues and from important facts like 2017 being one of the best years in human history, many scientific & technological improvements and breakthroughs like genetic engineering or AI, or global & US economic growth. Objectively, Trump's first year has been largely a non-event; a few things were accomplished like packing federal courts and a bizarre tax bill, but overall not much happened, and Trump has not lived up to the apocalyptic predictions & hysteria. If the next 3 years are similar to 2017, one would have to admit that Trump as president turned out better than George W. Bush! ## Links **Genetics**: - [Everything Is Heritable]{.smallcaps}: #. ["Accurate Genomic Prediction Of Human Height"](https://www.biorxiv.org/content/10.1101/190124.full "'Accurate Genomic Prediction Of Human Height', Lello et al 2017"), Lello et al 2017 (Hsu's lasso) #. ["Genomic analysis of family data reveals additional genetic effects on intelligence and personality"](https://www.biorxiv.org/content/10.1101/106203.full), Hill et al 2017a (GREML-KIN/family-GCTA: IQ missing heritability resolved with novel GCTA---most/all of the rest is due to semi-rare additive variants, implying that GWASes and future polygenic scores will do much better) #. ["GWAS of 78,308 individuals identifies new loci and genes influencing human intelligence"](/doc/iq/2017-sniekers.pdf "'Genome-wide association meta-analysis of 78,308 individuals identifies new loci and genes influencing human intelligence', Sniekers et al 2017"), Sniekers et al 2017 #. ["Multi-trait analysis of genome-wide association summary statistics using MTAG"](/doc/genetics/heritable/correlation/2018-turley.pdf), Turley et al 2018; ["A combined analysis of genetically correlated traits identifies 107 loci associated with intelligence"](https://www.biorxiv.org/content/10.1101/160291.full "'A combined analysis of genetically correlated traits identifies 107 loci associated with intelligence', Hill et al 2017"), Hill et al 2017b (use of multiple [genetic correlations](https://en.wikipedia.org/wiki/Genetic_correlation) to overcome measurement error greatly boosts efficiency of IQ GWAS, and provides best public polygenic score to date: 7% of variance. This illustrates a good way to work around the shortage of high-quality IQ test scores by exploiting multiple more easily-measured phenotypes. Even better: like LD score regression, MTAG only requires public summary statistics; so it may also, like LD score regression, see an explosion in use---since it is usable by everyone & there are so many overlapping phenotypic measurements...) #. ["Genome-wide genetic data on ~500,000 UK Biobank participants"](https://www.biorxiv.org/content/10.1101/166298.full), Bycroft et al 2017 (The full UK Biobank _n_ = 500k genetics dataset is now available to researchers! UKBB is the gift that keeps on giving---and now it's going to give even more by tripling the sample size.) #. ["An atlas of genetic associations in UK Biobank"](https://www.biorxiv.org/content/10.1101/176834.full), Canela-Xandri et al 2017 (at least 559 of 717 UKBB traits have detectable SNP heritability, with pervasive genetic correlations; polygenic scores for all have been made public via [Gene ATLAS](http://geneatlas.roslin.ed.ac.uk/ "Gene ATLAS is a large database of associations between hundreds of traits and millions of variants using the UK Biobank cohort"). See previously: [Ge et al 2016](https://www.biorxiv.org/content/10.1101/070177.full "Phenome-wide Heritability Analysis of the UK Biobank")) #. ["Common risk variants identified in autism spectrum disorder"](https://www.biorxiv.org/content/10.1101/224774.full), Grove et al 2017 (ASD, as expected, crosses the sample size threshold for hits. More importantly: the genetic correlations imply that autism is not a single thing & that intelligence genes are not inherently 'autistic'; hence it will be possible to select for intelligence without selecting for autism. I've always had a hard time believing the simple genetic correlations between intelligence and 'autism spectrum disorder' since it's unclear why variants that improve intelligence would decrease social functioning which should require intelligence as much as anything else; if it's simply that there's heterogeneity and that, say, 'systematizing' is shared between intelligence and autism diagnoses, that would be a credible resolution.) #. ["Quantifying the impact of rare and ultra-rare coding variation across the phenotypic spectrum"](https://www.biorxiv.org/content/10.1101/148247.full), Ganna et al 2017 #. The environment is genetic: ["The nature of nurture: effects of parental genotypes"](/doc/genetics/heritable/2018-kong.pdf), Kong et al 2017; ["Estimating heritability without environmental bias"](https://www.biorxiv.org/content/10.1101/218883.full), Young et al 2017 (interesting new method; among other implications, that much of the benefits of embryo selection would be delayed to the next generation, since they will be expressed via better parenting (whatever that is).) #. ["10 Years of GWAS Discovery: Biology, Function, and Translation"](/doc/genetics/heritable/2017-visscher.pdf), Visscher et al 2017 (Almost a decade into the human genetic revolution---GCTA was ~2009---where do we stand?) - [Engineering]{.smallcaps}: #. ["First Human Embryos Edited With CRISPR in U.S."](https://www.technologyreview.com/2017/07/26/68093/first-human-embryos-edited-in-us/ "Researchers have demonstrated they can efficiently improve the DNA of human embryos") #. ["CRISPR/Cas9-mediated gene editing in human zygotes using Cas9 protein"](/doc/genetics/editing/2017-tang.pdf), Tang et al 2017 (no off-target mutations and efficiencies of 20/50/100% for various edits. As I predicted, the older papers, Liang et al 2015 / Kang et al 2016 / Komor et al 2016, were not state-of-the-art and would be improved on considerably); ["Correction of a pathogenic gene mutation in human embryos"](https://www.nature.com/articles/nature23305), Ma et al 2017 (Human CRISPR editing: no observed off-targets, 27.9% efficiency.) #. ["Beyond editing to writing large genomes"](/doc/genetics/genome-synthesis/2017-chari.pdf), Chari & Church 2017 (genome synthesis) #. ["A New Way to Reproduce: Scientists are trying to manufacture eggs and sperm in the laboratory. Will it end reproduction as we know it?"](https://www.technologyreview.com/2017/08/07/105540/a-new-way-to-reproduce/) (Rapid progress towards iterated embryo selection; will it become a reality before genome synthesis?) #. ["China sprints ahead in CRISPR therapy race: Human trials are using the genome-editing technique to treat cancers and other conditions"](/doc/genetics/editing/2017-normile.pdf), Normile 2017-10-06; ["China's embrace of embryo selection raises thorny questions: Fertility centres are making a massive push to increase preimplantation genetic diagnosis in a bid to eradicate certain diseases"](https://www.nature.com/articles/548272a) (The wind is rising.) #. ["U.S. attitudes on human genome editing"](/doc/genetics/editing/2017-scheufele.pdf), Scheufele et al 2017 (increasingly positive public opinion, especially among the most informed) #. ["Eugenics 2.0: We're at the Dawn of Choosing Embryos by Health, Height, and More; Will you be among the first to pick your kids' IQ? As machine learning unlocks predictions from DNA databases, scientists say parents could have choices never before possible."](https://www.technologyreview.com/2017/11/01/105176/eugenics-20-were-at-the-dawn-of-choosing-embryos-by-health-height-and-more/) (Hsu's embryo selection startup, Genomic Prediction, comes out of stealth) #. ["A 100-Year Review: Methods and impacts of genetic selection in dairy cattle---From daughter-dam comparisons to deep learning algorithms"](/doc/genetics/selection/artificial/index-selection/2017-weigel.pdf "‘A 100-Year Review: Methods and impact of genetic selection in dairy cattle—From daughter-dam comparisons to deep learning algorithms’, Weigel et al 2017"), Weigel et al 2017 (A preview of improving genomic prediction & selection.) - [Recent Evolution]{.smallcaps}: #. in Iceland: decrease in the education polygenic score 1910--1990, ["Selection against variants in the genome associated with educational attainment"](/doc/genetics/selection/natural/human/dysgenics/2017-kong.pdf), Kong et al 2017 ([graph](/doc/genetics/heritable/correlation/2017-kong-iceland-education-dysgenics.png); [media](https://www.theguardian.com/science/2017/jan/16/natural-selection-making-education-genes-rarer-says-icelandic-study "Natural selection making 'education genes' rarer, says Icelandic study: Researchers say that while the effect corresponds to a small drop in IQ per decade, over centuries the impact could be profound")) #. in the US: decrease in the education polygenic score 1920--1960, ["Mortality Selection in a Genetic Sample and Implications for Association Studies"](https://www.biorxiv.org/content/10.1101/049635.full), Domingue et al 2016 ([graph](/doc/genetics/selection/2016-domingue-usa-education-dysgenics.png)) #. selection against education in the UK: ["Signatures of negative selection in the genetic architecture of human complex traits"](/doc/genetics/selection/natural/human/dysgenics/2018-zeng.pdf), Zeng et al 2018 #. ["Patterns of shared signatures of recent positive selection across human populations"](https://www.biorxiv.org/content/10.1101/109371.full), Johnson & Voight 2017 #. disease mutation load: ["The Genomic Health Of Ancient Hominins"](https://www.biorxiv.org/content/10.1101/145193.full "'The genomic health of ancient hominins', Berens et al 2017"), Berens et al 2017 ([media](https://phys.org/news/2017-08-cavemen-genetic-checkup.html "You and some 'cavemen' get a genetic checkup"); +35% percentile increase in general disease risks over past ~millennia?) #. ["Detecting polygenic adaptation in admixture graphs"](https://www.biorxiv.org/content/10.1101/146043.full), Racimo et al 2017 (No sign of selection is found for Europeans, but if I understand the method right, it's only looking at net selection with time steps corresponding to populations branching. So given the European pattern of selection for intelligence at least up until agriculture and then heavy recent dysgenics against education/intelligence, those might mostly cancel compared to an East Asian population like Japan which started later.) #. ["Soft sweeps are the dominant mode of adaptation in the human genome"](https://www.biorxiv.org/content/10.1101/090084.full), Schrider & Kern 2017 (Detection of 2000 instances of recent human selection, half of which are specific to individual human populations, and many of which affect the central nervous system. Note this doesn't cover polygenic selection, so it's a loose lower bound on how much recent human evolution there has been.) #. ["Evidence for evolutionary shifts in the fitness landscape of human complex traits"](https://www.biorxiv.org/content/10.1101/173815.full "‘An evolutionary compass for elucidating selection mechanisms shaping complex traits’, Uricchio et al 2018"), Uricchio et al 2017 (Recent human evolution <50kya: selection on education/intelligence, schizophrenia, height, BMI, Crohn’s disease) #. ["Linkage disequilibrium-dependent architecture of human complex traits shows action of negative selection"](/doc/genetics/selection/natural/human/2017-gazal.pdf), Gazal et al 2017 (high mutation load and ongoing [purifying/negative selection](https://en.wikipedia.org/wiki/Negative_selection_\(natural_selection\)) against variants affecting puberty/anorexia/autism/blood pressure/BMI/celiac disease/Crohn’s disease/breast size/hair curl/heel score/height/gray hair/lung capacity/baldness/cirrhosis/arthritis/schizophrenia/shoe size/unibrow) #. ["Quantification of frequency-dependent genetic architectures and action of negative selection in 25 UK Biobank traits"](https://www.biorxiv.org/content/10.1101/188086.full), Schoech et al 2017 (mutation load & purifying/negative selection within 25 UKBB traits: larger effects of rarer variants, but rare variants continue to disappoint by not accounting for much variance in total. Traits: puberty/blood pressure/BMI/bone mineral density/lung capacity/height/smoking/waist-hip ratio/allergic eczema/asthma/college education/hypertension/11 blood panel traits) **AI**: #. ["CycleGAN: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks"](https://arxiv.org/abs/1703.10593#bair), Zhu et al 2017; weird and magical, leading to applications like ["Unsupervised Machine Translation Using Monolingual Corpora Only"](https://arxiv.org/abs/1711.00043), Lample et al 2017 (but what is it [really learning](https://arxiv.org/abs/1712.02950 "'CycleGAN, a Master of Steganography', Chu et al 2017")?) #. ["ProGAN: Progressive Growing of GANs for Improved Quality, Stability, and Variation"](https://arxiv.org/abs/1710.10196#nvidia "'Progressive Growing of GANs for Improved Quality, Stability, and Variation', Karras et al 2017"), Karras et al 2017 ([source](https://github.com/tkarras/progressive_growing_of_gans); [video](https://www.youtube.com/watch?v=XOxxPcy5Gr4); GANs generating photorealistic 1024x1024px faces, better than [StackGAN++](https://arxiv.org/abs/1710.10916 "'StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks', Zhang et al 2017") This jumps right over the uncanny valley to, for many of these, I can no longer tell the difference without focusing hard on the eyes.) #. ["WGAN: Wasserstein GAN"](https://arxiv.org/abs/1701.07875 "'Wasserstein GAN', Arjovsky et al 2017"), Arjovsky et al 2017 (a surprisingly small tweak fixes both mode collapse & divergence, yielding stable GANs which reliably fit datasets like anime faces in my experiments with [the code](https://github.com/martinarjovsky/WassersteinGAN); underfitting/expressiveness seems to remain an issue, though) #. GANs start becoming useful: ["Generative Adversarial Imitation Learning (GAIL)"](https://arxiv.org/abs/1606.03476 "'Generative Adversarial Imitation Learning', Ho & Ermon 2016"), Ho & Ermon 2016; ["Learning human behaviors from motion capture by adversarial imitation"](https://arxiv.org/abs/1707.02201), Merel et al 2017 (an unusual applied use of GANs); ["Learning from Demonstrations for Real World Reinforcement Learning"](https://arxiv.org/abs/1704.03732 "'Deep Q-learning from Demonstrations', Hester et al 2017"), Hester et al 2017 #. ["Inferring and Executing Programs for Visual Reasoning"](https://arxiv.org/abs/1705.03633), Johnson et al 2017 #. ["Hard Mixtures of Experts for Large Scale Weakly Supervised Vision"](https://arxiv.org/abs/1704.06363#facebook), Gross et al 2017 (scaling CNNs to 500m+ images by sharding) #. ["deep learning can't do logic or reasoning"]{.smallcaps}: ["A simple neural network module for relational reasoning"](https://arxiv.org/abs/1706.01427#deepmind), Santoro et al 2017 ([blog](https://deepmind.google/discover/blog/a-neural-approach-to-relational-reasoning/)) #. ["Attention Is All You Need" for SOTA machine translation](https://arxiv.org/abs/1706.03762#google "'Attention Is All You Need', Vaswani et al 2017"), Vaswani et al 2017 #. ["One Model To Learn Them All"](https://arxiv.org/abs/1706.05137), Kaiser et al 2017 (a single NN for multi-modal tasks: from image classification to image captioning to English parsing to English⟺German⟺French translation) #. ["2016 in Computer Vision"](https://www.themtank.org/a-year-in-computer-vision), Duffy & Flynn (review of primarily DL progress in 2016 on image classification, object detection/tracking, segmentation, upscaling, 3D geometry estimation, and fundamental CNN & dataset R&D) #. [reinforcement learning]{.smallcaps} research is coming out too frequently to single out more than a few papers; see [subscribe to the /r/ReinforcementLearning](https://www.reddit.com/r/reinforcementlearning/) & [/r/DecisionTheory](https://www.reddit.com/r/DecisionTheory/) subreddits for updates #. *AlphaGo Zero*: ["Mastering The Game of Go without Human Knowledge"](/doc/reinforcement-learning/model/alphago/2017-silver.pdf#deepmind "'Mastering the game of Go without human knowledge', Silver et al 2017"), Silver et al 2017a ([detailed commentary](https://www.reddit.com/r/reinforcementlearning/comments/778vbk/mastering_the_game_of_go_without_human_knowledge/)); ["Thinking Fast and Slow with Deep Learning and Tree Search"](https://arxiv.org/abs/1705.08439), Anthony et al 2017 ([blog](https://davidbarber.github.io/blog/2017/11/07/Learning-From-Scratch-by-Thinking-Fast-and-Slow-with-Deep-Learning-and-Tree-Search/)); ["Learning Generalized Reactive Policies using Deep Neural Networks"](https://arxiv.org/abs/1708.07280), Groshev et al 2017; ["Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm"](https://arxiv.org/abs/1712.01815#deepmind "'Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm', Silver et al 2017"), Silver et al 2017b ([commentary](https://www.reddit.com/r/reinforcementlearning/comments/7hvin5/mastering_chess_and_shogi_by_selfplay_with_a/)), see also [Lagoudakis & Parr 2003](/doc/reinforcement-learning/model/alphago/2003-lagoudakis.pdf "Reinforcement Learning as Classification: Leveraging Modern Classifiers") #. *"deep learning can't do planning"*: ["Learning model-based planning from scratch"](https://arxiv.org/abs/1707.06170), Pascanu et al 2017; ["Imagination-Augmented Agents for Deep Reinforcement Learning"](https://arxiv.org/abs/1707.06203#deepmind), Weber et al 2017 ([blog](https://deepmind.google/discover/blog/agents-that-imagine-and-plan/ "Agents that imagine and plan")); ["Path Integral Networks: End-to-End Differentiable Optimal Control"](https://arxiv.org/abs/1706.09597), Okada et al 2017; ["Value Prediction Network"](https://arxiv.org/abs/1707.03497#deepmind), Oh et al 2017; ["Prediction and Control with Temporal Segment Models"](https://arxiv.org/abs/1703.04070), Mishra et al 2017; ["Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuning"](https://arxiv.org/abs/1708.02596), Nagabandi et al 2017; ["Model-based Adversarial Imitation Learning"](https://arxiv.org/abs/1612.02179), Baram et al 2016; ["Learning Generalized Reactive Policies using Deep Neural Networks"](https://arxiv.org/abs/1708.07280), Groshev et al 2017; ["Deep Visual Foresight for Planning Robot Motion"](https://arxiv.org/abs/1610.00696), Finn & Levine 2016; ["Recurrent Environment Simulators"](https://arxiv.org/abs/1704.02254), Chiappa et al 2017 #. ["Machine Learning for Systems and Systems for Machine Learning"](http://learningsys.org/nips17/assets/slides/dean-nips17.pdf), Jeff Dean, 2017 NIPS slides; ["The Case for Learned Index Structures"](https://arxiv.org/abs/1712.01208#google), Kraska et al 2017 #. ["Deep reinforcement learning from human preferences"](https://arxiv.org/abs/1706.03741#openai), Christiano et al 2017 (blogs: [1](https://deepmind.google/discover/blog/learning-through-human-feedback/ "Learning through human feedback [blog]"), [2](https://openai.com/research/learning-from-human-preferences "Learning from Human Preferences")) #. ["SMASH: One-Shot Model Architecture Search through HyperNetworks"](https://arxiv.org/abs/1708.05344), Brock et al 2017 #. ["Bayesian Reinforcement Learning: A Survey"](https://arxiv.org/abs/1609.04436), Ghavamzadeh et al 2016 #. ["Deep Reinforcement Learning: An Overview"](https://arxiv.org/abs/1810.06339 "‘Deep Reinforcement Learning’, Li 2018"), Li 2017 #. ["TreeQN and ATreeC: Differentiable Tree Planning for Deep Reinforcement Learning"](https://arxiv.org/abs/1710.11417 "'TreeQN and ATreeC: Differentiable Tree-Structured Models for Deep Reinforcement Learning', Farquhar et al 2017"), Farquhar et al 2017 (deep model-based planning; despite GPU VRAM limiting them to depth-2/3 at most, still helpful) #. ["A Survey of Monte Carlo Tree Search (MCTS) Methods"](https://repository.essex.ac.uk/4117/1/MCTS-Survey.pdf), Browne et al 2012; ["A Tutorial on Thompson Sampling"](https://arxiv.org/abs/1707.02038), Russo et al 2017 #. ["Deep Reinforcement Learning that Matters"](https://arxiv.org/abs/1709.06560), Henderson et al 2017 **Statistics/meta-science**: #. ["Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children"](/doc/statistics/bias/publication/2016-pica.pdf), Pica et al 2016 (>35000 children subjected to useless human experimentation annually in the USA. I'm glad the bioethicists and IRBs are tackling the *real* problems, like what happens to leftover embryos or whether genetic engineering might insult the disabled or whether enough community meetings have been held & all "stakeholders" properly informed.) #. ["Is the staggeringly profitable business of scientific publishing bad for science?"](https://www.theguardian.com/science/2017/jun/27/profitable-business-scientific-publishing-bad-for-science "It is an industry like no other, with profit margins to rival Google—and it was created by one of Britain's most notorious tycoons: Robert Maxwell.") #. ["Proceeding From Observed Correlation to Causal Inference: The Use of Natural Experiments"](/doc/statistics/causality/2007-rutter.pdf), Rutter 2007 #. ["A long journey to reproducible results: Replicating our work took four years and 100,000 worms but brought surprising discoveries"](https://www.nature.com/articles/548387a) (background to [Lucanic et al 2017](https://www.nature.com/articles/ncomms14256 "Impact of genetic background and experimental reproducibility on identifying chemical compounds with robust longevity effects")) #. ["Daryl Bem Proved ESP Is Real---which means science is broken"](https://slate.com/health-and-science/2017/06/daryl-bem-proved-esp-is-real-showed-science-is-broken.html) (Apparently Bem was serious. But one man's _modus ponens_ is another man's _modus tollens_.) #. ["Reconstruction of a Train Wreck: How Priming Research Went off the Rails"](https://replicationindex.com/2017/02/02/reconstruction-of-a-train-wreck-how-priming-research-went-of-the-rails/) #. ["'Peer review' is younger than you think. Does that mean it can go away?"](https://sappingattention.blogspot.com/2017/09/peer-review-is-younger-than-you-think.html); ["Peer Review: The end of an error?"](https://www.the-tls.co.uk/articles/alternative-to-peer-review-essay-timothy-gowers/) #. ["How readers understand causal and correlational expressions used in news headlines"](/doc/statistics/causality/2017-adams.pdf), Adams et al 2017 (people do not understand the difference between correlation and causation) #. ["A Conceptual Introduction to Hamiltonian Monte Carlo"](https://arxiv.org/abs/1701.02434), Betancourt 2017 (HMC is critical to Bayesian neural networks & Stan) #. [[How Often Does Correlation=Causation]{.smallcaps}](/correlation "'How Often Does Correlation=Causality?', Branwen 2014")? ["Bias and high-dimensional adjustment in observational studies of peer effects"](https://arxiv.org/abs/1706.04692), Eckles & Bakshy 2017 (Standard correlational estimate w/controls overestimates effect of Facebook experiment by 320%, requires 3700 additional control variables to approximate the randomized effect.); ["Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment"](https://pdfs.semanticscholar.org/2576/fd36efa9be01a26269e94925283de306cd83.pdf), Blake et al 2014 (does online advertising [actually work](/banner#discussion)?) **Politics/religion**: #. ["Self-Censorship in Public Discourse: A Theory of 'Political Correctness' and Related Phenomena"](/doc/sociology/preference-falsification/1994-loury.pdf), Loury 1994 #. ["Sparks and Prairie Fires: A Theory of Unanticipated Political Revolution"](/doc/sociology/preference-falsification/1989-kuran.pdf), Kuran 1989 (Speaking of information cascades and common knowledge...); ["How Stalin Hid Ukraine's Famine From the World: In 1932 and 1933, millions died across the Soviet Union---and the foreign press corps helped cover up the catastrophe"](https://www.theatlantic.com/international/archive/2017/10/red-famine-anne-applebaum-ukraine-soviet-union/542610/) (A failed information cascade: all the Western journalists knew about Stalin's genocidal famine and failed economics, but even a front page expose in multiple newspapers based on scores of interviews was not enough to break their censorship.) #. [_Days of Rage: America's Radical Underground, the FBI, and the Forgotten Age of Revolutionary Violence _ review](https://status451.com/2017/01/20/days-of-rage/) #. ["PPE: the Oxford degree that runs Britain"](https://www.theguardian.com/education/2017/feb/23/ppe-oxford-university-degree-that-rules-britain "Oxford University graduates in philosophy, politics and economics make up an astonishing proportion of Britain's elite. But has it produced an out-of-touch ruling class?"); ["The unrecognised simplicities of effective action #2: 'Systems engineering' and 'systems management'---ideas from the Apollo programme for a 'systems politics'"](https://dominiccummings.files.wordpress.com/2017/02/201702-effective-action-2-systems-engineering-to-systems-politics.pdf "‘The unrecognised simplicities of effective action #2: 'Systems engineering' and 'systems management'—ideas from the Apollo programme for a `systems politics`’, Cummings 2017"), Cummings 2017 (what should politics look like in the post-atomic age of existential risk?) #. ["The Dark Enlightenment"](https://www.thedarkenlightenment.com/the-dark-enlightenment-by-nick-land/), Nick Land #. ["Non-Communication at GE: The Impacted Philosophers"](/doc/economics/1969-brooks-businessadventures-ch7-noncommunicationge.pdf), pg111--124, ch7 of [_Business Adventures: Twelve Classic Tales from the World of Wall Street_](https://www.amazon.com/Business-Adventures-Twelve-Classic-Street/dp/1497644895), Brooks 1969 (the GE price-fixing scandal: emergent conspiracies from plausible denialability) #. ["The High Cost of Not Doing Experiments"](https://behavioralscientist.org/mindware-the-high-cost-of-not-doing-experiments/), Nisbett 2015 #. ["The World Might Be Better Off Without College for Everyone: Students don't seem to be getting much out of higher education"](https://www.theatlantic.com/magazine/archive/2018/01/whats-college-good-for/546590/) #. [Robert Caro on political power and Lyndon Johnson](/doc/history/2016-caro.html "Robert Caro, The Art of Biography No. 5") #. [66 failed social interventions](https://80000hours.org/2012/08/social-interventions-gone-wrong/); ["Randomized Controlled Trial of the Metropolitan Police Department Body-Worn Camera Program"](https://bwc.thelab.dc.gov/)/["A Big Test of Police Body Cameras Defies Expectations"](https://www.nytimes.com/2017/10/20/upshot/a-big-test-of-police-body-cameras-defies-expectations.html) (A large pre-registered randomized trial of police bodycams shows tiny effects at best despite extremely promising initial results in other places & experiments. [Rossi's _Iron Law of Evaluation_](/doc/sociology/1987-rossi "'The Iron Law Of Evaluation And Other Metallic Rules', Rossi 2012"): "The expected value of any net impact assessment of any large scale social program is zero"; the _Stainless Steel Law_: "The better designed the impact assessment of a social program, the more likely is the resulting estimate of net impact to be zero.") **Psychology**: #. ["Why _g_ Matters: The Complexity of Everyday Life"](/doc/iq/ses/1997-gottfredson.pdf "'Why g matters: The complexity of everyday life', Gottfredson 1997"), Gottfredson 1997 #. ["Does High Self-esteem Cause Better Performance, Interpersonal Success, Happiness, or Healthier Lifestyles?"](https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.508.2792&rep=rep1&type=pdf "'Does High Self-Esteem Cause Better Performance, Interpersonal Success, Happiness, Or Healthier Lifestyles?', Baumeister et al 2003"), Baumeister et al 2003; ["The Man Who Destroyed America's Ego: How a rebel psychologist challenged one of the 20th century's biggest-and most dangerous-idea"](/doc/sociology/2014-02-25-matter-themanwhodestroyedamericasego.html); ["'It was quasi-religious': the great self-esteem con"](https://www.theguardian.com/lifeandstyle/2017/jun/03/quasi-religious-great-self-esteem-con "In the 1980s, Californian politician John Vasconcellos set up a task force to promote high self-esteem as the answer to all social ills. But was his science based on a lie?") #. ["China launches brain-imaging factory: Hub aims to make industrial-scale high-resolution brain mapping a standard tool for neuroscience"](https://www.nature.com/articles/548268a) (Such data streams could also impact GWASes for intelligence and other cognitive traits: the brains will of course be genotyped and available for GWAS, so the data will be ready and waiting for hierarchical and SEM methods which fractionate intelligence. It is worth noting that the UK Biobank---the gift that keeps on giving---intends to fMRI up to 100,000 of its participants, which would be a good complement to these connectomes, as its current dataset is underpowered eg. [Wigmore et al 2017](https://www.nature.com/articles/tp2017148 "Do regional brain volumes and major depressive disorder share genetic architecture? A study of Generation Scotland (n=19 762), UK Biobank (n=24 048) and the English Longitudinal Study of Ageing (n=5766)")) #. ["The Effects of Education, Personality, and IQ on Earnings of High-Ability Men"](/doc/iq/ses/2011-gensowski.pdf), Gensowski et al 2011 #. [On child psychopathy](https://www.theatlantic.com/magazine/archive/2017/06/when-your-child-is-a-psychopath/524502/); ["The 1% of the population accountable for 63% of all violent crime convictions"](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3969807/), Falk et al 2013; ["Common psychiatric disorders [and violent crime] share the same genetic origin: a multivariate sibling study of the Swedish population"](/doc/genetics/heritable/correlation/2015-pettersson.pdf "'Common psychiatric disorders share the same genetic origin: a multivariate sibling study of the Swedish population', Pettersson et al 2015"), Pettersson et al 2015 #. ["Who Buried Paul?"](http://ludix.com/moriarty/paul.html) (A fun retrospective on the ["Paul McCartney is actually dead" Beatles conspiracy theory](https://en.wikipedia.org/wiki/Paul_is_dead) which, if you're like me, you've never heard of before but was apparently quite a thing. Featuring conspiracy theorists literally connecting the dots and seeing stars.) #. ["Does Far Transfer Exist? Negative Evidence From Chess, Music, and Working Memory Training"](https://journals.sagepub.com/doi/full/10.1177/0963721417712760), Sala & Gobet 2017 #. ["Practice Does Not Make Perfect: No Causal Effect of Music Practice on Music Ability"](/doc/genetics/heritable/correlation/2014-mosing.pdf), Mosing et al 2014 #. ["Multiplying 10-digit numbers using Flickr: The power of recognition memory"](https://people.csail.mit.edu/andyd/rec_method.pdf), Drucker 2010 **Biology**: #. ["The Fireplace Delusion"](https://www.samharris.org/blog/the-fireplace-delusion); ["Wood-smoke health effects: a review"](https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.510.4296&rep=rep1&type=pdf), Naeher et al 2007 (the [Global Burden of Disease](https://en.wikipedia.org/wiki/Global_Burden_of_Disease_Study) estimate for poor countries is that 7.7% of all DALYs lost is [due to chronic & 'lower respiratory infections'](https://vizhub.healthdata.org/gbd-compare/#settings=1c5235ed0e4875665b1e2005644f6a7694b65e96), more than either HIV or malaria. Happy holidays.) #. ["The US President’s Malaria Initiative and under-5 child mortality in sub-Saharan Africa: A difference-in-differences analysis"](https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1002319), Jakubowski et al 2017 #. ["We Used Terrible Science to Justify Smoking Bans: Will we look at the new evidence for long enough to at least consider whether we've gone too far?"](https://slate.com/technology/2017/02/secondhand-smoke-isnt-as-bad-as-we-thought.html) #. ["Lithium in Drinking Water and Incidence of Suicide: A Nationwide Individual-Level Cohort Study with 22 Years of Follow-Up"](https://www.mdpi.com/1660-4601/14/6/627), Knudsen et al 2017; ["Lithium in drinking water and the incidence of bipolar disorder: A nation-wide population-based study"](/doc/psychiatry/bipolar/lithium/2017-kessing.pdf), Kessing et al 2017 (Two major blows to the lithium/drinking-water hypothesis) #. ["Responsiveness of cats (_Felidae_) to silver vine (Actinidia polygama), Tatarian honeysuckle (_Lonicera tatarica_), valerian (_Valeriana officinalis_) and catnip (_Nepeta cataria_)"](https://bmcvetres.biomedcentral.com/articles/10.1186/s12917-017-0987-6 "'Responsiveness of cats (Felidae) to silver vine (Actinidia polygama), Tatarian honeysuckle (Lonicera tatarica), valerian (Valeriana officinalis) and catnip (Nepeta cataria)', Bol et al 2017"), Bol et al 2017 #. ["Mapping the Human Exposome: It's now possible to map a person's lifetime exposure to nutrition, bacteria, viruses, and environmental toxins-which profoundly influence human health"](https://nautil.us/mapping-the-human-exposome-236726/); ["Numerous uncharacterized and highly divergent microbes which colonize humans are revealed by circulating cell-free DNA"](/doc/genetics/heritable/2017-kowarsky.pdf), Kowarsky et al 2017 ([media](https://www.sciencedaily.com/releases/2017/08/170823090945.htm "More than 99% of the microbes inside us are unknown to science: A survey of DNA fragments circulating in the blood suggests the microbes living within us are vastly more diverse than previously known. In fact, 99% of that DNA has never been seen before."); towards finding the nonshared-environment component: taking the Gloomy Hypothesis seriously, we are going to need GWAS-scale approaches to measuring pollutants & infections & stressors to find the actual causal agents, instead of the get-rich-quick schemes which dominate epidemiology.) #. ["Metformin alters the gut microbiome of individuals with treatment-naive type 2 diabetes, contributing to the therapeutic effects of the drug"](https://agingfree.org/Portals/0/xBlog/uploads/2017/5/24/Metformin%20alters%20the%20gut%20microbiome%20of%20individuals.pdf), Wu et al 2017 #. ["Sex Differences In The Adult Human Brain: Evidence From 5,216 UK Biobank Participants"](https://www.biorxiv.org/content/10.1101/123729.full "'Sex differences in the adult human brain: Evidence from 5,216 UK Biobank participants', Ritchie et al 2017"), Ritchie et al 2017 #. ["Why does drug resistance readily evolve but vaccine resistance does not?"](https://rspb.royalsocietypublishing.org/content/284/1851/20162562), Kennedy & Read 2017 **Technology**: #. ["How a Dorm Room _Minecraft_ Scam Brought Down the Internet"](https://www.wired.com/story/mirai-botnet-minecraft-scam-brought-down-the-internet/) (So Mirai was developed to... extort _Minecraft_ servers? 2017 is truly beyond parody. Also, we're doomed.) #. [Survey of P=NP results and progress](https://www.scottaaronson.com/papers/pnp.pdf "‘P≟NP’, Aaronson 2016"), Aaronson 2016 #. ["Don't Worry---It Can't Happen"](/doc/existential-risk/1940-sciam-harrington-nuclearweapons-dontworryitcanthappen.pdf), Harrington, _Scientific American_ 1940 #. ["TrueBit: A scalable verification solution for blockchains"](https://people.cs.uchicago.edu/~teutsch/papers/truebit.pdf), Teutsch & Reitwiessner 2017 (Very complex but interesting scheme for safely outsourcing arbitrarily big computations on blockchains) #. `filfre.net`: see [June link selection](/newsletter/2017/06#links) #. ["Cryptology and Physical Security: Rights Amplification in Master-Keyed Mechanical Locks"](https://eprint.iacr.org/2002/160.pdf), Blaze 2003 (cryptographic attacks offline; see also Blaze 2004a ["Safecracking for the computer scientist"](http://leipper.org/manuals/zip-fill/safelocks_for_compscientist.pdf), [Blaze 2004b](https://www.mattblaze.org/papers/humancambridgepreproc.pdf "Toward a Broader View of Security Protocols")) #. ["When Will The Earth Try to Kill Us Again?"](https://arstechnica.com/science/2017/11/when-will-the-earth-try-to-kill-us-again/) (reviewing the latest work on volcanic cycles and mass-extinction mechanisms) #. ["Computational Complexity of Air Travel Planning"](http://www.demarcken.org/carl/papers/ITA-software-travel-complexity/ITA-software-travel-complexity.pdf), De Marcken 2003 / ITA Software (Airline ticket search is not just NP-hard or worse, but undecidable.) #. ["Books 1923–1941 Now Liberated!"](https://blog.archive.org/2017/10/10/books-from-1923-to-1941-now-liberated/), Internet Archive; ["Creating a Last Twenty (L20) Collection: Implementing §108(H) in Libraries, Archives and Museums"](/doc/economics/copyright/2017-gard.pdf "'Creating a Last Twenty (L20) Collection: Implementing §108(h) in Libraries, Archives and Museums', Gard 2017"), Gard 2017. (A takes an unexpectedly bold step towards ending the orphan copyright [deadweight](/doc/economics/copyright/index) problem by exploiting a copyright provision/loophole I've never even heard of before: §108(h) of the 1976 Copyright Right Act, allowing libraries to legally scan & distribute works in their final 20 years of copyright which are not in "normal commercial exploitation" ie hard to get, to an unspecified degree.) #. [Falsehoods Programmers Believe About X](https://github.com/kdeldycke/awesome-falsehood) **Economics**: #. [the moral imperative of economic growth]{.smallcaps}: #. ["How big a deal was the Industrial Revolution?"](https://lukemuehlhauser.com/industrial-revolution/) (the Industrial Revolution---the only important event in the history of human welfare.) #. ["Stubborn Attachments: A Vision for a Society of Free, Prosperous, and Responsible Individuals"](https://web.archive.org/web/20171030232756/https://medium.com/stubborn-attachments/stubborn-attachments-full-text-8fc946b694d) (Tyler Cowen) #. ["Cornucopia: The Pace of Economic Growth in the Twentieth Century"](/doc/economics/2000-delong.pdf "'Cornucopia: The Pace of Economic Growth in the 20th Century', DeLong 2000"), DeLong 2000 #. ["99 Reasons 2017 Was A Great Year: If you're feeling despair about the fate of humanity in the 21st century, you might want to reconsider."](https://medium.com/future-crunch/99-reasons-2017-was-a-good-year-d119d0c32d19) (2017: between the steady improvements across the board on almost all metrics of health and wealth and tech and violence, and population growth, 2017 saw perhaps the greatest increase in utility in the history of the human species---just like 2016 before it, and 2015, and 2014...) #. ["Back in the USSR: What life was like in the Soviet Union"](https://www.adamsmith.org/research/back-in-the-ussr) #. ["Property Is Another Name for Monopoly: Facilitating Efficient Bargaining with Partial Common Ownership of Spectrum, Corporations, and Land"](https://www.law.nyu.edu/sites/default/files/upload_documents/Property%20Monopoly.pdf), Posner & Weyl 2016 #. ["Algorithmic Entities"](https://openscholarship.wustl.edu/cgi/viewcontent.cgi?article=6319&context=law_lawreview), LoPucki 2017 ([Bayern 2016](/doc/ai/2016-bayern.pdf "The Implications of Modern Business–Entity Law for the Regulation of Autonomous Systems"); decentralized autonomous corporations are doable _de jure_ and not just _de facto_.) #. ["Amazon's Antitrust Paradox"](https://www.yalelawjournal.org/note/amazons-antitrust-paradox), Khan 2017 #. ["Economies of density in e-commerce: a study of Amazon's fulfillment center network"](/doc/economics/2017-houde.pdf), Houde et al 2017 (Amazon's sales tax vs shipping cost tradeoff) #. ["Are Ideas Getting Harder to Find?"](/doc/economics/2020-bloom.pdf), Bloom et al 2020 #. ["Islam and Economic Performance: Historical and Contemporary Links"](https://sites.duke.edu/timurkuran/files/2017/09/Islam-Economic-Performance-Kuran-JEL-in-press.pdf), Kuran 2018 (More on perpetuities and the harms of long-term charities) #. ["Industrial Espionage and Productivity"](/doc/economics/2020-glitz.pdf), Glitz & Meyersson 2017 (Why do countries like East Germany or China engage in so much industrial espionage? Because it works & helps compensate for their own inefficiency.) #. ["The High-Cost, High-Risk World of Modern Pet Care: A wave of corporatization is hitting the veterinary industry, but does a one-size-fits-all approach work?"](https://www.bloomberg.com/news/features/2017-01-05/when-big-business-happens-to-your-pet) (more importantly: why is this model successful in the most free market possible for healthcare?) #. ["The Common Law Corporation: The Power of the Trust in Anglo-American Business History"](https://corpgov.law.harvard.edu/2017/01/31/the-common-law-corporation-the-power-of-the-trust-in-anglo-american-business-history/) (was the limited-liability corporation necessary?) **Philosophy**: #. ["On the Impossibility of Supersized Machines"](https://arxiv.org/abs/1703.10987), Garfinkel et al 2017; ["G.K. Chesterton on AI Risk"](https://slatestarcodex.com/2017/04/01/g-k-chesterton-on-ai-risk/); ["A Thinking Ape's Critique of Trans-Simianism"](https://dresdencodak.com/2009/05/15/a-thinking-apes-critique-of-trans-simianism-repost/) #. ["How To Be Good: An Oxford philosopher thinks he can distill all morality into a formula. Is he right?"](https://www.newyorker.com/magazine/2011/09/05/how-to-be-good) (in memory of [Derek Parfit](https://en.wikipedia.org/wiki/Derek_Parfit)) #. ["Underprotection of Unpredictable Statistical Lives Compared to Predictable Ones"](/doc/existential-risk/2016-lipsitch.pdf), Lipsitch et al 2016 #. [Effective Altruism Global 2017 conference: SSC's review](https://slatestarcodex.com/2017/08/16/fear-and-loathing-at-effective-altruism-global-2017/) #. ["What Do Philosophers Believe?"](/doc/philosophy/epistemology/2014-bourget.pdf), Bourget & Chalmers 2013 #. ["Carvaka"](https://web.archive.org/web/20020312064520/https://www.humanistictexts.org/carvaka.htm) #. [Mike Darwin on animal research, moral cowardice, and reasoning in an uncaring universe](https://www.lesswrong.com/posts/ghtsPkTQ7JhZtjjsB/mike-darwin-on-animal-research-moral-cowardice-and-reasoning) #. ["Wireheading Done Right: Stay Positive Without Going Insane"](https://qualiacomputing.com/2016/08/20/wireheading_done_right/) (Qualia Computing) #. ["Simon Browne: the soul-murdered theologian"](/doc/psychology/1996-berman.pdf), Berman 1996 (["The Zombie Preacher of Somerset"](https://www.lesswrong.com/posts/Fy2b55mLtghd4fQpx/the-zombie-preacher-of-somerset)) **Misc**: #. ["The Great Moon Hoax"](https://hoaxes.org/archive/permalink/the_great_moon_hoax) (early science and Natural Theology predicted life was abundant throughout the solar system and universe; instead, we see a Great Silence) #. [Astronauts after walking on the moon](https://www.lrb.co.uk/the-paper/v27/n17/steven-shapin/what-did-you-expect "What did you expect? The banality of moon-talk"); ["This Warrior of a Dead World---Gene Wolfe's literary portrait of Neil Armstrong"](http://silkandhornheresy.blogspot.co.uk/2012/08/this-warrior-of-dead-world-gene-wolfes.html) **Fiction**: #. ["Alpha (A translation of _Genesis_ 1)"](https://llamasandmystegosaurus.blogspot.com/2017/05/alpha.html) (`word2vec` for computer-assisted creation of rhyming definitions & Book of Genesis with only words starting with "a") #. [A history of prog rock](https://slate.com/culture/2012/08/history-of-prog-the-nice-emerson-lake-palmer-and-other-bands-of-the-1970s.html) #. ["The Poet and the Politician: Fujiwara no Teika and the Compilation of the _Shinchokusenshu_"](/doc/japan/poetry/teika/1998-smits.pdf "'The Poet and the Politician: Teika and the Compilation of the Shinchokusenshū', Smits 1998"), Smits 1998 #. ["If You Read Closely: Aoi Hiragi's _Whisper of the Heart_ on Page and Screen"](https://wondersinthedark.wordpress.com/2012/09/01/if-you-read-closely-aoi-hiragis-whisper-of-the-heart-on-page-and-screen/) #. [The _Iliad_ as Lawsuit](/doc/fiction/poetry/2011-yvain-iliadaslawsuit.html) ## Books **Nonfiction**: #. [_Selected Non-Fictions_](https://www.amazon.com/Borges-Selected-Non-Fictions-Jorge-Luis/dp/0140290117), [Jorge Luis Borges](https://en.wikipedia.org/wiki/Jorge_Luis_Borges) ([July selection](/newsletter/2017/07#links)) #. [_Site Reliability Engineering: How Google Runs Production Systems_](https://sre.google/sre-book/table-of-contents/) ([January review](/newsletter/2017/01#books)) #. [_The Playboy Interview: Volume II_](https://www.amazon.com/002-Interview-Barry-G-Golson/dp/0399507698) #. [_Artificial Life_](/doc/ai/1992-levy-artificiallife.pdf "‘Artificial Life: A Report from the Frontier Where Computers Meet Biology’, Levy 1992"), Levy #. [_Possible Worlds and Other Essays_](https://www.fadedpage.com/showbook.php?pid=20160325), [J.B.S. Haldane](https://en.wikipedia.org/wiki/J._B._S._Haldane) 1927 #. [Annual Berkshire Hathaway letters](https://www.berkshirehathaway.com/letters/letters.html) of [Warren Buffett](https://en.wikipedia.org/wiki/Warren_Buffett) #. [_Tokyo: A Certain Style_](/doc/japan/art/1997-tsuzuki-tokyoacertainstyle.pdf "'Tokyo: A Certain Style', Tsuzuki 1997") #. [_The Grand Strategy of the Roman Empire: From the First Century CE to the Third_](https://www.amazon.com/Grand-Strategy-Roman-Empire-Century/dp/1421419459/), Luttwak 2016 #. [_Moon Dust: In Search of the Men Who Fell to Earth_](https://www.amazon.com/Moondust-Search-Men-Fell-Earth/dp/0007155425), Smith 2005 **Fiction**: #. [_Unsong_](https://unsongbook.com/ "'Unsong', Alexander 2015"), Scott Alexander #. [_Unforgotten Dreams: Poems by the Zen monk Shōtetsu_](/doc/japan/poetry/shotetsu/1997-carter-shotetsu-unforgottendreams.pdf "'Unforgotten Dreams: Poems by the Zen Monk Shōtetsu', Shōtetsu & Carter 1997"), Steven D. Carter #. [_The Anubis Gates_](https://en.wikipedia.org/wiki/The_Anubis_Gates), [Tim Powers](https://en.wikipedia.org/wiki/Tim_Powers) ([January review](/newsletter/2017/01#books)) #. [_Sunset in a Spiderweb: Sijo Poetry of Ancient Korea_](https://www.amazon.com/Sunset-Spider-Poetry-Ancient-Korea/dp/0030120713/), Baron & Kim 1974 ## TV/movies Nonfiction movies: #. [_Amy_](https://en.wikipedia.org/wiki/Amy_\(2015_film\)) (2015; [June review](/review/movie#amy)) #. [_The Great Happiness Space_](https://en.wikipedia.org/wiki/The_Great_Happiness_Space) ([November review](/review/movie#the-great-happiness-space)) **Fiction**:
#. [_Breaking Bad_](https://en.wikipedia.org/wiki/Breaking_Bad) ([May review](/review/movie#breaking-bad)) #. [_Blade Runner 2049_](https://en.wikipedia.org/wiki/Blade_Runner_2049) ([October review](/review/movie#blade-runner-2049)) #. [_L.A. Confidential_](https://en.wikipedia.org/wiki/L.A._Confidential_\(film\)) #. [_Hackers_](https://en.wikipedia.org/wiki/Hackers_\(film\)) (1995; [January review](/review/movie#hackers)) #. [_Once Upon A Time In The West_](https://en.wikipedia.org/wiki/Once_Upon_a_Time_in_the_West) ([February review](/newsletter/2017/02#one-upon-a-time-in-the-west)) #. [_All About Eve_](https://en.wikipedia.org/wiki/All_About_Eve) ([June review](/review/movie#all-about-eve)) #. [_Cool Hand Luke_](https://en.wikipedia.org/wiki/Cool_Hand_Luke) #. [_The Terminator_](https://en.wikipedia.org/wiki/The_Terminator) #. [_10 Cloverfield Lane_](https://en.wikipedia.org/wiki/10_Cloverfield_Lane) ([March review](/newsletter/2017/03#books))
**Anime**: #. [_The Tale of the Princess Kaguya_](https://en.wikipedia.org/wiki/The_Tale_of_the_Princess_Kaguya_\(film\)) (2013; [review](/review/anime#the-tale-of-the-princess-kaguya)) #. [_Kubo and the Two Strings_](https://en.wikipedia.org/wiki/Kubo_and_the_Two_Strings) (2016; [January review](/review/anime#kubo-and-the-two-strings)) #. [_Fullmetal Alchemist: Brotherhood_](https://en.wikipedia.org/wiki/Fullmetal_Alchemist:_Brotherhood) ([May review](/review/anime#fma-brotherhood)) #. [_Zootopia_](https://en.wikipedia.org/wiki/Zootopia)