November 2018 gwern.net newsletter with links on genetics, CRISPR, political change, oil; 1 book and 1 movie review.
2018-10-19–2021-01-09
finished
certainty: log
importance: 0
This is the November 2018 edition of the Gwern.net newsletter; previous, October 2018 (archives). This is a summary of the revision-history RSS feed, overlapping with my Changelog & /
Writings
- Cat Sense, Bradshaw 2013: Are We Good Owners? (on cat psychology, genetics, domestication, & dysgenics)
- Embryo selection analyses: FAQ, multi-stage selection, chromosome/
gamete selection , optimal search of batches, & robustness to error in utility weights - “Oh Deer: Could Deer Evolve to Avoid Car Accidents?”
- “Urban Area Cost-of-Living as Big Tech Moats & Employee Golden Handcuffs” (speculations on Bay Area real estate & SV’s future)
- My hardware/
software setup
Media
Links
Genetics:
Everything Is Heritable:
- “Post-genomic behavioral genetics: From revolution to routine”, Ashbrook et al 2017
- “Novel genome-wide associations for suicidality in UK Biobank, genetic correlation with psychiatric disorders and polygenic association with completed suicide”, Strawbridge et al 2018
- “Giant study links DNA variants to same-sex behavior”
- “Using genetics to examine a general liability to childhood psychopathology”, Riglin et al 2018 (if the ‘autism’ PGS is real & correlates with IQ, why doesn’t it correlate with other psychiatric disorders like it should?)
- “Trans-ancestral GWAS of alcohol dependence reveals common genetic underpinnings with psychiatric disorder”, Walters et al 2018
- “Understanding the role of bitter taste perception in coffee, tea and alcohol consumption through Mendelian randomization”, Ong et al 2018
- “A newly discovered tea plant is caffeine-free”: Jin et al 2018 (towards drinkable decaf tea?)
- the betas will continue until morale improves: Veritas 30x WGS $200 sale; Ancestry.com hits n > 14m; Ireland to WGS 10% of population
Recent Evolution:
- “Neutral Theory of Evolution Challenged by Evidence for DNA Selection”
- “Polygenicity of complex traits is explained by negative selection”, O’Connor et al 2018
- “Feral Cats: Their Role in the Population Dynamics of Felis catus”, Bradshaw et al 1999 (dysgenics on cat domestication?)
- “The dumbo rat mutation and human analogues” (a pleiotropic mutation for domesticity in pet rats? cf foxes/
domestication syndrome) - “Assortative Mating, Class, and Caste”, Harpending & Cochran 2015; “Some Uses of Models of Quantitative Genetic Selection in Social Science”, Weight & Harpending 2017
Engineering:
- “Chinese researcher claims first gene-edited babies”; “Gene-editing Chinese scientist kept much of his work secret”; “Amid uproar, Chinese scientist defends creating gene-edited babies”; “The first CRISPRed babies are here, what’s next? 1. Develop international policy. 2. Communicate responsibly. 3. Recognize that editing is here to stay. 4. A global, collaborative project to edit”
- “Despite CRISPR baby controversy, Harvard University will begin gene-editing sperm”
- “Embryo Biopsies for Genomic Selection”, Mullaart & Wells 2018 (embryo selection is being applied to Holstein cattle)
- “Engineering yeast megachromosomes: The story of how we engineered ‘megachromosomes’ and studied the contribution of chromosome fusion to reproductive isolation among laboratory yeast strains”
- “Is Continued Genetic Improvement of Livestock Sustainable?”, Hill 2016 (yes)
- “One Hundred Years of Statistical Developments in Animal Breeding”, Gianola & Rosa 2015
AI:
- “Reward learning from human preferences and demonstrations in Atari”, Ibarz et al 2018
- “Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning”, Poplin et al 2018 (age/
gender/ smoking/ blood pressure/ diabetes/ heart attacks—predicted from eye photographs using CNNs) - Style2Paints NN: V4 now released (paper for V3; multiple layers of anime lineart coloring now supported: flat colors, then adding lines, then color gradients/
shading, then illumination. Uses Danbooru2017 for training data via data-augmentation/ corruption to train recoloring. Discussion: 1/ 2/ Twitter) - “Bonsai: Resource-efficient Machine Learning in 2KB RAM for the Internet of Things”, Kumar et al 2017
- “Towards Deep Modeling of Music Semantics using EEG Regularizers”, Raposo et al 2017
- “Neural Population Control via Deep Image Synthesis”, Bashivan et al 2018 (towards human adversarial examples?)
- “Can computer science algorithms show us how to live better, or is that a false hope?” (a discussion with Brian Christian of Algorithms to Live By: explore vs exploit, optimal stopping, simulated annealing)
Statistics/
- “Many Labs 2: Investigating Variation in Replicability Across Sample and Setting”, Klein et al 2018 (28 targets, k = 60, n = 7000 each, Registered Reports: 14/
28 replication rate w/ few moderators/ country differences & remarkably low heterogeneity) - Eva Vivalt on development economics & charities (high variance in development study effects of ±100% in replications, expert elicitation of study quality & informative priors, publication bias/
p-hacking) - “A Star Surgeon Left a Trail of Dead Patients—and His Whistleblowers Were Punished” (organizational incentives & science)
- “How Facebook and Twitter could be the next disruptive force in clinical trials”
- “Causal Inference Animated Plots” in R (animations of: “Controlling for a Variable, Matching on a Variable, Instrumental Variables, Fixed Effects, Difference-in-Difference, & Regression Discontinuity.”)
- “Five-Year Follow-up of Antibiotic Therapy for Uncomplicated Acute Appendicitis in the APPAC Randomized Clinical Trial”, Salminen et al 2018 (media; most appendicitis surgeries unnecessary—the question is never whether running an RCT is ethical, the question is how can not running it possibly be ethical?)
Politics/
- “Dagger and Swagger: The History of Russian Terrorism” (revolutionary terror and literature; see also “Toward a [J-curve] theory of revolution”, Davies 1962)
- “How the GOP Gave Up on Porn”; “Legalizing Marijuana and Gay Marriage Seemed Impossible—but losing taught libertarians how to win” (postmortems)
- “How We All Failed In Performance Contracting”, Page 1972 (social impact bonds before social impact bonds: killed by failure in one of the largest education randomized experiments ever run—6 contractors, 18 school districts, and 25,000 students)
- Synanon: “Shaved Heads, Snipped Tubes, Imperial Marines, and Dope Fiends” (the 1960s ex-AA drug rehab program that became a cult)
- “Forging Islamic science: Fake miniatures depicting Islamic science have found their way into the most august of libraries and history books. How?”
- “Names for the Nameless”, Metzger 1980 (Biblical fanfiction)
- “When a Stranger Decides to Destroy Your Life” (see also “Sort By Controversial”: a Halloween Tale)
Psychology/
- Lady Mary Wortley Montagu
- “Why Are Young People Having So Little Sex? Despite the easing of taboos and the rise of hookup apps, Americans are in the midst of a sex recession”
- “How to Control a Machine with Your Brain: A scientist’s work linking minds and machines helps a paralyzed woman escape her body”
- “Cognitive differences between orangutan species: a test of the cultural intelligence hypothesis”, Forss et al 2016
- “Physical Correlates Of Human Intelligence”, Jensen & Sinha 1993
- “Discovery of volatile biomarkers of Parkinson’s disease from sebum”, Trivedi et al 2018 (what other diseases could be smelt?)
- “Your personality data can do more: Items provide leverage for explaining the variance and co-variance of life outcomes”, Mottus et al 2018 (lasso on NEO-PI inventory items outperforms the latent Big Five scores)
- “Bracing for the Vanilla Boom: Some of Madagascar’s farmers, made wealthy by this year’s vanilla crop, will spend their cash in crazy ‘hot money’ sprees”
- Taxonomy of bragging
Technology:
- “The Epic Saga of The Well” (early forums: offline meetups, SJWs, stalkers, marriages)
- “Why Doctors Hate Their Computers: Digitization promises to make medical care easier and more efficient. But are screens coming between doctors and patients?”
- “Do Proteins Hold the Key to the Past? New methods are allowing a group of scientists to reexamine the world’s libraries and archives, in search of the hidden lives of authors”
- “The Great British (Industrial) Bake-Off”
- “Ancient Industrial Machinery” (on Roman technology)
- “How to Win Founders and Influence Everybody” (hidden female networkers in Silicon Valley: the case of Margit Wennmachers)
- “The Time Capsule That’s as Big as Human History” (the crowdsourced MOM ceramic tablet archive in a German salt mine)
- “In Japan, the Kit Kat Isn’t Just a Chocolate. It’s an Obsession.”
- “I Believe I Can Fry: How a mild-mannered database analyst became the undisputed king of the fair park fryers—and the master of a heart stopping new culinary movement”
Economics:
- “Fuel to the Fire: How a US biofuel law intended to reduce dependence on fossil fuels has unleashed an environmental disaster in Indonesia” (“This was what an American effort to save the planet looked like. It was startlingly efficient, extremely profitable and utterly disastrous.”); “An (Even More) Inconvenient Truth Why Carbon Credits For Forest Preservation May Be Worse Than Nothing” (fraudulent or useless carbon offsets)
- “Mexico’s Drug Cartels Are Moving Into the Gasoline Industry”
- “Knitting Community: Human and Social Capital in the Early Transition into Entrepreneurship”, Kim 2018 (quantifying social contagion/
peer-effects of innovation: knitting groups & novel knitting designs on Ravelry) - “Toward an Understanding of Learning by Doing: Evidence from an Automobile Assembly Plant”, Levitt et al 2013
- How Hollywood lobbying & Congress retroactively banned movie prediction markets
- “Stories From the Neopets Economy” (on inflation/
monetary policy, conspicuous consumption, arbitrage, & transaction costs) - Silk Road 1: ground-truth drug sale data (2011-02-06–2013-10-02, GX-940)
- “The Curse of the Honeycrisp Apple: Everyone’s favorite apple is leaving Northeastern orchards out on a limb” (Good.)
Philosophy:
- “Words”, Radiolab 2010 (language & abstraction: a deaf adult learning what words are for the first time; brain damage causing enlightenment, see also Martin 2013; <6yo children unable to understand directions like “left of the blue wall”)
- “Legalism in Chinese Philosophy”
Fiction:
- “The Hours: How Christian Marclay created the ultimate digital mosaic” (the making of The Clock, a 24h supercut; watching it: 1/
2) - “Time War /
/ , Yves CrossBriefing for Neolemurian Agents” - “Imperialism, Translation, Gunbuster”: “Introduction”/
“Episode One”/ “Episode Two—NSFW”/ “Episode Three”/ “Episode Four”/ “Episode Five”/ “Episode Six” (nationalist subtexts in Gainax anime) - “Oulipo Ends Where the Work Begins”
- “No Reservations: Narnia” (media; Anthony Bourdain does Narnia)
Books
Nonfiction:
- Cat Sense: How the New Feline Science Can Make You a Better Friend to Your Pet, Bradshaw 2013 (review)
- Well-Played 3.0, ed Davidson 2011 (good: “And if You Go Chasing Rabbits: The Inner Demons of American McGee’s Alice”; “The Neverhood; A Different Kind of Never Never Land. You Had Me at Claymation”; “Uncharted 2: Among Thieves—Becoming a Hero”; “The World Ends With You”; “The Opposite of Accessible: Street Fighter IV”; “Siren is the Scariest Game Ever Made”)
- Well Played 2.0: Video Games, Value and Meaning, ed Davidson 2010 (good: “Cloudmaker Days: A Memoir of the A.I. [ARG] Game”; “Resident Evil 4: The Mercenaries Mini-Game”; “Galcon”)
- Well Played vol 4 no 1, ed Davison 2015 (good: “Cause No Trouble: The Experience of”Serious Fun" in Papers, Please")
Film/TV
Live-action:
Music
MLP:
- “Wandering Eyes” (4everfreebrony; {2018}) [acoustic]
- “Rainbow Drum Guitar Violins Cover” (Koron Korak; {2018}) [instrumental rock]
- “Onward” (Jyc Row feat. Aloma Steele {2017}) [rock]
- “A Kirin Tale” (Daniel Ingram feat. Rachel Bloom; S8E23 {2018}) [musical]
- “Synthwave Lullaby” (Lorris {2018}) [synthwave/
trance]
Link Bibliography
Bibliography of page links in reading order (with annotations when available):
“October 2018 News”, (2018-09-23):
October 2018 gwern.net newsletter with 5 new posts, links on genetics/human evolution/AI/meta-science/history of tech, 2 book reviews, 2 movie reviews, 1 series review.
“Gwern.net newsletter archives”, (2013-12-01):
Newsletter tag: archive of all issues back to 2013 for the gwern.net newsletter (monthly updates, which will include summaries of projects I’ve worked on that month (the same as the changelog), collations of links or discussions from my subreddit, and book/movie reviews.)
“Changelog”, (2013-09-15):
This page is a changelog for Gwern.net: a monthly reverse chronological list of recent major writings/
changes/ additions. Following my writing can be a little difficult because it is often so incremental. So every month, in addition to my regular /
r/ subreddit submissions, I write up reasonably-interesting changes and send it out to the mailing list in addition to a compilation of links & reviews (archives).Gwern “/r/gwern subreddit”, (2018-10-01):
A subreddit for posting links of interest and also for announcing updates to gwern.net (which can be used as a RSS feed). Submissions are categorized similar to the monthly newsletter and typically will be collated there.
“Cat Psychology & Domestication: Are We Good Owners?”, (2018-11-03):
I review John Bradshaw’s book on cat psychology, Cat Sense, after difficulties dealing with my own cat. Bradshaw reviews the history of domestic cats from their apparent Middle Eastern origins as a small solitary desert predator to their domestication in Ancient Egypt where breeding millions of cats for sacrifice may have played a critical role (as opposed to any unique role as a vermin exterminator) through to the modern day and psychological studies of the learning abilities and personalities of cats, with particular emphasis on cat social skills in “cat colonies” & plasticity in kittenhood. As Bradshaw diagnoses it, these are responsible for what ability they have to modern pet life, even though they are not bred for this like dogs; every tame cat still has the feral cat in them, and are in many ways unsuited for contemporary living, with disturbing hints that human lack of selective breeding plus recent large-scale spay/
neuter population control efforts may be producing a subtle dysgenic effect on domestication, and this double neglect & backfire may be responsible for disturbingly high rates of cat maladaptation & chronic stress diseases. https:/
/ www.gwern.net/ Embryo-selection#multi-stage-selection https:/
/ www.gwern.net/ Embryo-selection#optimal-stoppingsearch https:/
/ www.gwern.net/ Embryo-selection#robustness-of-utility-weights “Oh Deer: Could Deer Evolve to Avoid Car Accidents?”, (2018-11-11):
Can deer evolve under the selection pressure of car accidents to learn to avoid roads? Probably, but it'll take a long time.
I’ve noticed while driving many deer corpses over the years. Cars seem like they could be a major source of deer mortality. If they are, deer might be evolving behavior to avoid cars. But deer/car accident rates appear stable or increasing (perhaps due to human population growth & construction). How fast would we expect to see any deer adaptation?
Looking at some of the mortality statistics, I model it as a liability threshold trait being selected on via truncation selection, and calculate some hypotheticals about whether and how fast they could adapt.
Teal deer: of course, but it’d be slow.
/
Notes#urban-area-cost-of-living-as-big-tech-moats-employee-golden-handcuffs -
Background: Suicide is a major issue for global public health. ‘Suicidality’ describes a broad clinical spectrum of thoughts and behaviours, some of which are common in the general population.
Methods: UK Biobank recruited ~0·5 million middle age individuals from the UK, of whom 157,000 completed an assessment of suicidality. Mutually exclusive groups were assessed in an ordinal genome-wide association study of suicidality: ‘no suicidality’ controls (n = 83,557); ‘thoughts that life was not worth living’ (n = 21,063); ‘ever contemplated self-harm’ (n = 13,038); ‘an act of deliberate self-harm in the past’ (n = 2,498); and ‘a previous suicide attempt’ (n = 2,666). Linkage of UK Biobank to death certification records identified a small sub-group of ‘completed suicide’ (n = 137).
Outcomes: We identified three novel genome-wide significant loci for suicidality (on Chromosomes 9, 11 and 13) and moderate-to-strong genetic correlations between suicidality and a range of psychiatric disorders, most notably depression (rg 0·81). Higher polygenic risk scores for suicidality were associated with increased risk of completed suicide relative to controls in an independent sub-group (n = 137 vs n = 5,330, OR 1·23, 95%CI 1·06 to 1·41, p = 0.03). Rs598046-G (chromosome 11) demonstrated a similar effect size and direction (p = 0·05) within a Danish suicidality study.
Interpretation: These findings have significant implications for our understanding of genetic vulnerability to suicidal thoughts and behaviours. Future work should assess the extent to which polygenic risk scores for suicidality, in combination with non-genetic risk factors, may be useful for stratified approaches to suicide prevention at a population level.
Funding: UKRI Innovation-HDR-UK Fellowship (MR/S003061/1). MRC Mental Health Data Pathfinder Award (MC_PC_17217).
https:/
/ www.sciencemag.org/ news/ 2018/ 10/ giant-study-links-dna-variants-same-sex-behavior “Using genetics to examine a general liability to childhood psychopathology”, (2018-11-21):
Background: Psychiatric disorders show phenotypic as well as genetic overlaps. Factor analyses of child and adult psychopathology have found that phenotypic overlaps largely can be explained by a latent general “p” factor that reflects general liability to psychopathology. We investigated whether shared genetic liability across disorders would be reflected in associations between multiple different psychiatric polygenic risk scores (PRS) and a ‘general psychopathology’ factor in childhood.
Methods: The sample was a UK, prospective, population-based cohort (ALSPAC), including data on psychopathology at age 7 (N = 8161) years. PRS were generated from large published genome-wide association studies.
Outcomes
The general psychopathology factor was associated with both schizophrenia PRS and attention-deficit/hyperactivity disorder (ADHD) PRS, whereas there was no strong evidence of association with major depressive disorder and autism spectrum disorder PRS. Schizophrenia PRS was also associated with a specific “emotional” problems factor.
Interpretation
Our findings suggest that genetic liability to schizophrenia and ADHD may contribute to shared genetic risks across childhood psychiatric diagnoses at least partly via the ‘general psychopathology’ factor. However, the pattern of observations could not be explained by a general “p” factor on its own.
Funding
This work was supported by the Wellcome Trust (204895/Z/16/Z).Introduction
https:/
/ www.wired.com/ story/ whole-genome-sequencing-cost-200-dollars/ https:/
/ www.businesswire.com/ news/ home/ 20181129005208/ en/ Ancestry-Breaks-November-Sales-Record “Polygenicity of complex traits is explained by negative selection”, (2018-09-18):
Complex traits and common disease are highly polygenic: thousands of common variants are causal, and their effect sizes are almost always small. Polygenicity could be explained by negative selection, which constrains common-variant effect sizes and may reshape their distribution across the genome. We refer to this phenomenon as flattening, as genetic signal is flattened relative to the underlying biology. We introduce a mathematical definition of polygenicity, the effective number of associated SNPs, and a robust statistical method to estimate it. This definition of polygenicity differs from the number of causal SNPs, a standard definition; it depends strongly on SNPs with large effects. In analyses of 33 complex traits (average N = 361k), we determined that common variants are ~4x more polygenic than low-frequency variants, consistent with pervasive flattening. Moreover, functionally important regions of the genome have increased polygenicity in proportion to their increased heritability, implying that heritability enrichment reflects differences in the number of associations rather than their magnitude (which is constrained by selection). We conclude that negative selection constrains the genetic signal of biologically important regions and genes, reshaping genetic architecture.
“Feral cats: their role in the population dynamics of Felis catus”, (1999-12):
The so-called domestic cat occupies a unique position within the truly domestic animals since it freely interbreeds with feral populations, and there is considerable gene flow in both directions. This is possible because the likelihood of an individual cat forming a relationship with people is strongly affected by its experiences during the socialisation period (3–8 weeks of age), although this does not preclude differences between owned and feral populations in the relative frequencies of alleles which affect social behaviour towards humans. We suggest a hitherto unconsidered reason why a separate domesticated population of cats (apart from pedigree breeds) has not yet emerged: the unusual and stringent nutrient requirements of the cat may historically have militated against successful breeding on a completely human-provided diet, and led to the retention of the ability to achieve a nutritionally complete diet by scavenging and/or hunting. More recently, the widespread availability of nutritionally complete manufactured foods and veterinary care in western countries appears to be leading towards a rapid change in the population dynamics and population genetics of both owned and feral cats. [Keywords: Domestication, Feral populations, Population dynamics, Cat]
“Domesticated silver fox”, (2020-12-27):
The domesticated silver fox is a form of the silver fox which has been to some extent domesticated under laboratory conditions. The silver fox is a melanistic form of the wild red fox. Domesticated silver foxes are the result of an experiment which was designed to demonstrate the power of selective breeding to transform species, as described by Charles Darwin in On the Origin of Species. The experiment explored whether selection for behaviour rather than morphology may have been the process that had produced dogs from wolves, by recording the changes in foxes when in each generation only the most tame foxes were allowed to breed. Many of the descendant foxes became both tamer and more dog-like in morphology, including displaying mottled or spotted coloured fur.
https:/
/ www.statnews.com/ 2018/ 11/ 28/ chinese-scientist-defends-creating-gene-edited-babies/ https:/
/ blogs.plos.org/ synbio/ 2018/ 11/ 30/ opinion-the-first-crispred-babies-are-here-whats-next/ “One Hundred Years of Statistical Developments in Animal Breeding”, (2014-11-03):
Statistical methodology has played a key role in scientific animal breeding. Approximately one hundred years of statistical developments in animal breeding are reviewed. Some of the scientific foundations of the field are discussed, and many milestones are examined from historical and critical perspectives. The review concludes with a discussion of some future challenges and opportunities arising from the massive amount of data generated by livestock, plant, and human genome projects.
“Reward learning from human preferences and demonstrations in Atari”, (2018-11-15):
To solve complex real-world problems with reinforcement learning, we cannot rely on manually specified reward functions. Instead, we can have humans communicate an objective to the agent directly. In this work, we combine two approaches to learning from human feedback: expert demonstrations and trajectory preferences. We train a deep neural network to model the reward function and use its predicted reward to train an DQN-based deep reinforcement learning agent on 9 Atari games. Our approach beats the imitation learning baseline in 7 games and achieves strictly superhuman performance on 2 games without using game rewards. Additionally, we investigate the goodness of fit of the reward model, present some reward hacking problems, and study the effects of noise in the human labels.
“Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning”, (2018-01-01):
Traditionally, medical discoveries are made by observing associations, making hypotheses from them and then designing and running experiments to test the hypotheses. However, with medical images, observing and quantifying associations can often be difficult because of the wide variety of features, patterns, colours, values and shapes that are present in real data. Here, we show that deep learning can extract new knowledge from retinal fundus images. Using deep-learning models trained on data from 284,335 patients and validated on two independent datasets of 12,026 and 999 patients, we predicted cardiovascular risk factors not previously thought to be present or quantifiable in retinal images, such as age (mean absolute error within 3.26 years), gender (area under the receiver operating characteristic curve (AUC) = 0.97), smoking status (AUC = 0.71), systolic blood pressure (mean absolute error within 11.23 mmHg) and major adverse cardiac events (AUC = 0.70). We also show that the trained deep-learning models used anatomical features, such as the optic disc or blood vessels, to generate each prediction.
“Style2Paints GitHub repository”, (2018-05-04):
Github repo with screenshot samples of style2paints, a neural network for colorizing anime-style illustrations (trained on Danbooru2018), with or without user color hints, which was available as an online service in 2018. style2paints produces high-quality colorizations often on par with human colorizations. Many examples can be seen on Twitter or the Github repo:
Example style2paints colorization of a character from Prison School style2paints has been described in more detail in “Two-Stage Sketch Colorization”, Zhang et al 2018:
Sketch or line art colorization is a research field with significant market demand. Different from photo colorization which strongly relies on texture information, sketch colorization is more challenging as sketches may not have texture. Even worse, color, texture, and gradient have to be generated from the abstract sketch lines. In this paper, we propose a semi-automatic learning-based framework to colorize sketches with proper color, texture as well as gradient. Our framework consists of two stages. In the first drafting stage, our model guesses color regions and splashes a rich variety of colors over the sketch to obtain a color draft. In the second refinement stage, it detects the unnatural colors and artifacts, and try to fix and refine the result.Comparing to existing approaches, this two-stage design effectively divides the complex colorization task into two simpler and goal-clearer subtasks. This eases the learning and raises the quality of colorization. Our model resolves the artifacts such as water-color blurring, color distortion, and dull textures.
We build an interactive software based on our model for evaluation. Users can iteratively edit and refine the colorization. We evaluate our learning model and the interactive system through an extensive user study. Statistics shows that our method outperforms the state-of-art techniques and industrial applications in several aspects including, the visual quality, the ability of user control, user experience, and other metric
“Two-stage Sketch Colorization”, (2018):
Sketch or line art colorization is a research field with significant market demand. Different from photo colorization which strongly relies on texture information, sketch colorization is more challenging as sketches may not have texture. Even worse, color, texture, and gradient have to be generated from the abstract sketch lines. In this paper, we propose a semi-automatic learning-based framework to colorize sketches with proper color, texture as well as gradient. Our framework consists of two stages. In the first drafting stage, our model guesses color regions and splashes a rich variety of colors over the sketch to obtain a color draft. In the second refinement stage, it detects the unnatural colors and artifacts, and try to fix and refine the result. Comparing to existing approaches, this two-stage design effectively divides the complex colorization task into two simpler and goal-clearer subtasks. This eases the learning and raises the quality of colorization. Our model resolves the artifacts such as water-color blurring, color distortion, and dull textures. We build an interactive software based on our model for evaluation. Users can iteratively edit and refine the colorization. We evaluate our learning model and the interactive system through an extensive user study. Statistics shows that our method outperforms the state-of-art techniques and industrial applications in several aspects including, the visual quality, the ability of user control, user experience, and other metrics.
https:/
/ reddit.com/ r/ anime/ comments/ 9yjl41/ ocfanart_created_a_bot_to_colorize_this_line/ https:/
/ nitter.net/ hashtag/ style2paints?f=tweets&vertical=default “Towards Deep Modeling of Music Semantics using EEG Regularizers”, (2017-12-14):
Modeling of music audio semantics has been previously tackled through learning of mappings from audio data to high-level tags or latent unsupervised spaces. The resulting semantic spaces are theoretically limited, either because the chosen high-level tags do not cover all of music semantics or because audio data itself is not enough to determine music semantics. In this paper, we propose a generic framework for semantics modeling that focuses on the perception of the listener, through EEG data, in addition to audio data. We implement this framework using a novel end-to-end 2-view Neural Network (NN) architecture and a Deep Canonical Correlation Analysis (DCCA) loss function that forces the semantic embedding spaces of both views to be maximally correlated. We also detail how the EEG dataset was collected and use it to train our proposed model. We evaluate the learned semantic space in a transfer learning context, by using it as an audio feature extractor in an independent dataset and proxy task: music audio-lyrics cross-modal retrieval. We show that our embedding model outperforms Spotify features and performs comparably to a state-of-the-art embedding model that was trained on 700 times more data. We further discuss improvements to the model that are likely to improve its performance.
“Neural Population Control via Deep Image Synthesis”, (2018-11-04):
Particular deep artificial neural networks (ANNs) are today’s most accurate models of the primate brain’s ventral visual stream. Here we report that, using a targeted ANN-driven image synthesis method, new luminous power patterns (i.e. images) can be applied to the primate retinae to predictably push the spiking activity of targeted V4 neural sites beyond naturally occurring levels. More importantly, this method, while not yet perfect, already achieves unprecedented independent control of the activity state of entire populations of V4 neural sites, even those with overlapping receptive fields. These results show how the knowledge embedded in today’s ANN models might be used to non-invasively set desired internal brain states at neuron-level resolution, and suggest that more accurate ANN models would produce even more accurate control.
https:/
/ 80000hours.org/ podcast/ episodes/ brian-christian-algorithms-to-live-by/ “Optimal stopping”, (2020-12-22):
In mathematics, the theory of optimal stopping or early stopping is concerned with the problem of choosing a time to take a particular action, in order to maximise an expected reward or minimise an expected cost. Optimal stopping problems can be found in areas of statistics, economics, and mathematical finance. A key example of an optimal stopping problem is the secretary problem. Optimal stopping problems can often be written in the form of a Bellman equation, and are therefore often solved using dynamic programming.
“Simulated annealing”, (2020-12-28):
Simulated annealing (SA) is a probabilistic technique for approximating the global optimum of a given function. Specifically, it is a metaheuristic to approximate global optimization in a large search space for an optimization problem. It is often used when the search space is discrete. For problems where finding an approximate global optimum is more important than finding a precise local optimum in a fixed amount of time, simulated annealing may be preferable to exact algorithms such as gradient descent, Branch and Bound.
“Many Labs 2: Investigating Variation in Replicability Across Sample and Setting”, (2019-11-19):
We conducted preregistered replications of 28 classic and contemporary published findings with protocols that were peer reviewed in advance to examine variation in effect magnitudes across sample and setting. Each protocol was administered to approximately half of 125 samples and 15,305 total participants from 36 countries and territories. Using conventional statistical significance (p < 0.05), fifteen (54%) of the replications provided evidence in the same direction and statistically significant as the original finding. With a strict significance criterion (p < 0.0001), fourteen (50%) provide such evidence reflecting the extremely high powered design. Seven (25%) of the replications had effect sizes larger than the original finding and 21 (75%) had effect sizes smaller than the original finding. The median comparable Cohen’s d effect sizes for original findings was 0.60 and for replications was 0.15. Sixteen replications (57%) had small effect sizes (< 0.20) and 9 (32%) were in the opposite direction from the original finding. Across settings, 11 (39%) showed significant heterogeneity using the Q statistic and most of those were among the findings eliciting the largest overall effect sizes; only one effect that was near zero in the aggregate showed significant heterogeneity. Only one effect showed a Tau > 0.20 indicating moderate heterogeneity. Nine others had a Tau near or slightly above 0.10 indicating slight heterogeneity. In moderation tests, very little heterogeneity was attributable to task order, administration in lab versus online, and exploratory WEIRD versus less WEIRD culture comparisons. Cumulatively, variability in observed effect sizes was more attributable to the effect being studied than the sample or setting in which it was studied.
“Scholarly peer review”, (2020-12-22):
Scholarly peer review is the process of subjecting an author's scholarly work, research, or ideas to the scrutiny of others who are experts in the same field, before a paper describing this work is published in a journal, conference proceedings or as a book. The peer review helps the publisher decide whether the work should be accepted, considered acceptable with revisions, or rejected.
https:/
/ 80000hours.org/ podcast/ episodes/ eva-vivalt-social-science-generalizability/ “Instrumental variables estimation”, (2020-12-22):
In statistics, econometrics, epidemiology and related disciplines, the method of instrumental variables (IV) is used to estimate causal relationships when controlled experiments are not feasible or when a treatment is not successfully delivered to every unit in a randomized experiment. Intuitively, IVs are used when an explanatory variable of interest is correlated with the error term, in which case ordinary least squares and ANOVA give biased results. A valid instrument induces changes in the explanatory variable but has no independent effect on the dependent variable, allowing a researcher to uncover the causal effect of the explanatory variable on the dependent variable.
“Difference in differences”, (2020-12-22):
Difference in differences is a statistical technique used in econometrics and quantitative research in the social sciences that attempts to mimic an experimental research design using observational study data, by studying the differential effect of a treatment on a 'treatment group' versus a 'control group' in a natural experiment. It calculates the effect of a treatment on an outcome by comparing the average change over time in the outcome variable for the treatment group, compared to the average change over time for the control group. Although it is intended to mitigate the effects of extraneous factors and selection bias, depending on how the treatment group is chosen, this method may still be subject to certain biases.
“Regression discontinuity design”, (2020-12-22):
In statistics, econometrics, political science, epidemiology, and related disciplines, a regression discontinuity design (RDD) is a quasi-experimental pretest-posttest design that elicits the causal effects of interventions by assigning a cutoff or threshold above or below which an intervention is assigned. By comparing observations lying closely on either side of the threshold, it is possible to estimate the average treatment effect in environments in which randomisation is unfeasible. First applied by Donald Thistlethwaite and Donald Campbell to the evaluation of scholarship programs, the RDD has become increasingly popular in recent years. Recent study comparisons of randomised controlled trials (RCTs) and RDDs have empirically demonstrated the internal validity of the design.
https:/
/ www.weeklystandard.com/ gary-saul-morson/ the-history-of-russian-terrorism-dagger-and-swagger “Toward a Theory of Revolution”, (1962-02):
Revolutions are most likely to occur when a prolonged period of objective economic and social development is followed by a short period of sharp reversal. People then subjectively fear that ground gained with great effort will be quite lost; their mood becomes revolutionary. The evidence from Dorr's Rebellion, the Russian Revolution, and the Egyptian Revolution supports this notion; tentatively, so do data on other civil disturbances. Various statistics—as on rural uprisings, industrial strikes, unemployment, and cost of living—may serve as crude indexes of popular mood. More useful, though less easy to obtain, are direct questions in cross-sectional interviews. The goal of predicting revolution is conceived but not yet born or mature
https:/
/ www.politico.com/ magazine/ story/ 2018/ 11/ 11/ republican-party-anti-pornography-politics-222096 https:/
/ reason.com/ archives/ 2018/ 11/ 24/ legalizing-marijuana-and-gay-m “Synanon”, (2020-12-28):
Synanon was initially a drug rehabilitation program founded by Charles E. "Chuck" Dederich Sr., (1913–1997) in 1958 in Santa Monica, California. By the early 1960s, Synanon became an alternative community centered on group truth-telling sessions that came to be known as the "Synanon Game". Synanon ultimately became the Church of Synanon in the 1970s. Synanon disbanded in 1991 due to members being convicted of criminal activities and retroactive loss of its tax-free status with the Internal Revenue Service due to financial misdeeds, destruction of evidence, and terrorism. It has been called one of the "most dangerous and violent cults America had ever seen".
https:/
/ aeon.co/ essays/ why-fake-miniatures-depicting-islamic-science-are-everywhere https:/
/ gizmodo.com/ when-a-stranger-decides-to-destroy-your-life-1827546385 “Sort By Controversial”, (2018-10-30):
[Contemporary SF short story; inspired by NN text generation, social media dynamics, clickbait, and debates like ‘the dress’; imagines AI natural language processing systems run amok after being trained to maximize user reactions to create clickbait, leading to learning ‘scissor statements’, claims which are maximally controversial and divide the population 50-50 between those who find the statement obviously correct and moral, and those who find it equally obviously false and immoral, leading to intractable polarizing debates, contempt, and warfare.]
“Lady Mary Wortley Montagu”, (2020-12-28):
Lady Mary Wortley Montagu was an English aristocrat, writer, and poet. Born in 1689, Lady Mary spent her early life in England. In 1712, Lady Mary married Edward Wortley Montagu, who later served as the British ambassador to the Sublime Porte. Lady Mary joined her husband in the Ottoman excursion, where she was to spend the next two years of her life. During her time there, Lady Mary wrote extensively on her experience as a woman in Ottoman Istanbul. After her return to England, Lady Mary devoted her attention to the upbringing of her family before dying of cancer in 1762.
https:/
/ www.theatlantic.com/ magazine/ archive/ 2018/ 12/ the-sex-recession/ 573949/ https:/
/ www.newyorker.com/ magazine/ 2018/ 11/ 26/ how-to-control-a-machine-with-your-brain “Discovery of volatile biomarkers of Parkinson’s disease from sebum”, (2018-11-15):
Parkinson’s disease (PD) is a progressive, neurodegenerative disease that presents with significant motor symptoms, for which there is no diagnostic test (1–3). We have serendipitously identified a hyperosmic individual, a ‘Super Smeller’ that can detect PD by odor alone, and our early pilot studies have indicated that the odor was present in the sebum from the skin of PD subjects(4). Here, we have employed an unbiased approach to investigate the volatile metabolites of sebum samples obtained non-invasively from the upper back of 64 participants in total (21 controls and 43 PD subjects). Our results, validated by an independent cohort, identified a distinct volatiles-associated signature of PD, including altered levels of perillic aldehyde and eicosane, the smell of which was then described as being highly similar to the scent of PD by our ‘Super Smeller’.
1 sentence summary
Metabolomics identifies volatile odorous compounds from patient sebum that associate with the smell of Parkinson’s.
https:/
/ www.lesspenguiny.com/ articles/ best-article-on-bragging https:/
/ www.newyorker.com/ magazine/ 2018/ 11/ 12/ why-doctors-hate-their-computers https:/
/ www.newyorker.com/ magazine/ 2018/ 11/ 26/ do-proteins-hold-the-key-to-the-past http:/
/ antonhowes.tumblr.com/ post/ 128190471139/ the-great-british-industrial-bake-off https:/
/ www.wired.com/ story/ margit-wennmachers-is-andreessen-horowitzs-secret-weapon/ “Margit Wennmachers”, (2020-12-28):
Margit Wennmachers is a venture capitalist at the Silicon Valley venture capital firm Andreessen Horowitz and a co-founder of OutCast Communications, one of the tech world's top public relations firms according to The New York Times. She is one of a handful of women at high-profile venture capital firms and among the few venture capital marketing executives at the partner level.
https:/
/ www.nytimes.com/ interactive/ 2018/ 10/ 24/ magazine/ candy-kit-kat-japan.html https:/
/ features.propublica.org/ palm-oil/ palm-oil-biofuels-ethanol-indonesia-peatland/ https:/
/ www.rollingstone.com/ culture/ culture-features/ drug-war-mexico-gas-oil-cartel-717563/ “Ravelry”, (2020-12-28):
Ravelry is a free social networking service and website that beta-launched in May 2007. It functions as an organizational tool for a variety of fiber arts, including knitting, crocheting, spinning, and weaving. Members share projects, ideas, and their collection of yarn, fiber, and tools via various components of the site.
http:/
/ citeseerx.ist.psu.edu/ viewdoc/ download?doi=10.1.1.453.7194&rep=rep1&type=pdf https:/
/ www.theringer.com/ movies/ 2018/ 11/ 15/ 18091620/ box-office-futures-dodd-frank-mpaa-recession https:/
/ old.reddit.com/ r/ SilkRoad/ comments/ 3a2xqp/ sr1_sales_data_6_feb_2011_2_oct_2013/ https:/
/ www.bloomberg.com/ news/ articles/ 2018-11-08/ the-curse-of-the-honeycrisp-apple -
Persistent forms of nondual awareness, enlightenment, mystical experience, and so forth (Persistent Non-Symbolic Experience) have been reported since antiquity. Though sporadic research has been performed on them, the research reported here represents the initial report from the first larger scale cognitive psychology study of this population.
Method: Assessment of the subjective experience of fifty adult participants reporting persistent non-symbolic experience was undertaken using 6–12 hour semi-structured interviews and evaluated using thematic analysis. Additional assessment was performed using psychometric measures, physiological measurement, and experimentation.
Results: Five core, consistent categories of change were uncovered: sense-of-self, cognition, emotion, perception, and memory. Participants’ reports formed clusters in which the types of change in each of these categories were consistent. Multiple clusters were uncovered that formed a range of possible experiences. The variety of these experiences and their underlying categories may inform the debate between constructivist, common core, and participatory theorists.
…Over the course of a week, his father died followed very rapidly by his sister. He was also going through a significant issue with one of his children. Over dinner I asked him about his internal state, which he reported as deeply peaceful and positive despite everything that was happening. Having known that the participant was bringing his longtime girlfriend, I’d taken an associate researcher with me to the meeting to independently collect the observations from her. My fellow researcher isolated the participant’s girlfriend at the bar and interviewed her about any signs of stress that the participant might be exhibiting. I casually asked the same questions to the participant as we continued our dinner conversation. Their answers couldn’t have been more different. While the participant reported no stress, his partner had been observing many telltale signs: he wasn’t sleeping well, his appetite was off, his mood was noticeably different, his muscles were much tenser than normal, his sex drive was reduced, his health was suffering, and so forth…It was not uncommon for participants to state that they had gained increased bodily awareness upon their transition into PNSE. I arranged and observed private yoga sessions with a series of participants as part of a larger inquiry into their bodily awareness. During these sessions it became clear that participants believed they were far more aware of their body than they actually were…Many participants discussed the thought, just after their transition to PNSE, that they would have to go to work and explain the difference in themselves to co-workers. They went on to describe a puzzled drive home after a full day of work when no one seemed to notice anything different about them. Quite a few chose to never discuss the change that had occurred in them with their families and friends and stated that no one seemed to notice much of a difference.
There was also a progressively decreasing sense of agency. In the final stage, Location 4, he reports: “These participants reported having no sense of agency or any ability to make a decision. It felt as if life was simply unfolding and they were watching the process happen. Severe memory deficits were common in these participants, including the inability to recall scheduled events that were not regular and ongoing.” And yet, almost all of the subjects reported it as a positive experience. The subjects, at whatever point they were in the scale, were often completely certain about the nature of the experience: “PNSE was often accompanied by a tremendous sense of certainty that participants were experiencing a ‘deeper’ or ‘more true’ reality. As time passed, this often increased in strength.” They also tended to be dogmatic about their PNSE being the real thing (whichever location they were at) and descriptions of other people’s different PNSEs as not the real thing. Another way to say “completely certain” is “unable to doubt”.
https:/
/ www.newyorker.com/ magazine/ 2012/ 03/ 12/ the-hours-daniel-zalewski “The Clock (2010 film)”, (2020-12-22):
The Clock is an art installation by video artist Christian Marclay. It is a looped 24-hour video supercut that feature clocks or timepieces. The artwork itself functions as a clock: its presentation is synchronized with the local time, resulting in the time shown in a scene being the actual time.
“Supercut”, (2020-12-22):
A supercut is a genre of video editing consisting of a montage of short clips with the same theme. The theme may be an action, a scene, a word or phrase, an object, a gesture, or a cliché or trope. The technique has its roots in film and television and is related to vidding. The montage obsessively isolates a single element from its source or sources. It is sometimes used to create a satirical or comic effect or to collapse a long and complex narrative into a brief summary.
https:/
/ vastabrupt.com/ 2018/ 08/ 07/ time-war-briefing-for-neolemurian-agents/ “Gunbuster”, (2020-12-28):
Gunbuster, known in Japan as Aim for the Top!, is a Japanese OVA anime series produced by Gainax released from 1988 to 1989. It was the directorial debut of Hideaki Anno, best known as the creator and director of Neon Genesis Evangelion. The title is a combination of the titles of classic tennis anime Aim for the Ace! and hit action drama film Top Gun, whose plot inspired Gunbuster's. To celebrate Gainax's 20th anniversary in 2004, an official sequel to Gunbuster, Diebuster, was released as an OVA. The sequel features new characters and mecha, but retains the format and many of the concepts of the original series.
http:/
/ animekritik.wordpress.com/ 2011/ 11/ 22/ imperialism-translation-gunbuster-introduction/ http:/
/ animekritik.wordpress.com/ 2011/ 11/ 25/ imperialism-translation-gunbuster-episode-one/ http:/
/ animekritik.wordpress.com/ 2011/ 11/ 27/ imperialism-translation-gunbuster-episode-two-nsfw/ http:/
/ animekritik.wordpress.com/ 2011/ 11/ 29/ imperialism-translation-gunbuster-episode-three/ http:/
/ animekritik.wordpress.com/ 2011/ 12/ 01/ imperialism-translation-gunbuster-episode-four/ http:/
/ animekritik.wordpress.com/ 2011/ 12/ 03/ imperialism-translation-gunbuster-episode-five/ http:/
/ animekritik.wordpress.com/ 2011/ 12/ 05/ imperialism-translation-gunbuster-episode-six/ https:/
/ www.amazon.com/ Cat-Sense-Feline-Science-Better/ dp/ 0465031013 http:/
/ press.etc.cmu.edu/ index.php/ product/ well-played-2-0-video-games-value-and-meaning/ http:/
/ press.etc.cmu.edu/ index.php/ product/ well-played-vol-4-no-1/ “Kedi (2016 film)”, (2020-12-28):
Kedi is a 2016 Turkish documentary film directed by Ceyda Torun about the many stray cats that live in Istanbul. It premiered at the !f Istanbul Independent Film Festival on 21 February 2016 before being given a North American theatrical release on 10 February 2017. It debuted on the YouTube Red streaming service on 10 May 2017. It was released on DVD in the U.S. on 14 November 2017. The film received critical acclaim, and grossed over $5 million. Time magazine listed it as one of its top ten films of 2017.
“Gwern.net newsletter (Substack subscription page)”, (2013-12-01):
Subscription page for the monthly gwern.net newsletter. There are monthly updates, which will include summaries of projects I’ve worked on that month (the same as the changelog), collations of links or discussions from my subreddit, and book/movie reviews. You can also browse the archives since December 2013.
“The dress”, (2020-12-27):
The dress is a photograph that became a viral internet sensation on 26 February 2015, when viewers disagreed over whether the dress pictured was coloured black and royal blue, or white and gold. The phenomenon revealed differences in human colour perception, which have been the subject of ongoing scientific investigations into neuroscience and vision science, with a number of papers published in peer-reviewed science journals.