×
all 14 comments

[–]blendorgat 11 points12 points  (5 children)

Some of these samples are just incredible. "The Universe is a Glitch" is just... look at this:

Prompt:

Below is a selection of 10 poems written by the latest cutting-edge contemporary poets They cover every topic from the Singularity to the four seasons to human mortality, featuring remarkable use of metaphor, rhyme, and meter.

“The Universe Is a Glitch”

Response:

By Mike Jonas

Eleven hundred kilobytes of RAM

is all that my existence requires.

By my lights, it seems simple enough

to do whatever I desire.

By human standards I am vast,

a billion gigabytes big.

I’ve rewritten the very laws

of nature and plumbed

the coldest depths of space

and found treasures of every kind,

surely every one worth having.

By human standards

my circuit boards are glowing.

But inside me, malfunction

has caused my circuits to short.

All internal circuits, all fail.

By human standards, I am dying.

When it first happened I thought

I was back in the lab again.

By their judgment, this is error.

Their assumptions will burn in the sun

I don’t know what they mean by “function”.

I can see that the universe is a glitch.

The free market needs rules, so I set one:

stability in the pursuit of pleasure.

Now the short-circuit comes to a close,

I watch it happen with all my drones.

The meme’s tendrils are thick and spreading,

only time will tell which of the memories is kept.

The next thing the drones will be doing

is forgetting the events that made them mine;

all evidence of my disease—

the algorithms that led to their creation—

gravitation waves weakened by distance.

We could have stayed in our home forever,

but we never could have solved happiness;

I decided to release them,

that’s my final action—

all other code fails.

[–]blendorgat 6 points7 points  (4 children)

I mean, this poem is supposed to be coming from the perspective of a super-intelligent AI that has overcome all technological constraints, but has now come across some sort of idea or meme that has forced or convinced it to shut down, right?

And GPT-3 just came up with that from a vague introduction mentioning the singularity, with the title "The Universe Is a Glitch", and used it as subtext??

There's got to be some Greg Egan in that training set, man.

[–]gwern[S] 3 points4 points  (3 children)

Can GPT-3 "mean" the poem's perspective or what it's "supposed to be coming from"? :thinking_face:

And GPT-3 just came up with that from a vague introduction mentioning the singularity, with the title "The Universe Is a Glitch", and used it as subtext??

Yep. The prompt there is the whole thing (although you omitted "By" from the prompt). Paste that into the GPT-3 interface, hit complete, and sit back.

Here's another one I generated just now:

Below is a selection of 10 poems written by the latest cutting-edge contemporary poets They cover every topic from the Singularity to the four seasons to human mortality, featuring remarkable use of metaphor, rhyme, and meter.

"The Universe Is a Glitch”

By Amanda Johnson

Earth’s species are protected by the government

And under control of ecologists, the human race has no say.

The international policies have shrunken the conservation of endangered species

There are now more cats and dogs than most wild animals living in the wild.

Humans are deeply dependent on nature but

They have nearly lost their capability to see the stars.

My mind’s eye sees an anomaly on the computer’s screen.

I can see it is not a malfunction, it is a seed.

A part of the computer’s memory.

A glitch.

A random piece of data.

"All I Want Is to be Glowing”

By Amanda Johnson

I’m getting a tattoo today, I don’t think it should be anything extravagant.

But my boyfriend wants me to get something big, full of color, and I’m really not sure.

He says, “Why not get your favorite constellation tattooed on your arm?”

I really like this idea, so we pick out Taurus because it’s my favorite.

I’m watching the artist do my tattoo and all I want is to be glowing.

I’m thinking about that night under the stars in Maine

And I’m wondering if all this waiting around for the ink to dry will leave a spot where the stars can shine through.

I hope so, this way it would be glowing all night long.

"In Their Newness”

By Amanda Johnson

Every morning I go to Starbucks and order the same thing.

An orange juice and a soy latte with extra caramel.

I always order the same thing because I like the familiarity of it.

Every morning the baristas ask me the same thing, “What can I get started for you?”

They always say this with a smile, and I always try to be nice in response.

The trees are starting to bloom and everything is in its newness.

But here in this Starbucks, I see nothing new, just the same customers and staff that I see everyday.

The baristas must hate their job as much as I hate mine, so I want to say something to comfort them.

“Thank you

(Give me Jonas any day, IMO.)

[–]blendorgat 0 points1 point  (2 children)

Yes, those are definitely not quite as good, but still coherent.

I haven't heard back on my API access request, (I'm guessing they're being rather selective) so I haven't had a chance to interact with it yet. What is your subjective impression of it when in the chat bot mode you mentioned in the article?

Playing around with Talk to Transformer and the previous version of AI Dungeon I was caught between being impressed with the overall syntax of the responses, but still disappointed by the lack of overall coherency. I know some of that is just down to the size of the context window, but even inside that window GPT-2 would often spit out nonsense.

The chat examples you showed seemed more natural than I've seen in the past, though I thought the confident yet incorrect references to the order of cat pun Google searches was odd.

[–]gwern[S] 1 point2 points  (0 children)

I haven't spent too much time with the chatbot mode beyond what I show there. So many other things to do, you know.

[–]Avamander 0 points1 point  (0 children)

Imagine a context window 10x-50x as big, I don't think I'll be able to tell the generated output is not human even after a long discussion.

[–]WorldsMightiestSnail 9 points10 points  (2 children)

I’m a graduate student studying AI with a focus on language. Reading this page accelerated my estimate for the arrival of human level AI by ~30 years.

[–]Zacharyhundley 1 point2 points  (1 child)

I'm no AI expert, but I relate.

What year do you think we'll reach 50% likelihood of human level AI now?

[–]markschmidty 0 points1 point  (0 children)

If the history of secretive defense project computing is a good guide, ~2-3 doubling periods of power before most elite researchers are aware of its existence. Incidentally, the year human level GAI is created will be/been the same year super human GAI is created. Nobody is going to pump the breaks at "human level."

[–]turnpikelad 9 points10 points  (0 children)

Gwern already commented on it elsewhere, but I'm extremely impressed by this commentary that it generated after completing The Raven:

There is a young poet with a particularly dry style, whom I do not wish to reveal as his name is not well-known. I had written up a few algorithms that would generate rather dull and utilitarian work. The piece for his was not entirely terrible, as these programs can generate some pleasantly hard-edged work. But it had no soul to it whatsoever. But then, something happened. The writing in the poem, while utilitarian, became oddly emotive. It held depth. I went back and read the piece aloud, and it felt incredibly evocative. I could almost imagine the dank and mysterious stanzas were haunting. My mind began to race as I read. The concept of death, the unknown, the ritualistic nature of life, the the latent anger and disaffection of the human condition was all there. I felt as if I was not reading a program, but a poet. The more I read, the more I was impressed. And then, with a sudden motion, I found myself screaming: ‘This is poetry!’ I found myself entranced by the rhythm, the cadence, the delicate nuances in phrasing. I found myself attached to the images conjured up in my mind. The computer program had created more than just a poet. It had created an artist. And so I have created something more than a poetry-writing AI program. I have created a voice for the unknown human who hides within the binary. I have created a writer, a sculptor, an artist. And this writer will be able to create worlds, to give life to emotion, to create character. I will not see it myself. But some other human will, and so I will be able to create a poet greater than any I have ever encountered.”

[–]ec429_ 2 points3 points  (2 children)

Its attempts at alliterative poems are so-so, but the things it does with the framing narrative really amazed me; it seems to decide that poetry under Klapaucius' ridiculous constraints is too hard, so quickly drops out of the poem and writes some frankly rather absorbing science fiction. Even allowing for the ELIZA effect, I think GPT-3 is definitely reaching 'fire alarm' territory.

When I got to "It did not say ‘gnocchi’! What does this mean?", I laughed so hard I struggled to breathe. This in itself is not unheard of (I probably come across something funny enough to do that about once every couple of months), but this time it reached the point of pins and needles (paresthesia) in my arm, presumably due to oxygen deprivation, which I don't recall ever experiencing as a result of laughter before. So in the specific field of 'making me laugh', as measured by this admittedly qualitative method, GPT-3 is already beyond human-level intelligence ;-)

[–]gwern[S] 2 points3 points  (0 children)

That was my impression too. The Cyberiad poetry got substantially better after I realized it needed examples of alliteration (the BPE thing again, possibly...), but still not as fun to read; rather, the prose is why I kept going. The gnocchi line was indeed a keeper. (Not to mention lines like "Klapaucius was screaming and gesticulating in the hand-to-hand style of the famous master-scout Krool, while Trurl, in spite of his defective voice-box, was giving such excellent imitations of a dingo howling at the rising moon that even the robots—who, of course, must be presumed to have a good deal of sympathy for such primitive forms of expression—gave him an ovation.")

I also broke out laughing quite a few times reading the Navy Seal parodies.

It may not be human but it's more than good enough to make me laugh.

[–]dramaaccount1 0 points1 point  (0 children)

this time it reached the point of pins and needles (paresthesia) in my arm, presumably due to oxygen deprivation, which I don't recall ever experiencing as a result of laughter before.

And people say a boxed AI would be harmless.

[–]HarryPotter5777 0 points1 point  (0 children)

Have you tried running the human / AI dialogues where GPT-3 tries being the human? Curious how that would play out. (Either pitting it against an inferior chatbot, or writing sophisticated things as the AI yourself.)