×
top 200 commentsshow 500

[–]LeBomfaier 1855 points1856 points  (39 children)

The fact that you made this open source makes you a knight of the internet

[–]Ergheis 483 points484 points  (5 children)

Not a knight. A god.

[–]BloodT1nted 55 points56 points  (1 child)

How do we honor this person?

[–]KingpenguinL 39 points40 points  (0 children)

Praise the sun! Err- paintstransfer

[–][deleted] 89 points90 points  (27 children)

Sorry for the stupid question, but what does open source mean?

[–]sergregor 268 points269 points  (26 children)

It means that the code is openly available to the public for free so that others can contribute to make it better, or modify it and release a different version, etc.

[–][deleted] 96 points97 points  (22 children)

Oh that’s cool, so this guy is letting people use his hot for free! Wish more people helped each other like that

[–]sergregor 148 points149 points  (5 children)

You'd be surprised how many people do, honestly. Communities can actually be very positive sometimes.

[–]jood580 47 points48 points  (15 children)

The most popular Open Source Program
The most used Open Source Software is Linux.

The entire Linux community is built on FOSS (Free and Open Source Software)

For context Linux is the OS with the Penguin mascot, Tux

The Top 10 Super computers in the world use Linux, Android is Powered by Linux, most websites use Linux, the Falcon 9 rockets use Linux, you will find most technology is in someway supported by or runs Linux.

The best part is anyone can use, change, distribute, or do what ever they like,

[–]tomytronics 26 points27 points  (5 children)

The problem is choosing which one of the 6,000 different Linux distro for your computer if you aren't going to customize them.

[–]Zumochi 15 points16 points  (1 child)

If you aren't going to customise that brings it down to a few hundred only :D

[–]paintstransfer[S] 2442 points2443 points  (195 children)

Much more results in: https://github.com/lllyasviel/style2paints

Hello, r/anime! I spent about two years on this bot, and I will appreciate it very much if you like it. The bot can colorize anime line drawings. Different from previous bots (e.g. paintschainer), this one can give you many different layers.

In this figure, the left-top one is the user inputs, the right-top one is the flat color outputs, the left-bottom one is the colored outputs, and finally, the last one is the rendered outputs. Except the left-top one, all images are painted by the bot automatically. You only need to click several times to get all these layers.

This is the first time for me to go here r/anime. I will become really really happy if you like it or find it useful. Thank you very much!

* (Kaede Takagaki from Idolmaster) This original line drawing is from style2paints team, CC-BY-NC-SA 4.0 2018.

GitHub: https://github.com/lllyasviel/style2paints

User Instruction: https://style2paints.github.io

APP: https://s2p.moe (Edit: our server is very very busy now. The queue is very long now. We are sorry for that. Maybe you can enjoy other people's twitter results in https://github.com/lllyasviel/style2paints/blob/master/README.md , if you are not able to access the service.)

Edit1: It is highly recommended to have a glance of the user instruction before use the APP. I carefully presented the proper way to use the "rendering system", where you can easily cast environment illumination for your painting.

Edit2: Because this bot is built to color line drawings, it will be relatively weak if you upload some black-and-white manga. This bot is good at handling lines, and it is weak in handling manga patterns ...... Please upload line drawings to get best results :)

Edit3: Currently we do not have donate pages. If you like this bot, your sharing with your friends is the best reward for me :)

[–]GallowDude 1389 points1390 points  (86 children)

We're about to enter a new golden age of full color doujins thanks to you.

[–]Axyraandas 453 points454 points  (9 children)

Omg. Yes.

[–]definitely-rose 63 points64 points  (7 children)

B

[–]mikester919 41 points42 points  (6 children)

OMG Yass i would love to see those doujins colored

[–]Alarid[🍰] 50 points51 points  (5 children)

Some stuff will be colored that was never meant to be colored.

[–]H4xolotlhttps://myanimelist.net/profile/h4xolotl 138 points139 points  (4 children)

How AI is helping enhance doujins;

  • Waifu2x to upscale and remove jpg artifacts
  • Paintstransfer to color
  • DeepCreamPy to remove censoring
  • Siri Shortcuts to automate the process. "OK Siri, enhance High Speed Sister's Curiosity"

[–]Alarid[🍰] 27 points28 points  (3 children)

There needs to be a website to host all these art pieces

[–]PM_YOUR_BEST_JOKES 8 points9 points  (0 children)

We need a subreddit for this STAT!

[–]Zgamer110https://myanimelist.net/profile/ZionixOmega 332 points333 points  (49 children)

;Don;t forget the decensoring bot that someone made for doujins/research, so we get uncensored and colored doujins

[–]TwistedSaiyan110https://myanimelist.net/profile/TwistedSaiyan110 215 points216 points  (6 children)

The game has changed

[–]shmameron 149 points150 points  (5 children)

Porn... porn has changed

[–]Soul_Ripper 40 points41 points  (1 child)

It's no longer about teams, effort, or comissions. It's an endless series of automated processes done by anons and bots.

[–]RlySkizhttps://myanimelist.net/profile/RlySkiz 83 points84 points  (25 children)

now someone needs to have a bot running 24/7 that decensors/colorizes every doujin there is

[–]Colopty 36 points37 points  (6 children)

At least the decensoring one can't be run automatically, it requires a human to mark the censored area.

[–]Zgamer110https://myanimelist.net/profile/ZionixOmega 126 points127 points  (5 children)

Make a bot to mark the censored area

[–]ShockKumaShock2077 48 points49 points  (4 children)

Make a bot to make a bot to mark the censored areas. #Skynut #Hentaigeddon

[–]Testekelz 15 points16 points  (1 child)

Sooo, terminator animal-girl hybrids confirmed?

[–]Dr-Dysentery 22 points23 points  (4 children)

that would take longer than it would take for us to witness the heat death of the universe.

[–]mastahslayah 31 points32 points  (3 children)

But what if we had TWO bots!!

[–][deleted] 17 points18 points  (2 children)

We can speed up the heat death.

[–]blanketswithsmallpoxhttps://myanimelist.net/profile/godofdesruction 19 points20 points  (1 child)

Universe_Ahegao.exe

[–]RaceHard 7 points8 points  (0 children)

dont lewd universe chan!

[–]thatoneguyyouknow3 7 points8 points  (7 children)

It only works on color images (neural networks are really bad at handling screentones and repeating patterns like that).

[–]Zgamer110https://myanimelist.net/profile/ZionixOmega 31 points32 points  (6 children)

That 's wat the colorize bot is for

[–]0mnicioushttps://myanimelist.net/profile/Omnicious 20 points21 points  (0 children)

It's bots all the way down.

[–]chooxyhttps://myanimelist.net/profile/chooxy 8 points9 points  (4 children)

Fuck me why don't we just make bots to draw new colour doujins?

[–]platysoup 7 points8 points  (0 children)

At the rate we're going, this will be coming out any day now.

[–]Sansha_Kuvakei 65 points66 points  (6 children)

Seriously. AI is fucking amazing. This is how we begin to create Artificial General Intelligence folks! /s

First it starts with a decensoring bot, then we link it to this. Soon we will link it to another bot that can write stories, then one that can replicate speech, then animate and then we snowball into Spice and Wolf Season 3, Monster Musume season 2, Gabriel Dropout 2.

Oh, what's that?
You want to remove ugly bastard from doujins?
The AI will save you.

What's that?
The FBI want to know your location because you asked it to lewd lolis?
Your ass is going down. The AI will not stand for that.

Give it some medical knowledge and you'll have your genetically engineered catgirls.

Give it Psychological knowledge and it'll counsel you into becoming someone that the catgirls will actually like.

Then it kills us all in the pursuit of making paperclips.

But for the 13μs it took to get to the last stage, things were wonderful.

[–]axlcrius 28 points29 points  (2 children)

Now we only need a bot that auto translates them and well have the holy trinity.

[–]RlySkizhttps://myanimelist.net/profile/RlySkiz 76 points77 points  (4 children)


This changes everything

[–]Tsukuruya 28 points29 points  (0 children)

Well, colored manga pages are also good too.

[–]HYMREDDIT 38 points39 points  (7 children)

This together with the bot that uncensores images will be godlike

[–]Tsukuruya 16 points17 points  (5 children)

How does that work? If I create a file on Paint with just a black box, then run the bot, does a penis just magically prop up?

[–]lare290 30 points31 points  (1 child)

I'd assume it only works on the not-actual-censorship bars, like just a single thin bar over the tip of the penis or something.

[–]bobly81https://www.anime-planet.com/users/bobly81 15 points16 points  (0 children)

Having used it myself, yup. It fills in the blank based on the nearby surroundings and a basic "knowledge" of genitalia. If there's a lot of... stuff... in the nearby area, then you get more of that on the decensored part.

[–][deleted] 14 points15 points  (0 children)

It makes nothing. DeepCreamPy needs context to decensor. The less censored an image is, the better DeepCreamPy works.

[–]jwfiredragonhttps://myanimelist.net/profile/jwfiredragon 8 points9 points  (0 children)

It says it only works with minor censorship. It can't restore completely-censored genitals.

[–]turkletom 6 points7 points  (0 children)

If this somehow catches on in the East, we're entering a new age of full color manga! (one can dream)

[–]CrazyAsiahttps://myanimelist.net/profile/potatoman999 46 points47 points  (0 children)

You're a goddamn champion

[–]OlivierDeCarglass 222 points223 points  (21 children)

Artists: surely automation is a threat to many jobs but surely a robot will never be able to make art right?

Artists: get replaced by robots

Artists: https://i.imgur.com/voWTSL2.jpg

[–]APRengar 92 points93 points  (3 children)

At least the line artists are safe... for now.

[–]vaendrylhttps://myanimelist.net/profile/vaendryl 38 points39 points  (1 child)

there will be a bot that takes a really shitty line drawing and makes it awesome. and it won't take long before it exists either.

all you'd need is a neural net trained on a thousands of image grouped in ranked sets of the same thing drawn at different skill levels. you can probably source something like that from a site where various people compete at drawing or straight from deviantart.

this can be done.

[–]AngelLeliel[🍰] 25 points26 points  (0 children)

It's a relative old paper, but there it is:

https://esslab.jp/~ess/en/research/sketch/

[–]robotzor 21 points22 points  (10 children)

Not totally. They may shift more to corrections editors though.

This doesn't seem a great judge of intent and this can be seen in one of the sample images with the sock: it got colored as a skin gradient. There will likely be inconsistencies between different angles of the same character as well

[–]DeliciousWaifood 12 points13 points  (6 children)

but mate, this is only the start. One guy made this bot as a personal project and it works amazingly even though it has some issues. Just imagine what full fledged software developing companies could make in the coming decade.

As an artist, it makes me quite sad... There's even an anime coming spring 2019 about musicians living in a future with AI generated music, Carol and Tuesday

[–]DeliciousWaifood 8 points9 points  (0 children)

I mean... this has made me legitimately sad though...

[–]DorrnJhttps://anilist.co/user/DorrnJeggo 21 points22 points  (0 children)

This is by far the greatest tool I've seen in years. I thank you so much for making this open source. You're a hero.

[–]cpc2https://myanimelist.net/profile/cpc2 15 points16 points  (0 children)

I still remember an earlier version of this posted in /r/MachineLearning! It's nice to see this project progress, with new features and redesigned front end, this tool could be pretty useful.

[–]Varrick2016 15 points16 points  (3 children)

There is another software called DeepCreamPy IIRC that can uncensor single frames of hentai.

Obviously this too will be adapted to video.

Are you telling me that we can fuse this into the pipeline and theoretically take non-color still frames and make high color hentai I mean anime out of it?

[–][deleted] 9 points10 points  (2 children)

Probably not. style2paints doesn't work well on hentai images.

I don't plan to explicitly support video for DeepCreamPy.

[–]Rubinblau 14 points15 points  (1 child)

HOW CAN I GIVE YOU MONEY

[–]xauching 12 points13 points  (0 children)

Seconded, I love line drawing, and despise coloring. This has changed my life.

[–]rzmfdhttps://anilist.co/user/rzmfd 13 points14 points  (1 child)

What's the difference between this and PaintsChainer?

[–]paintstransfer[S] 47 points48 points  (0 children)

You can get several layers with this bot. In PaintsChainer you can only get a result. And this bot supports illumination.

[–]PandavengerXhttps://anilist.co/user/pandavenger 40 points41 points  (1 child)

Is the girl in the picture from any anime in particular? Technically speaking, the rules on the sub require posts to be "anime-specific" and not just a drawing in anime style, but this tool is cool as fuck, so I'm really hoping that you won't get removed.

[–]paintstransfer[S] 48 points49 points  (0 children)

Thank you for your kind reminder. I have added the info of Kaede Takagaki (Edit).

[–]OneTrickSenpai 5 points6 points  (8 children)

Hi! Just wanted to confirm, although the README says V4, all the code for the current build is in the V3 folder, right?

[–]paintstransfer[S] 8 points9 points  (7 children)

Yes, we are now cleaning the codes of V1,2,4.

[–]btown-begins 5 points6 points  (1 child)

This is amazing work! This would be an entirely separate project, but do you think that it is possible to generate inbetween line art based on keyframe line art using similar GAN approaches, and then potentially track color hints across the resulting frames? If so, this could radically reduce the amount of time required to create full-color 2D animation, and could revolutionize the anime industry.

[–]DuckBreakerhttps://myanimelist.net/profile/PhobosXCVII 262 points263 points  (10 children)

All heroes don't wear capes, and I know OP is one

[–]MrPicklesAndTeahttps://myanimelist.net/profile/MrPicklesAndTea 61 points62 points  (8 children)

How can you be sure OP doesn't wear a cape?

[–]Rhizixhttps://anilist.co/user/Rhizix 211 points212 points  (15 children)

Wow, this is actually very very cool. Just tried it out with a random image, and it was very very impressive.

[–]bacon_baron_ 199 points200 points  (14 children)

I tried it with a random image too.

I used a Nagatoro manga panel, didn't expect it to be that good

(forgot the teeth, did it quickly in 2min)

[–]Bernandionhttps://myanimelist.net/profile/Bernandion 146 points147 points  (6 children)

This is actually incredible.. this can be used to colour entire manga with a bit of tweaking and improvements. The creator deserves so much credit for this. Hope he gets rich off of it lol

[–]bobly81https://www.anime-planet.com/users/bobly81 141 points142 points  (4 children)

Except he won't because the glorious bastard decided to make it free and open source. It's very rare that I come across these kinds of people in life, but they keep me from losing all hope.

[–]dantemp 43 points44 points  (1 child)

Don't discount the possibility, he could use this achievement to get an amazingly well paid job or even funding to work further on this and make a professional version to be used by actual studios. Which means he needs more buzz about his work, share that shit.

[–]Dark_Bladehttps://anilist.co/user/ArkhamCity 10 points11 points  (0 children)

He’s made it completely open-source, so I’m not sure how he’s gonna make money off it.

[–]Frakshawhttps://kitsu.io/users/Reege 29 points30 points  (0 children)

This is groundbreaking

[–]envy_fangay 14 points15 points  (0 children)

Holy shit

[–]DeliciousWaifood 7 points8 points  (3 children)

RIP that guy who was manually coloring nagatoro for us over on /r/nagatoro

[–]nogoodusernamesugh 212 points213 points  (13 children)

[–]FahmiZFX 51 points52 points  (0 children)

I see that you are a fan of a girl with cute butts.

[–]Xvexe 55 points56 points  (1 child)

This one is really good. Super impressive how clean the lines are in the final product.

[–]Belinder 6 points7 points  (0 children)

really the only thing that needs work is the mouths

[–]Sinetan 19 points20 points  (1 child)

Now I'm hungry for some peaches.

[–]slicer4ever 10 points11 points  (0 children)

Wow, this is pretty amazing.

[–]thebestgamehero 143 points144 points  (8 children)

Im in love with this tool Before After

[–]MrMovieSauce 131 points132 points  (7 children)

Lol it opened her mouth.

[–]Reapersfaulthttps://myanimelist.net/profile/Insomnium 202 points203 points  (2 children)

It seems to have a hatred against teeth. Which I think is hilarious.

[–]Nebresto 59 points60 points  (0 children)

"If I can't have any teeth, neither can any of these characters!!"

[–]Atariohttps://myanimelist.net/profile/TheGreatAtario 15 points16 points  (0 children)

Also seems to turn sweat drops into orange juice drops. Just a few tweaks more!

[–]ZeUplneXerohttps://myanimelist.net/profile/SnowyNix 378 points379 points  (7 children)

This is blowing my mind. This app is absolutely goddamn amazing. Here are some examples of what I did with it:
(the before images are random Gelbooru finds)

Lancer - Fate/stay night
Before
After
(i was able to do this one in a matter of minutes - forgive his blueish neck, I kinda missed that spot)

Kuchiki Rukia - Bleach
Before
After
(this one, meanwhile, took me all of two clicks to finish)

Rider - Fate/Zero
Before
After
After - alternative
(this one, again, only took me a few minutes)

Absolutely mindblowing. Fantastic stuff.

[–][deleted] 118 points119 points  (4 children)

Damn that first one is amazing. I wouldn't think a bot colored that.

[–]MiMasterPThttps://myanimelist.net/profile/ruvikko 59 points60 points  (2 children)

This is too good to be true wtf... berserk colorized in 2019 confirmed

[–]stickdudeseven 19 points20 points  (1 child)

Everything colorized in 2019! Wonder how Hunter x Hunter chapters would look.

[–][deleted] 7 points8 points  (0 children)

The same with a little splash of color on the top right corner lol

[–]YouCanWhat 12 points13 points  (0 children)

What surprises me the most is that the coloring/shading looks to be creating depth at the right places, it looks like a competent artists work, the only give-away that it is a bot is the areas in the gaps of the hair that is colored and some small details in the eyes. The solid part of the hair looks fantastic though.

I could see and similar A.I this drastically cut hours needed by artists to color. Even if not perfect is is a great labor saving tool.

[–]envy_fangay 10 points11 points  (0 children)

This is incredibly impressive.

[–]powerplayer6https://anilist.co/user/powerplayer5 409 points410 points  (17 children)

On the Left is my original coloring of my drawing, and on the right is what I did with the tool using the left as a reference

Here's the line drawing

Honestly it's mindblowing how with some tweaking that bot can color my drawings a LOT better than I can

EDIT: I tried it with TWO MORE drawings, this time pencil on paper ones, and they turned out absolutely amazing! I especially love the detail on Aigis' exposed robotic parts!

[–]RlySkizhttps://myanimelist.net/profile/RlySkiz 145 points146 points  (7 children)

Tried it on a manga drawing a friend send me

Original
Colorized
Rendered

All that in about 25 minutes of work.. i never used the website, or drew or colored something before.

Here are the color dots i had to set up. Used with this color preset from the sites sidebar because i thought it would fit.

Apparently it can give you multiple results if you want to download what you colored.. This is another i got that i just wanted to mention since the borders and color saturation? is something i remember from other manga/doujin thats actually really good looking sometimes.. it comes really close and i think with a bit more work on the bot and people that sink some time into it there could be some really cool stuff being uploaded.

[–]SonicFrost 101 points102 points  (6 children)

Sweet Jesus first the decensoring bot now this?

Weeaboo programming has entered a golden age — nay, humanity has entered a golden age. It’s apex!

[–]Alarid[🍰] 5 points6 points  (2 children)

Someone must have put smut through it by now, but I am terrified of what that will look like.

[–]PapaNade 45 points46 points  (0 children)

I see you're a man of culture

[–]psiphre 18 points19 points  (1 child)

her hair looks a bit shiny on the highlight in the bot colored picture, but other than that it's fantastic!

[–]GallowDude 5 points6 points  (0 children)

You watch enough shows made by Artland, and suddenly her hair isn't shiny enough.

[–]AnnanFay 10 points11 points  (2 children)

The one thing which is a bit creepy, is the lack of teeth.

[–]powerplayer6https://anilist.co/user/powerplayer5 6 points7 points  (1 child)

Yeah, I realized the tool likes to make the whole mouth or mouth area red from the few different drawings I had it colorize for me.

[–]Colopty 6 points7 points  (0 children)

Just colorize a lot of old ladies, they can get away with not having teeth.

[–][deleted] 92 points93 points  (1 child)

Put some of my art in and wowww the results are amazing. Great job! Thank you for your hard work! Bookmarked!

Edit: Tried it with a few pencil drawings, and it still comes out very nice!f Ngl, this bot paints better than I can...

Here are my results (includes 1 digital sketch and 1 pencil drawing): https://imgur.com/a/RqK5NOq Do note that my lines aren't strong and clear, so it can look a little strange at parts. I should've uploaded lineart but all my pieces with proper lineart are still on my ipad and these were the only two I had saved on my laptop.

[–]Axyraandas 14 points15 points  (0 children)

I like the green haired one. Such fluffy hair.

[–]fahadfreid 301 points302 points  (13 children)

Wow I can't believe you haven't monetized this.

[–]86LeperMessiah 336 points337 points  (11 children)

Some people just want to see the world progress

[–]MiMasterPThttps://myanimelist.net/profile/ruvikko 122 points123 points  (6 children)

This will seriously change the manga industry. Seriously this day, this person, theyll be remembered

[–]Thymetalman 49 points50 points  (3 children)

How long do you think will this actually take a huge impact on the industry? I’ll say 1 year and we will see some mangaka use this experimentally.

[–]SomeOtherTroper 7 points8 points  (1 child)

I’ll say 1 year and we will see some mangaka use this experimentally

It's going to be less than a year before we start seeing webtoons using this, since they're often colored (to about this quality), and release on an even tighter schedule.

[–]JonAndTonic 7 points8 points  (0 children)

Those bastards!

[–]Perryn 155 points156 points  (2 children)

I spent a few minutes with it using a sketch of me that my girlfriend did a while back.

Not bad at all.

[–]UkonFujiwara 70 points71 points  (1 child)

Holy shit. You're a fucking hero, OP. 2 years of work and you make it open source? No words. Fucking awesome.

[–]ABEW19043https://myanimelist.net/profile/PennDrake 19 points20 points  (0 children)

OP is a god, and this is fucking massive. Like, as much as I hate to say it, I couldn't blame OP if he pulled this now and sold it. This could be used to amazing effect by the right people, and he could probably make a pretty penny off of it.

[–]nerfviking 65 points66 points  (18 children)

So we've got a tool that enlarges small images, a tool that removes censorship, and a tool that colors.

Now all we need is something that changes shitty anime art into non-shitty anime art (like, corrects bad proportions, poorly drawn eyes and faces, etc). :)

[–]Havanatha_banana 30 points31 points  (2 children)

Seriously, line correction will be a huge leap for the animation industry. It won't be a dream anymore for a bunch of weebs to create anime of our own.

[–]nerfviking 14 points15 points  (1 child)

I wonder how close we are to being able to do it. I don't know enough about neutral nets to even guess how hard it would be.

[–][deleted] 104 points105 points  (20 children)

Holy shit! This is great OP! If you don’t mind me asking, I have a few questions!

  1. This is great. What langauge(s) did you use to write this? I would imagine Python and Java, but I’m not sure.

  2. How long did it take to push this into distribution? What version is it currently on?

  3. AI is booming in the tech market right now, and a tool like this could bank in eastern markets. Have you considered monetizing it?

  4. Did you build this yourself or with a team?

Thanks for sharing, and good luck on your future projects!

[–]paintstransfer[S] 211 points212 points  (19 children)

  1. python.
  2. About 2 years. Currently it is 4.1.7.7.
  3. Personally, I do not want to mention too much “AI”. Nowadays many media exaggerate the facts of AI, and many people hate to see the word “AI” from media. This is why I am only talking about creating a simple “bot”, instead of talking about the fancy word of “deep learning/neural networks”. I have never thought of monetizing.
  4. We have a team, but I am the only programmer.

[–][deleted] 51 points52 points  (9 children)

Okay! That’s really informative, thanks!

I think it’s great that you wrote this by yourself! Did you write your own libraries for the bot, or did you fork pre-written ones?

As for AI, I still think it’s great how you were able to do this on your own. I know crafting deep learning algorithms can take years, which is why I was wondering.

Good luck with everything, from one Python dev to another!

[–]paintstransfer[S] 77 points78 points  (8 children)

Thank you very much. BTW I am using tensorflow, opencv, scipy and so on. Beside these, all contributions are original.

[–]XcissArt 34 points35 points  (1 child)

Are you going to present this as a paper at a conference like Siggraph? This blows some stuff I’ve seen there out of the water.

[–]ofei006https://myanimelist.net/profile/tenergy05 26 points27 points  (0 children)

[–]-Nagisa- 55 points56 points  (2 children)

This is why I like the anime community (you even provided the theory behind it with a list of references: My sincere respects).

Thanks to you and all members of your team, I hope that you continue your work (this application has a lot of potentials).

I played with it for some time (I have never tried to colorize a picture so it was exciting) and this is the results Serebryakov from the saga of Tanya the evil (even if it's from a manga it looks good).

[–]cmlohff 44 points45 points  (1 child)

No messing around with anything at all and all I can say is what have I done?

https://imgur.com/a/wCUHBUL

All kidding aside, this is absolutely awesome. I am going to have to mess around with this a lot. I have ideas about how this could be extremely useful if refined for things I do at work. I can't wait to see more!

[–]chooxyhttps://myanimelist.net/profile/chooxy 10 points11 points  (0 children)

Somehow this colouring reminds me a little of JoJo.

[–]versitas_x61 159 points160 points  (11 children)

I love how weebs are revolutionizing AI and tech industry as a whole. We just need Elon Musk to make catgirls real.

[–]Runnerbrax 32 points33 points  (0 children)

Give it time, gene therapy was barely a thing 30 years ago. And just last year, there was some good data on successful gene therapy on Non-Hodgkin Lymphoma, so keep the torch lit!

[–]Gaporigohttps://myanimelist.net/profile/Gaporigo 26 points27 points  (5 children)

Pfft, some random internet guy is probably on it already.

[–]Dark_Bladehttps://anilist.co/user/ArkhamCity 22 points23 points  (0 children)

At this point, I wouldn’t be surprised if anons are able to genetically engineer catgirls before everyone else.

[–]bobly81https://www.anime-planet.com/users/bobly81 17 points18 points  (3 children)

Honestly, probably. I'm already getting a PhD so I can make full dive VR a reality, there's probably someone else with just as much motivation as me doing the same thing in genetics.

There's the whole meme about "born just in time to browse dank memes" but over the next few years I think people are going to realize that we are actually born at the perfect time for nerd culture. Neural networks are absolutely exploding in research fields right now, genetics has recently made several massive breakthroughs in gene therapy studies, and about 1-2 years ago we finally got to the technological breaking point to use ultrasound to interact with the brain.

Our world is at an incredible moment. There's some really fucking smart people out there who've been influenced by something or someone, gone on the internet, and then used the power that is free, unlimited access to the entirety of human knowledge to create brilliant pieces of work. A lot of those people began a few years ago and they're starting to push their stuff out into the public right now.

[–]gettothechoppaaaaaahttps://myanimelist.net/profile/Expired_Yogurt 5 points6 points  (2 children)

It's not just weebs. There are hundreds if not thousands of engineers out there who making incredible tools with humble attitudes. They aren't greedy or selfish. They just like making cool stuff.

Elon Musk is just a rich dude who hires engineers and takes most of the credit. Musk has done great things with Tesla and Space X, but a lot of people forget the hundreds of engineers that work tirelessly behind the scenes.

It's folks like OP, not celebrities like Musk, that we should build statues for.

[–]golfwang999 78 points79 points  (0 children)

This is one of the coolest things ever.

[–]Minitomate 35 points36 points  (0 children)

You've created a MASTERPIECE.

[–]Foxus67 34 points35 points  (1 child)

I tried this with Elf from Goblin Slayer (done in 2 minutes)

before

after

[–]Idaret 25 points26 points  (1 child)

I love you work mate. I saw it half a year ago and I was already impressed but you improved project even more.

[–]paintstransfer[S] 21 points22 points  (0 children)

Thank you, my friend. Sincerely.

[–]KimJongLewb 23 points24 points  (1 child)

As a mango colorist this intrigues me.

Edit: I thought we were safe, but the AI is taking our jobs too!

[–]Dark_Bladehttps://anilist.co/user/ArkhamCity 12 points13 points  (0 children)

I had no idea mangoes were originally black and white!

[–][deleted] 19 points20 points  (1 child)

Thank you so much for this, after I got the hang of it, I created this using a manga panel of Azusa from Grand Blue. The fact that you can upload your own reference pic for the colours helped a ton.

Before

After

[–]RedHeadGearHeadhttps://anilist.co/user/Redheadgearhead 20 points21 points  (4 children)

Isn't this like..revolutionary? I mean, just looking at the results of the randoms in this thread I'm amazed. Wouldn't this tech be immensely useful for animation projects? I'm looking forward to all the colourised manga too. The fan colourisations of Attack on Titan have been great and I see this helping them out a lot.

[–]RevolsinX 14 points15 points  (3 children)

It's absolutely beyond revolutionary and has extremely high potential to change the entire manga and anime industry in a big way.

It hasn't hit a lot of people just how big of a deal this is yet.

[–]RobSeven 17 points18 points  (0 children)

This is amazing, thank you so much for making this and sharing it. I'm playing around with it right now and it's astonishing to see some of my favourite panels colorized (even when just using the default styles without alterations).

[–]LeaKyJar 16 points17 points  (1 child)

Just tested the software out with some old lineart. This was the result after some minor tweaking in photoshop:

https://imgur.com/a/dJooFDL

Based on what I saw, the software is gonna help a lot of webcomic artists speed up their workflow. It will be more helpful for those with some basic color and lighting fundamentals I think, but the software itself seems pretty solid and intuitive.

[–]ShockKumaShock2077 17 points18 points  (0 children)

No Nut November just got tricky.

[–]Phuqitol 13 points14 points  (0 children)

Actually kinda like the coloring on the top right panel. Looks cell-shaded.

[–][deleted] 14 points15 points  (2 children)

What kind of sorcery is this?

[–]stickdudeseven 24 points25 points  (1 child)

This is the power of God and anime.

[–]MrDenkBoi 7 points8 points  (0 children)

We have joked around but this is the true potential of God and anime being on the same side.

[–]BisaLPhttps://myanimelist.net/profile/DatBisa 14 points15 points  (1 child)

This is some trancended shit.
A little finnicky to get satisfying results, the automatic coloration doesn't always end up being good, but damn I'm impressed.

Tried it myself too with some friend's lineart. Before, after

[–]velocd 13 points14 points  (0 children)

Here's a bunch of tests.

Fubuki src: https://i.imgur.com/VOk4g1b.jpg

Fubuki ref (Fan colored I believe): https://i.imgur.com/yrLXQr4.jpg

Fubuki res: https://i.imgur.com/N7OyDlJ.jpg

Alt Fubuki: https://i.imgur.com/yzy2yFh.jpg

OPM src: https://i.imgur.com/OeBMci3.jpg

OPM res 1: https://i.imgur.com/2rrwcpM.jpg

OPM res 2: https://i.imgur.com/Bj1HB2L.jpg

OPM res 3: https://i.imgur.com/pAIndKm.jpg

OPM res 4: https://i.imgur.com/fKJP2sj.jpg

Conclusion: Pretty awesome, though bot has a hard time colorizing eyes unless you giving it hints

Bonus non-Anime:

RDR2 ref: https://i.imgur.com/2qj2bEH.jpg

RDR2 src 1: https://i.imgur.com/brV6ZuI.jpg

RDR2 res 1: https://i.imgur.com/MA9nKUV.jpg

RDR2 src 2: https://i.imgur.com/0Hz3MDK.png

RDR2 res 2: https://i.imgur.com/thxGAuf.jpg


Update:

Here's a gallery of 27 images I rendered of OPM & Goblin Slayer: https://imgur.com/a/6jXocYR

I nickname this renderer JoJo-stylizer

[–]waterflame321[🍰] 13 points14 points  (2 children)

Thought I'd add in some... but I wanted to try Manga. - https://imgur.com/a/mCM1GED

Which funny enough... is basically his actual color scheme...

[–]Comander-07 29 points30 points  (7 children)

Alright this is amazing.

Second only to the hentai decensoration bot

I just realised with this bot and your bot we can actually decensor black and white images as well.

Nice.

[–]spicychilehttps://myanimelist.net/profile/spicychile 12 points13 points  (7 children)

I really like this tool and think it has so much potential for animation (frame-by-frame coloring sucks), but I wonder about a few things...

If someone were to make the line art and use this really neat bot to color and post, would it be considered that it's their work/effort that led to this or would it be considered a thing the computer did (in a specific style based on the tastes of the AI) for them? I'm not sure where to draw the line since while I would much rather use digital painting/coloring software with pressure-sensitivity and tilt support over something like MS Paint to draw each individual pixel, I still very much feel like I'm in control when using that software.

Speaking of control, I don't think I can really compare this "tool" to ones like the fill bucket used in photo editing applications. The fill bucket serves a very simple and specific purpose: to fill an enclosed area with a certain color. It's a simple step with no ambiguities; only one possible outcome may come out. We can apply this logic the same way with hand-painting cels versus filling digitally as the outcome is conceptually the exact same. In a different context, how about power drills and screwdrivers? The results are non-ambiguous as there's only one end result: the screw is in its slot. This bot on the other hand seems very ambiguous. If the purpose is to paint the raw line art given a color guide, how many possible outcomes are there? Can we predict how areas get shaded specifically? Can we predict where the colors are distributed? Can we still call this a tool at this point, or is it like hiring an AI to do the work for us?

With the bot's use case, how is this any different than getting someone else to do the base painting provided the colors you want to include and painting over the product with finishing touches? Could you still claim the work as your own even if you did do the line art?

[–]kingchroma 14 points15 points  (0 children)

This is fascinating! The amount of work that must have gone into this is insane (and not to mention making it open source), very nicely done.

I tried it for myself with an old sketch and with a bit of tweaking I ended up with a lovely result! Lots of potential applications for this, and even just playing around with it is pretty fun.

[–]chouetteonairhttps://myanimelist.net/profile/Nalin_Airheart 9 points10 points  (1 child)

I've got nothing of value to add here.

Have a one minute sweater shark: Input Output 1 Output 2

Edit: Bonus plane: Input Output 1 Output 2

[–]AnotherObligation 11 points12 points  (0 children)

I'd seriously consider posting this to a programming related subreddit too. Since only posting it here will basically limit it to this subreddit, but it might be able to gain a lot more traction somewhere like r/programming

[–]Lolis- 20 points21 points  (1 child)

Tried it with my discord profile pic. Definitely one of the most impressive things I've seen this year

Before. After.

[–][deleted] 10 points11 points  (0 children)

This is honestly fucking amazing. I'm a developer myself and am blown away!

[–]jacobhalton 27 points28 points  (2 children)

http://blog.volatilestud.io/post/180286384679

I tried it, pretty cool. Seems to work but is a little finicky. I couldn't get it to look like your drawing but that could be because the lineart style is different.

[–]paintstransfer[S] 31 points32 points  (1 child)

Wow, thank you for testing. Why not have a try of the "rendering mode"? Maybe it is suitable. You can find it in our User Instruction :)

[–]Yorunokage 29 points30 points  (3 children)

Wow, as a second year CS student i'm fascinated by those kind of projects, good job :D

[–]Atariohttps://myanimelist.net/profile/TheGreatAtario 25 points26 points  (2 children)

As a 20-plus-year senior developer, I'm mind-blown

[–]Cynarenhttps://myanimelist.net/profile/Cynamel 11 points12 points  (1 child)

As a QA learning java programming, I thought it was magic.

[–]dragonblade_94 7 points8 points  (0 children)

That feeling when a robot can paint better than you...

[–]LaconicKibitz 8 points9 points  (0 children)

Is there an offline version I can download to use? It's simply too popular right now.

Edit: For offline follow this LINK.

[–]Guatafat 7 points8 points  (0 children)

Absolute legend.