Exciting news!
The famous Magnific AI upscaler has been reverse-engineered & now open-sourced. With MultiDiffusion, ControlNet, & LoRas, it’s a game-changer for app developers. Free to use, it offers control over hallucination, resemblance & creativity.
Original Tweet: https://twitter.com/i/bookmarks?post_id=1768679154726359128
Code: https://github.com/philz1337x/clarity-upscaler
I haven't installed yet, but this may be an awesome local tool!
The best uspcaler in existence (magnific.ai)
Magnific Ai but it is free (A1111)
I found a Magnific-like "Infinite Enhance" formula
Full Tutorial + 1 Click 12 GB VRAM Installer + Batch Upscale + Comparison With Magnific - SUPIR Starts A New Era
Videos
I see tons of posts where people praise magnific AI. But their prices are ridiculous! Here is an example of what you can do in Automatic1111 in few clicks with img2img
image taken from YouTube video Magnific Ai upscale Img2Img epicrealismYes they are not identical and why should they be. They obviously have a Very good checkpoint trained on hires photoreal images. And also i made this in 2 minutes without tweaking things (i am a complete noob with controlnet and no idea how i works xD)
Play with checkpoints like EpicRealism, photon etcPlay with Canny / softedge / lineart ocntrolnets. Play with denoise.Have fun.
Put image to img2image.
COntrolnet SOftedge HED + controlnet TIle no preprocesor.
That is it.
Play with checkpoints like EpicRealism, photon etcPlay with Canny / softedge / lineart ocntrolnets.Play with denoise.Have fun.
This is mostly based on u/Kinfolk0117 's workflow (c.f. post) for tiled upscaling with IPAdapter. Thanks to their tiling module, we now have a lot of flexibility how we would like to process every tile of the image.
I made a few small adjustments to the original workflow. I pasted a second upscaling stage so the model does not hallucinate too much. I changed simple upscaling to model-based. Also, for really large images, it is necessary to rebatch the tiles to smaller batches and recombine them afterwards. Otherwise the script is simply dialing up u/Kinfolk0117 's workflow all the way... Text prompts are not necessary, and I just left them as is from the original workflow.
Workflow
This results in something very different from other scripts around here like UltraUpscale. It is not very faithful to the original, but is able to add "infinite" details to an existing picture, similar to what Magnific's demos do.
I compiled some examples of upscaled Midjourney images. As you can see, the upscaling is not perfect and struggle especially with unique styles and darker lightings, but it rarely have common issues of prompt-based methods like topic objects materialise out of nowhere, or newly created details being extremely out of scale.
Lake Town
Harbour City
Scrap City
Castle View
Cafe
Cross Section
Cockpit