Shulou(Shulou.com)11/24 Report--

Stability AI put another big move, Uncrop Clipdrop one-click expansion + reconstruction of the picture, Photoshop Generative Fill free replacement.

Before that, the reconstruction image function of PS was extremely exciting and made countless people shout.

Today, Stability AI made another big move. It teamed up with Clipdrop to launch Uncrop Clipdrop--, the ultimate image scale editor.

From the name Uncrop, we can see its use.

It is an AI-generated "external painting" tool that can change the scale of any image by creating an extended background that complements any existing photo or image.

Knock on the blackboard: through the Clipdrop website, you can try this tool for free without logging in!

The scale is adjusted arbitrarily, and Uncrop is built based on Stability AI text-to-image model Stable Diffusion XL until satisfaction.

Through advanced algorithms and deep learning techniques, Uncrop automatically analyzes the content of the uploaded image and produces a visually reasonable output.

This can solve the urgent needs of many cartographers and painters.

Took a near-perfect picture, that is, the composition is not satisfactory, what to do? Uncrop gives you a button to solve!

In many cases, in order for the image to be displayed on a banner or large canvas, we need to resize the image to the right size without distorting it or losing important details. Uncrop completely solves this problem.

Do you want to change the horizontal map into a vertical view? Uncrop helps you out of your worries.

Vertical to horizontal? It's a piece of cake.

Photos that are not in the right proportion can be pulled to the proportion you want.

However, Uncrop also has its own limitations.

If it is an extreme uncropped image, or a large number of images with missing content, it will produce inaccurate results.

Therefore, we need to ensure the high quality of the original image as much as possible in order to get the best results.

In addition, Uncrop relies on algorithms to analyze the surrounding pixels and fill in gaps, and its accuracy may vary according to the complexity of the scene.

Effect demonstration official introduction effect video:

Netizens shared examples of their own external painting effects:

The hands-on experience saw that the effect was so good that the editor could not help itching and immediately tested a wave of hands.

In fact, the feeling is: the operation is very convenient.

As shown in the GIF above, select an image and drag it to the specified area of the page.

You can select the scope you want to expand as shown below, and then wait a few seconds, and the platform will generate 4 expanded images for you to choose and save.

And it can also be reprocessed according to a generated picture combined with the AI revision of Clipdrop.

Remove the background.

Sharpen.

Then ask AI to reconstruct the style of the processed images.

After several times of AI doll generation and processing, the picture has not only been expanded, but also can be thoroughly "evolved" in style and content according to the specific needs of users.

This is the time for designers to give full play to their creativity!

We also did some tests on portraits, sports scenes and still life scenes.

Original portrait

Expansion effect

Part of the effect of the expansion is really natural.

However, because Prompt can not be used to guide the direction, the effect of expansion is relatively random.

Reconstruction effect

Reconstruction effect after expansion

The old problem of generating character images by AI is still not ideal.

And after the reconstruction, the little sister's body proportion is a little bit problematic, and her appearance also feels lower.

Still life original picture

Expansion effect

The expansion effect is relatively natural, and there is almost no sense of disobedience.

Extend the effect of reconstruction

However, after the reconstruction, the line distortion is more obvious, and the style of the whole picture will change greatly.

Original picture of motion scene

Expansion effect

Very sensitive to capture the dynamic style of the picture, the expansion effect is good.

Reconstruction effect after expansion

After the reconstruction, the subject has disappeared, leaving only a dynamic blurred picture, and AI is not good at grasping the main points of the content.

When I try to make a landscape photo expand infinitely into a panoramic picture.

It is found that for the parts that have been extended, the extension function of Uncrop can not continue to nest dolls.

In the month of the open source version of SD-XL4, Stability AI began testing Stable Diffusion XL for the public.

It is worth mentioning that open source SD-XL has reached the Midjourney level, can perform better in image details, and is almost completely controllable.

Officials have not disclosed much specific information about the Stable Diffusion XL model, only that it is similar to the v2 model in architecture, but has a larger scale and parameters.

SD-v2.1 includes 900 million parameters, SD-XL has about 2.3 billion parameters, and Emad says the official version may release a smaller distillation version.

SD-XL 's improvements over previous versions are as follows:

High quality images can be generated using a short descriptive prompt

Images that are more suitable for prompt can be generated.

The human body structure in the image is more reasonable.

Compared with v2.1 and v1.5 (to a lesser extent), the images generated by SD-XL are more in line with public aesthetics.

Negative prompts (negative prompt) are optional

The resulting portrait is more realistic.

The text in the image is clearer

Instead of PS Generative Fill, and free Uncrop is functionally very similar to Photoshop Generative Fill.

The essential function is to use AI to create image content in a specified location.

The function of Photoshop Generative Fill demonstrates, but compared with Uncrop,PS GF, it can not only expand the picture, but also create the image according to the requirement in the specified location.

If users want to make more precise changes to the details of the image, PS GF still has a great advantage in function.

But if you only need to expand part of the image content, Uncrop has been able to meet the requirements.

And with a few tips on prompts, Uncrop+Clipdrop can also generate and expand image content according to the user's description.

The key is that it is easy to operate and completely free!

Compared with the cost of using PS GF for about 150 yuan per month, for most users who do not have high requirements for image content, this set of tools provided by Stability AI should be a better choice.

And look at the momentum of Stability AI to introduce new features.

I feel that sooner or later this circle will be rolled up by them. All the functions are easy to use and free of charge.

Reference:

Https://stability.ai/blog/clipdrop-launches-uncrop-the-ultimate-aspect-ratio-editor

This article comes from the official account of Wechat: Xin Zhiyuan (ID:AI_era)

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.