Contact Us
Apps Page Background Image
Learn/Course/Auto1111 Tutorial Chapter 9 The Concept and Application of LoRA Models

FeaturedAuto1111 Tutorial Chapter 9 The Concept and Application of LoRA Models

0
0
0
mimicpc
08/20/2024
Stable Diffusion 3
Lora models
Transform low-resolution images into high-quality masterpieces with Auto1111 Chapter 5. Discover Hi-Res Fix and Stable Diffusion Upscaler techniques to enhance image quality and explore advanced settings for optimal results.

If you want to create comic characters or cyberpunk cosplayers, or enhance the details and style of generated images, you should learn how to use LoRA.

LoRA was initially used in large language models to fine-tune them with less data. It can also be used with Checkpoint, making it accessible and beginner-friendly.

3 Ways to Use LoRA in Stable Diffusion

The first way is to type <Lora:Lora folder name:1> to find the Lora you want to use.

The second way is more obvious if you cannot remeber the name of Lora. Simply click Lora and you will find that appears in the prompt.

The third way is to use Addtional Network. It allows users to use 5 different Lora at the same time. We need to install it first.

https://github.com/kohya-ss/sd-webui-additional-networks

Then you will find Addtional Network tag, click on it. Now you can find and select Lora that you downloaded. Remeber to click Enable and adjust Weight, otherwise it will be invalid.


5 Ways to Applicate Lora in Stable Diffusion

The first type is Character Lora, game character and manga character are popular in Lora. For example, Lucy from Cyperpunk. There are various Lora of Lucy could be found in Civitai.

Download the Lora first, upload into Lora folder, and then Lora is ready to use.

https://civitai.com/models/5477/lucy-cyberpunk-edgerunners-lora

Prompt:masterpiece, best quality, lucy \(cyberpunk\), <lora:lucy_offset:1>, bob cut, short hair, asymmetrical hair, multicolored hair, 1girl, solo, pale skin, red lips, detached sleeves, beautiful eyes, upper body, outdoors, looking at viewer, beautiful and aesthetic, official art, professional illustration, hires, amazing, absurdres





The second type is Painting Style LoRA. A classic example of this is Ghibli Style LoRA, which allows users to replicate or restore a specific painting style to the fullest extent.

Prompt:ghibli style, kiki \(majo no takkyuubin\),1girl, :o, bangs, black eyes, black hair, black shirt, blush, bow, bow hairband, collarbone, day, fingernails, food, fruit, hair bow, hairband, holding, holding food, holding fruit, looking at viewer, open mouth, outdoors, red bow, red hairband, shirt, short hair, solo, strawberry, sunlight, upper body, water drop, ((masterpiece))<lora:ghibli_style_offset:1>




The third type is Concept LoRA. This type of LoRA is difficult to define, as it encompasses a broader range of elements than a specific painting style. It combines various painting styles to create a unique blend. An example of this type of LoRA is Gacha Splash LoRA.

Prompt:[(white background:1.5),::5],1girl, mid shot, full body, ocean, sea waves, water splashes, sky, light particles, butterflies, night, starry sky <lora:lihui4JXK-b2-bf16-128-128-1-re1-ep3-768-DA-5015fix:1>


The forth type is Cloth/Costume Lora, which you mighr familiar with. Ordinary clothing like white shirt and blue jeans, AI could identified and generate for you, but what if you want special clothing, for instance, Mecha? Then you will need Lora.

Prompt:(best quality, masterpiece), 1girl, medium hair, looking at viewer, <lora:mechaarmor_v0.7:0.7>, pink mechaarmor



The last type is Objects Lora, which help you to add particular objects into the image. Cyberhelmet is considered as the example of this type of Lora.

Prompt:detailed, complex 3d render ultra detailed of a beautiful woman android, (walking away), looking over shoulder, beutiful ass, petite, cyborg, robotic parts, 150 mm, beautiful studio soft light, rim light, vibrant details, luxurious cyberpunk, lace, hyperrealistic, anatomical, facial muscles, cable electric wires, ((full body)), microchip, elegant, beautiful background, octane render, H. R. Giger style, 8k, best quality, masterpiece, illustration, an extremely delicate and beautiful, extremely detailed ,CG ,unity ,wallpaper, (realistic, photo-realistic:1.37),Amazing, finely detail, masterpiece,best quality,official art, extremely detailed CG unity 8k wallpaper, absurdres, incredibly absurdres, robot, silver helmet, full body,

full body, <lora:Cyberhelmet:0.8> mask, (beautiful woman) cyberpunk



Catalogue