(flux)Turn your photo to clay style(照片转黏土风格flux版)
2.0
2 reviewsDescription
step1:
With vision model and language model, the description of the picture are converted into clay style prompt.
step2:
With flux controlnet and lora, we can transform the style of the image while maintaining similarity.
step3:
Crop and enlarge the face, and redraw the face to maintain similarity through sdxl and instant id models.
主要分三步:
1、通过视觉模型和大语言模型,实现prompt 的风格转换
2、通过Flux/lora/controlnet,在转换风格同时保持相似度。
3、通过对脸部采取放大重绘再贴回,这一步使用sdxl模型和instantid模型,来恢复脸部相似度。
flux lora:
https://www.liblib.art/modelinfo/9e0e6f29c0a245d3bb74bad9c7e2313e?from=personal_page&versionUuid=e0087451768a4bb3844bd084ebd79962
sdxl checkpoint:
https://www.liblib.art/modelinfo/36404bfb74f64c168cad048312eb5f42?from=personal_page&versionUuid=3414d7c35b1245a3b3bfcf11c980cd5b
sdxl lora:
https://www.liblib.art/modelinfo/235e784744304cc9833e6eaad5d9b58b?from=personal_page&versionUuid=29269f9228b84c8cad139a15c3372551
手机端H5在线使用链接(flux模型叠加sdxl模型会有点慢):
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (2)
- latest (4 months ago)
- v20241008-144146
Node Details
Primitive Nodes (6)
BizyAirJoyCaption (1)
BizyAirSiliconCloudLLMAPI (1)
ControlNetApplySD3 (1)
Fast Groups Bypasser (rgthree) (1)
Note (2)
Custom Nodes (52)
ComfyUI
- ControlNetLoader (2)
- PreviewImage (7)
- DualCLIPLoader (1)
- ImageScaleToTotalPixels (4)
- UNETLoader (1)
- VAELoader (1)
- CLIPTextEncode (4)
- VAEEncode (1)
- SaveImage (1)
- LoraLoaderModelOnly (2)
- CheckpointLoaderSimple (1)
- MaskToImage (1)
- VAEDecode (2)
- ImageScale (1)
- KSampler (2)
- InpaintModelConditioning (1)
- LoadImage (1)
- easy promptConcat (1)
- easy imageSize (1)
- easy humanSegmentation (2)
- InstantIDFaceAnalysis (1)
- InstantIDModelLoader (1)
- ApplyInstantID (1)
- LayerUtility: RestoreCropBox (1)
- LayerUtility: CropByMask V2 (2)
- AV_ControlNetPreprocessor (1)
- ComfyUI_Image_Round__ImageRound (1)
- ShowText|pysssss (2)
- String Literal (3)
- Seed Generator (2)
Model Details
Checkpoints (1)
ReminiClay黏土风_SDXL_V1.0.safetensors
LoRAs (2)
ReminiClay黏土风_SDXL_LoRA_Dim128.safetensors
flux\Flux_Remini_clay_v1.safetensors