这是一个关于In-Context-Lora微调模型

9张图训练,不同类型得出结论:

1.汉字训练无效

2.服装/产品类(不是过于复杂的)精确描述后放置白底图上,训练后能精确复刻

3.如果忽略了部分描述,训练后生成图片也会把相应的白底元素忽略

4.1之前一张训练银杏的图,正常flux训练结果不理想,这里用In-Context-Lora的方式微调效果很棒,能还原和创意改变场景元素

4.2汉服的训练手持油纸伞效果非常好(本质也是抠图,至于抠图和原图上下文这个有没有什么我就搞不懂了)

5.意外发现Flux底膜的古琴训练的很好,加上一些古琴的修饰即可

6.老问题,滑雪板的固定器还原还是有bug,但是滑雪板的还原度比Flux直接训练的要好一点

7.训练的Config文件: https://github.com/ali-vilab/In-Context-LoRA/tree/main/config

8.我用4090 24g卡训练爆显存了,注意打开.yml文件的注释:low_vram: true


关于提示词参考:

a woman wearing a white short sleeved shirt and a black pleated skirt, wearing a black tie, standing in the flower park. Her hair naturally hung down on her shoulders, looking very elegant

This is a picture depicting an ancient style scene, where a woman wearing a pink purple Hanfu is holding an oil paper umbrella. Her hair is decorated with hair accessories, and she is wearing a wine red belt around her waist. She was holding a yellow lantern in her hand, with a green background of trees and water flowing

A woman wearing a sleeveless waist cinched ruffled short skirt with blue pattern stands in the seaside. She has long black hair and is wearing a pearl necklace. Her gaze towards the camera is firm and confident. On the wooden table to her right is a bouquet of green plants. The background is a blue sea, sky, and a huge rocky mountain.

In a picture of a room, in the bottom left corner of the picture, there is a Mickey Mouse doll, and on the right side is a hand holding a cup with a green plant pattern printed on it, and the English word "LOVELY FLOW" written on it. The lid is beige

In a picture of a room, in the bottom left corner of the picture, there is a Mickey Mouse doll, and on the right side is a hand holding a cup with a green plant pattern printed on it, and the English word "LOVELY FLOW" written on it. The lid is brownish red

a Chinese woman wearing mermaid clothing sitting in front of a desert background. She was wearing a blue robe embroidered with exquisite patterns and sequins, appearing very delicate and noble. she wore a white crown on her head and a pearl necklace around her neck. In her hand, she is holding a beautifully decorated guqin with various gemstones and exquisite patterns embedded on it

A motorcycle parked at the roadside. mainly black and white in color, looks very cool. It has a streamlined design and a large headlight. You can also see some text on the motorcycle,A woman wearing a hat and dark clothes stands beside it. The background is a green lawn, some trees and gray white buildings. There are clouds in the sky

A picture depicting traditional Chinese calligraphy art with black handwriting engraved on it. A light green inkstone is filled with red ink paste, and a white rice paper has here are black vertical Chinese characters that read, 'happy new year ', Two transparent jade scales are pressed onto paper


最后小结:

1.滑雪装备滑雪板带有固定器的不要训练了

2.汉字不用训练

3.尽量精确描述白底图上的元素