Text-to-Image
lora
mi804 commited on
Commit
cdd503f
·
verified ·
1 Parent(s): f737c5e

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -40,14 +40,14 @@ cd DiffSynth-Studio
40
  pip install -e .
41
  ```
42
  1. **Entity-Level Controlled Image Generation**
43
- EliGen achieves effective entity-level control results. See [entity_control.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) for usage.
44
  2. **Image Inpainting**
45
  To apply EliGen to image inpainting task, we propose a inpainting fusion pipeline to preserve the non-painting areas while enabling precise, entity-level modifications over inpaining regions.
46
- See [entity_inpaint.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for usage.
47
  3. **Styled Entity Control**
48
- EliGen can be seamlessly integrated with existing community models. We have provided an example of how to integrate it with the IP-Adpater. See [entity_control_ipadapter.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for usage.
49
  4. **Entity Transfer**
50
- We have provided an example of how to integrate EliGen with In-Cotext LoRA, which achieves interesting entity transfer results. See [entity_transfer.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for usage.
51
  5. **Play with EliGen using UI**
52
  Download the checkpoint of EliGen from [ModelScope](https://www.modelscope.cn/models/DiffSynth-Studio/Eligen) to `models/lora/entity_control` and run the following command to try interactive UI:
53
  ```bash
@@ -65,7 +65,7 @@ pip install -e .
65
  </video>
66
  </div>
67
 
68
- 1. The image generation effect of complex Entity combinations, demonstrating the strong generalization of EliGen. See [entity_control.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_1-6` for generation prompts.
69
 
70
  |Entity Conditions|Generated Image|
71
  |-|-|
@@ -76,7 +76,7 @@ pip install -e .
76
  |![eligen_example_5_mask_0](./samples/e5_m.png)|![eligen_example_5_0](./samples/e5.png)|
77
  |![eligen_example_6_mask_8](./samples/e6_m.png)|![eligen_example_6_8](./samples/e6.png)|
78
 
79
- 1. Demonstration of the robustness of EliGen. The following examples are generated using the same prompt but different seeds. Refer to [entity_control.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_7` for the prompts.
80
 
81
  |Entity Conditions|Generated Image|
82
  |-|-|
@@ -86,19 +86,19 @@ pip install -e .
86
  |![eligen_example_7_mask_5](./samples/e7_m.png)|![eligen_example_7_8](./samples/e7_4.png)|
87
 
88
  ### Image Inpainting
89
- Demonstration of the inpainting mode of EliGen, see [entity_inpaint.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for generation prompts.
90
  |Inpainting Input|Inpainting Output|
91
  |-|-|
92
  |![inpaint_i1](./samples/inpaint_i1.jpg)|![inpaint_o1](./samples/inpaint_o1.png)|
93
  |![inpaint_i2](./samples/inpaint_i2.png)|![inpaint_o2](./samples/inpaint_o2.png)|
94
  ### Styled Entity Control
95
- Demonstration of the styled entity control results with EliGen and IP-Adapter, see [entity_control_ipadapter.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for generation prompts.
96
  |Style Reference|Entity Control Variance 1|Entity Control Variance 2|Entity Control Variance 3|
97
  |-|-|-|-|
98
  |![ip_ref](./samples/ip_ref.png)|![ip_1](./samples/ip_1.png)|![ip_2](./samples/ip_2.png)|![ip_3](./samples/ip_3.png)|
99
 
100
  ### Entity Transfer
101
- Demonstration of the entity transfer results with EliGen and In-Context LoRA, see [entity_transfer.py](https://github.com/mi804/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for generation prompts.
102
 
103
  |Entity to Transfer|Transfer Target Image|Transfer Example 1|Transfer Example 2|
104
  |-|-|-|-|
 
40
  pip install -e .
41
  ```
42
  1. **Entity-Level Controlled Image Generation**
43
+ EliGen achieves effective entity-level control results. See [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) for usage.
44
  2. **Image Inpainting**
45
  To apply EliGen to image inpainting task, we propose a inpainting fusion pipeline to preserve the non-painting areas while enabling precise, entity-level modifications over inpaining regions.
46
+ See [entity_inpaint.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for usage.
47
  3. **Styled Entity Control**
48
+ EliGen can be seamlessly integrated with existing community models. We have provided an example of how to integrate it with the IP-Adpater. See [entity_control_ipadapter.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for usage.
49
  4. **Entity Transfer**
50
+ We have provided an example of how to integrate EliGen with In-Cotext LoRA, which achieves interesting entity transfer results. See [entity_transfer.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for usage.
51
  5. **Play with EliGen using UI**
52
  Download the checkpoint of EliGen from [ModelScope](https://www.modelscope.cn/models/DiffSynth-Studio/Eligen) to `models/lora/entity_control` and run the following command to try interactive UI:
53
  ```bash
 
65
  </video>
66
  </div>
67
 
68
+ 1. The image generation effect of complex Entity combinations, demonstrating the strong generalization of EliGen. See [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_1-6` for generation prompts.
69
 
70
  |Entity Conditions|Generated Image|
71
  |-|-|
 
76
  |![eligen_example_5_mask_0](./samples/e5_m.png)|![eligen_example_5_0](./samples/e5.png)|
77
  |![eligen_example_6_mask_8](./samples/e6_m.png)|![eligen_example_6_8](./samples/e6.png)|
78
 
79
+ 1. Demonstration of the robustness of EliGen. The following examples are generated using the same prompt but different seeds. Refer to [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_7` for the prompts.
80
 
81
  |Entity Conditions|Generated Image|
82
  |-|-|
 
86
  |![eligen_example_7_mask_5](./samples/e7_m.png)|![eligen_example_7_8](./samples/e7_4.png)|
87
 
88
  ### Image Inpainting
89
+ Demonstration of the inpainting mode of EliGen, see [entity_inpaint.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for generation prompts.
90
  |Inpainting Input|Inpainting Output|
91
  |-|-|
92
  |![inpaint_i1](./samples/inpaint_i1.jpg)|![inpaint_o1](./samples/inpaint_o1.png)|
93
  |![inpaint_i2](./samples/inpaint_i2.png)|![inpaint_o2](./samples/inpaint_o2.png)|
94
  ### Styled Entity Control
95
+ Demonstration of the styled entity control results with EliGen and IP-Adapter, see [entity_control_ipadapter.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for generation prompts.
96
  |Style Reference|Entity Control Variance 1|Entity Control Variance 2|Entity Control Variance 3|
97
  |-|-|-|-|
98
  |![ip_ref](./samples/ip_ref.png)|![ip_1](./samples/ip_1.png)|![ip_2](./samples/ip_2.png)|![ip_3](./samples/ip_3.png)|
99
 
100
  ### Entity Transfer
101
+ Demonstration of the entity transfer results with EliGen and In-Context LoRA, see [entity_transfer.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for generation prompts.
102
 
103
  |Entity to Transfer|Transfer Target Image|Transfer Example 1|Transfer Example 2|
104
  |-|-|-|-|