Upload README.md
Browse files
README.md
CHANGED
@@ -40,14 +40,14 @@ cd DiffSynth-Studio
|
|
40 |
pip install -e .
|
41 |
```
|
42 |
1. **Entity-Level Controlled Image Generation**
|
43 |
-
EliGen achieves effective entity-level control results. See [entity_control.py](https://github.com/
|
44 |
2. **Image Inpainting**
|
45 |
To apply EliGen to image inpainting task, we propose a inpainting fusion pipeline to preserve the non-painting areas while enabling precise, entity-level modifications over inpaining regions.
|
46 |
-
See [entity_inpaint.py](https://github.com/
|
47 |
3. **Styled Entity Control**
|
48 |
-
EliGen can be seamlessly integrated with existing community models. We have provided an example of how to integrate it with the IP-Adpater. See [entity_control_ipadapter.py](https://github.com/
|
49 |
4. **Entity Transfer**
|
50 |
-
We have provided an example of how to integrate EliGen with In-Cotext LoRA, which achieves interesting entity transfer results. See [entity_transfer.py](https://github.com/
|
51 |
5. **Play with EliGen using UI**
|
52 |
Download the checkpoint of EliGen from [ModelScope](https://www.modelscope.cn/models/DiffSynth-Studio/Eligen) to `models/lora/entity_control` and run the following command to try interactive UI:
|
53 |
```bash
|
@@ -65,7 +65,7 @@ pip install -e .
|
|
65 |
</video>
|
66 |
</div>
|
67 |
|
68 |
-
1. The image generation effect of complex Entity combinations, demonstrating the strong generalization of EliGen. See [entity_control.py](https://github.com/
|
69 |
|
70 |
|Entity Conditions|Generated Image|
|
71 |
|-|-|
|
@@ -76,7 +76,7 @@ pip install -e .
|
|
76 |
|||
|
77 |
|||
|
78 |
|
79 |
-
1. Demonstration of the robustness of EliGen. The following examples are generated using the same prompt but different seeds. Refer to [entity_control.py](https://github.com/
|
80 |
|
81 |
|Entity Conditions|Generated Image|
|
82 |
|-|-|
|
@@ -86,19 +86,19 @@ pip install -e .
|
|
86 |
|||
|
87 |
|
88 |
### Image Inpainting
|
89 |
-
Demonstration of the inpainting mode of EliGen, see [entity_inpaint.py](https://github.com/
|
90 |
|Inpainting Input|Inpainting Output|
|
91 |
|-|-|
|
92 |
|||
|
93 |
|||
|
94 |
### Styled Entity Control
|
95 |
-
Demonstration of the styled entity control results with EliGen and IP-Adapter, see [entity_control_ipadapter.py](https://github.com/
|
96 |
|Style Reference|Entity Control Variance 1|Entity Control Variance 2|Entity Control Variance 3|
|
97 |
|-|-|-|-|
|
98 |
|||||
|
99 |
|
100 |
### Entity Transfer
|
101 |
-
Demonstration of the entity transfer results with EliGen and In-Context LoRA, see [entity_transfer.py](https://github.com/
|
102 |
|
103 |
|Entity to Transfer|Transfer Target Image|Transfer Example 1|Transfer Example 2|
|
104 |
|-|-|-|-|
|
|
|
40 |
pip install -e .
|
41 |
```
|
42 |
1. **Entity-Level Controlled Image Generation**
|
43 |
+
EliGen achieves effective entity-level control results. See [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) for usage.
|
44 |
2. **Image Inpainting**
|
45 |
To apply EliGen to image inpainting task, we propose a inpainting fusion pipeline to preserve the non-painting areas while enabling precise, entity-level modifications over inpaining regions.
|
46 |
+
See [entity_inpaint.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for usage.
|
47 |
3. **Styled Entity Control**
|
48 |
+
EliGen can be seamlessly integrated with existing community models. We have provided an example of how to integrate it with the IP-Adpater. See [entity_control_ipadapter.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for usage.
|
49 |
4. **Entity Transfer**
|
50 |
+
We have provided an example of how to integrate EliGen with In-Cotext LoRA, which achieves interesting entity transfer results. See [entity_transfer.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for usage.
|
51 |
5. **Play with EliGen using UI**
|
52 |
Download the checkpoint of EliGen from [ModelScope](https://www.modelscope.cn/models/DiffSynth-Studio/Eligen) to `models/lora/entity_control` and run the following command to try interactive UI:
|
53 |
```bash
|
|
|
65 |
</video>
|
66 |
</div>
|
67 |
|
68 |
+
1. The image generation effect of complex Entity combinations, demonstrating the strong generalization of EliGen. See [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_1-6` for generation prompts.
|
69 |
|
70 |
|Entity Conditions|Generated Image|
|
71 |
|-|-|
|
|
|
76 |
|||
|
77 |
|||
|
78 |
|
79 |
+
1. Demonstration of the robustness of EliGen. The following examples are generated using the same prompt but different seeds. Refer to [entity_control.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control.py) `example_7` for the prompts.
|
80 |
|
81 |
|Entity Conditions|Generated Image|
|
82 |
|-|-|
|
|
|
86 |
|||
|
87 |
|
88 |
### Image Inpainting
|
89 |
+
Demonstration of the inpainting mode of EliGen, see [entity_inpaint.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_inpaint.py) for generation prompts.
|
90 |
|Inpainting Input|Inpainting Output|
|
91 |
|-|-|
|
92 |
|||
|
93 |
|||
|
94 |
### Styled Entity Control
|
95 |
+
Demonstration of the styled entity control results with EliGen and IP-Adapter, see [entity_control_ipadapter.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_control_ipadapter.py) for generation prompts.
|
96 |
|Style Reference|Entity Control Variance 1|Entity Control Variance 2|Entity Control Variance 3|
|
97 |
|-|-|-|-|
|
98 |
|||||
|
99 |
|
100 |
### Entity Transfer
|
101 |
+
Demonstration of the entity transfer results with EliGen and In-Context LoRA, see [entity_transfer.py](https://github.com/modelscope/DiffSynth-Studio/tree/main/examples/EntityControl/entity_transfer.py) for generation prompts.
|
102 |
|
103 |
|Entity to Transfer|Transfer Target Image|Transfer Example 1|Transfer Example 2|
|
104 |
|-|-|-|-|
|