File size: 3,600 Bytes
1ae9872
fa556b1
 
 
 
 
 
d755ae2
1ae9872
 
 
a973422
 
17a14e9
a12f521
 
15f2ccc
 
17a14e9
 
 
a12f521
8eb9ce4
3e1c3ec
17a14e9
 
 
 
15f2ccc
99745bb
a12f521
17a14e9
 
15f2ccc
17a14e9
7f4e1be
17a14e9
15f2ccc
17a14e9
 
1fdff79
3e1c3ec
17a14e9
 
15f2ccc
17a14e9
 
 
 
7f4e1be
99745bb
7f4e1be
1fdff79
a125be2
 
1964f63
99745bb
1964f63
a125be2
99745bb
 
a12f521
99745bb
 
 
 
 
 
 
 
a12f521
a125be2
9af3c99
a12f521
9af3c99
34c6239
9af3c99
a12f521
9af3c99
99745bb
 
 
 
 
 
 
15f2ccc
 
99745bb
1964f63
99745bb
 
a973422
 
 
99745bb
a973422
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
---
title: My Face Enhancement Space
emoji: 😊
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.25.2
app_file: demo.py
pinned: false
---

# Face Enhance
A tool for improving facial consistency and quality in AI-generated images. Dramatically enhance facial fidelity while preserving the original image's background, lighting, and composition.

<div style="text-align: center;">
  <img src="examples/elon_compare.gif" alt="Elon Comparison" width="600"/>
</div>

## Installation

### Prerequisites
- Python 3.11 or higher
- 1 GPU with 48GB VRAM
- At least 50GB of free disk space

### Setup

1. Set up your Hugging Face token:
   - Create a token at [Hugging Face](https://huggingface.co/settings/tokens)
   - Log into Hugging Face and accept their terms of service to download [Flux.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
   - Set the following environment variables:
     ```
     export HUGGINGFACE_TOKEN=your_token_here
     export HF_HOME=/path/to/your/huggingface_cache
     ```
   - Models will be downloaded to `$HF_HOME` and symlinked to `./ComfyUI/models/`

2. Create the virtual environment:
   ```
   python -m venv venv
   source venv/bin/activate
   python -m pip install -r requirements.txt
   ```

3. Run the install script:
   ```
   python install.py
   ```

   This will
   - Install ComfyUI, custom nodes, and remaining dependencies to your venv
   - Download all required models (Flux.1-dev, ControlNet, text encoders, PuLID, and more)

4. Run inference on one example:

   ```
   python test.py --input examples/dany_gpt_1.png --ref examples/dany_face.jpg --out examples/dany_enhanced.png
   ```

   <details>
   <summary>Arguments</summary>

   - `--input` (str): Path to the input image.
   - `--ref` (str): Path to the reference face image.
   - `--output` (str): Path to save the output image.
   - `--crop` (store_true): Flag to face crop the reference image. Default: False.
   - `--upscale` (store_true): Flag to upscale the (cropped) reference image. Default: False.
   - `--caption` (store_true): Flag to caption the input image. Default: False.
   - `--id_weight` (float): Face ID weight. Default: 0.75.
   </details>

## Gradio Demo

A simple web interface for the face enhancement workflow. 

1. Run `python demo.py`

2. Go to http://localhost:7860. You may need to enable port forwarding.

## Running on ComfyUI

Using the ComfyUI workflows is the fastest way to get started. Run `python run_comfy.py`. There are two workflows:
- `./workflows/FaceEnhancementProd.json` for face enhancement
- `./workflows/FaceEmbedDist.json` for computing the [face embedding distance](https://github.com/cubiq/ComfyUI_FaceAnalysis)


### Notes
- The script and demo run a ComfyUI server ephemerally
- Gradio demo is faster than the script because the models remain loaded in memory and ComfyUI server is booted up.
- All images are saved in `./ComfyUI/input/scratch/`
- `FaceEnhancementProd.py` was created with the [ComfyUI-to-Python-Extension](https://github.com/pydn/ComfyUI-to-Python-Extension) and re-engineered for efficiency and function.
- Face cropping, upscaling, and captioning are unavailable; these will be added in an update.

### Troubleshooting

- **Out of memory errors**: If your GPU has less than 48 GB VRAM, install [Flux.1-dev at fp8 precision](https://huggingface.co/Comfy-Org/flux1-dev).
- **Face detection issues**: This method works for photorealistic images of people. It may not work on cartoons, anime characters, or non-human subjects.
- **Downloading models fails**: Check your Hugging Face token has proper permissions.