Abstract
The thermal-to-visible (T2V) face translation task is essential for enabling face verification in low-light or dark conditions by converting thermal infrared faces into their visible counterparts. However, this task faces two primary challenges. First, the inherent differences between the modalities hinder the effective use of thermal information to guide RGB face reconstruction. Second, translated RGB faces often lack the identity details of the corresponding visible faces, such as skin color. To tackle these challenges, we introduce DiffTV, the first Latent Diffusion Model (LDM) specifically designed for T2V facial image translation with a focus on preserving identity. Our approach proposes a novel heterogeneous feature alignment strategy that bridges the modal gap and extracts both coarse-and fine-grained identity features consistent with visible images. Furthermore, a dual-stage condition injection strategy introduces control information to guide identity-preserved translation. Experimental results demonstrate the superior performance of DiffTV, particularly in scenarios where maintaining identity integrity is critical.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 32nd ACM International Conference on Multimedia |
| Editors | Yadan Luo, Toan Do, Yan Yan |
| Place of Publication | New York NY USA |
| Publisher | Association for Computing Machinery (ACM) |
| Pages | 10930-10938 |
| Number of pages | 9 |
| ISBN (Electronic) | 9798400706868 |
| DOIs | |
| Publication status | Published - 2024 |
| Event | ACM International Conference on Multimedia 2024 - Melbourne, Australia Duration: 28 Oct 2024 → 1 Nov 2024 Conference number: 32nd https://dl.acm.org/doi/book/10.1145/3664647 (Proceedings) https://2024.acmmm.org/ (Website) |
Conference
| Conference | ACM International Conference on Multimedia 2024 |
|---|---|
| Abbreviated title | MM 2024 |
| Country/Territory | Australia |
| City | Melbourne |
| Period | 28/10/24 → 1/11/24 |
| Internet address |
|
Keywords
- diffusion model
- identity-preserving
- image translation
- thermal-to-visible
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver