Integrating Layer-Wise Relevance Propagation with Stable Diffusion for Enhanced Interpretability

Loading...
Thumbnail Image
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Diffusion-based generative models, such as Stable Diffusion and DALL-E, have revolutionized artificial intelligence by enabling high-quality image generation from textual descriptions. Despite their success, these models raise ethical concerns, such as style appropriation and misuse, closely tied to the interpretability and transparency of the underlying mechanisms. This paper introduces a framework integrating Layer-wise Relevance Propagation (LRP) into the Stable Diffusion model to enhance interpretability. LRP assigns relevance scores to specific elements of textual prompts, allowing users to understand and visualize how input text influences image generation. We also present an interactive web-based visualization tool that supports intuitive exploration of diffusion processes. By improving interpretability, this approach fosters responsible use of generative AI technologies. A user study involving 35 participants demonstrates the tool's accessibility and effectiveness.
Description

CCS Concepts: Computing methodologies → Generative AI; Diffusion Models; Stable Diffusion; Layer-wise Relevance Propagation; AI Transparency; Human-centered computing → Visual analytics

        
@inproceedings{
10.2312:eurova.20251102
, booktitle = {
EuroVis Workshop on Visual Analytics (EuroVA)
}, editor = {
Schulz, Hans-Jörg
and
Villanova, Anna
}, title = {{
Integrating Layer-Wise Relevance Propagation with Stable Diffusion for Enhanced Interpretability
}}, author = {
Auman, Christian
and
Bhati, Deepshikha
and
Arquilla, Kyle
and
Neha, Fnu
and
Guercio, Angela
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISSN = {
2664-4487
}, ISBN = {
978-3-03868-283-7
}, DOI = {
10.2312/eurova.20251102
} }
Citation
Collections