Interactively Assessing Disentanglement in GANs

dc.contributor.authorJeong, Sangwonen_US
dc.contributor.authorLiu, Shusenen_US
dc.contributor.authorBerger, Matthewen_US
dc.contributor.editorBorgo, Ritaen_US
dc.contributor.editorMarai, G. Elisabetaen_US
dc.contributor.editorSchreck, Tobiasen_US
dc.date.accessioned2022-06-03T06:05:43Z
dc.date.available2022-06-03T06:05:43Z
dc.date.issued2022
dc.description.abstractGenerative adversarial networks (GAN) have witnessed tremendous growth in recent years, demonstrating wide applicability in many domains. However, GANs remain notoriously difficult for people to interpret, particularly for modern GANs capable of generating photo-realistic imagery. In this work we contribute a visual analytics approach for GAN interpretability, where we focus on the analysis and visualization of GAN disentanglement. Disentanglement is concerned with the ability to control content produced by a GAN along a small number of distinct, yet semantic, factors of variation. The goal of our approach is to shed insight on GAN disentanglement, above and beyond coarse summaries, instead permitting a deeper analysis of the data distribution modeled by a GAN. Our visualization allows one to assess a single factor of variation in terms of groupings and trends in the data distribution, where our analysis seeks to relate the learned representation space of GANs with attribute-based semantic scoring of images produced by GANs. Through use-cases, we show that our visualization is effective in assessing disentanglement, allowing one to quickly recognize a factor of variation and its overall quality. In addition, we show how our approach can highlight potential dataset biases learned by GANs.en_US
dc.description.number3
dc.description.sectionheadersVisualization and Machine Learning
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14524
dc.identifier.issn1467-8659
dc.identifier.pages85-95
dc.identifier.pages11 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14524
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14524
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies --> Artificial intelligence; Model verification and validation
dc.subjectComputing methodologies
dc.subjectArtificial intelligence
dc.subjectModel verification and validation
dc.titleInteractively Assessing Disentanglement in GANsen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
v41i3pp085-095.pdf
Size:
25.27 MB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
1115-file1.pdf
Size:
391.37 KB
Format:
Adobe Portable Document Format
Collections