Depth-Aware Shadow Removal

dc.contributor.authorFu, Yanpingen_US
dc.contributor.authorGai, Zhenyuen_US
dc.contributor.authorZhao, Haifengen_US
dc.contributor.authorZhang, Shaojieen_US
dc.contributor.authorShan, Yingen_US
dc.contributor.authorWu, Yangen_US
dc.contributor.authorTang, Jinen_US
dc.contributor.editorUmetani, Nobuyukien_US
dc.contributor.editorWojtan, Chrisen_US
dc.contributor.editorVouga, Etienneen_US
dc.date.accessioned2022-10-04T06:41:31Z
dc.date.available2022-10-04T06:41:31Z
dc.date.issued2022
dc.description.abstractShadow removal from a single image is an ill-posed problem because shadow generation is affected by the complex interactions of geometry, albedo, and illumination. Most recent deep learning-based methods try to directly estimate the mapping between the non-shadow and shadow image pairs to predict the shadow-free image. However, they are not very effective for shadow images with complex shadows or messy backgrounds. In this paper, we propose a novel end-to-end depth-aware shadow removal method without using depth images, which estimates depth information from RGB images and leverages the depth feature as guidance to enhance shadow removal and refinement. The proposed framework consists of three components, including depth prediction, shadow removal, and boundary refinement. First, the depth prediction module is used to predict the corresponding depth map of the input shadow image. Then, we propose a new generative adversarial network (GAN) method integrated with depth information to remove shadows in the RGB image. Finally, we propose an effective boundary refinement framework to alleviate the artifact around boundaries after shadow removal by depth cues. We conduct experiments on several public datasets and real-world shadow images. The experimental results demonstrate the efficiency of the proposed method and superior performance against state-of-the-art methods.en_US
dc.description.number7
dc.description.sectionheadersImage Restoration
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14691
dc.identifier.issn1467-8659
dc.identifier.pages455-464
dc.identifier.pages10 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14691
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14691
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies --> Image processing; Computational photography
dc.subjectComputing methodologies
dc.subjectImage processing
dc.subjectComputational photography
dc.titleDepth-Aware Shadow Removalen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
v41i7pp455-464.pdf
Size:
1.56 MB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
paper1159_supplemental_material.pdf
Size:
447.73 KB
Format:
Adobe Portable Document Format
Collections