38-Issue 7

Permanent URI for this collection

Now showing 1 - 1 of 1

Shadow Inpainting and Removal Using Generative Adversarial Networks with Slice Convolutions
(The Eurographics Association and John Wiley & Sons Ltd., 2019) Wei, Jinjiang; Long, Chengjiang; Zou, Hua; Xiao, Chunxia; Lee, Jehee and Theobalt, Christian and Wetzstein, Gordon
In this paper, we propose a two-stage top-down and bottom-up Generative Adversarial Networks (TBGANs) for shadow inpainting and removal which uses a novel top-down encoder and a bottom-up decoder with slice convolutions. These slice convolutions can effectively extract and restore the long-range spatial information for either down-sampling or up-sampling. Different from the previous shadow removal methods based on deep learning, we propose to inpaint shadow to handle the possible dark shadows to achieve a coarse shadow-removal image at the first stage, and then further recover the details and enhance the color and texture details with a non-local block to explore both local and global inter-dependencies of pixels at the second stage. With such a two-stage coarse-to-fine processing, the overall effect of shadow removal is greatly improved, and the effect of color retention in non-shaded areas is significant. By comparing with a variety of mainstream shadow removal methods, we demonstrate that our proposed method outperforms the state-of-the-art methods.