ClarifyNet: A high-pass and low-pass filtering based CNN for single image dehazing

Susladkar, Onkar and Deshmukh, Gayatri and Nag, Subhrajit and Mantravadi, Ananya and Makwana, Dhruv and Ravichandran, Sujitha and Mohan, C Krishna and et al, . (2022) ClarifyNet: A high-pass and low-pass filtering based CNN for single image dehazing. Journal of Systems Architecture, 132. pp. 1-11. ISSN 1383-7621

Text
Journal_of_Systems_Architecture.pdf - Published Version
Restricted to Registered users only
Download (2MB) | Request a copy

Abstract

Dehazing refers to removing the haze and restoring the details from hazy images. In this paper, we propose ClarifyNet, a novel, end-to-end trainable, convolutional neural network architecture for single image dehazing. We note that a high-pass filter detects sharp edges, texture, and other fine details in the image, whereas a low-pass filter detects color and contrast information. Based on this observation, our key idea is to train ClarifyNet on ground-truth haze-free images, low-pass filtered images, and high-pass filtered images. Based on this observation, we present a shared-encoder multi-decoder model ClarifyNet which employs interconnected parallelization. While training, ground-truth haze-free images, low-pass filtered images, and high-pass filtered images undergo multi-stage filter fusion and attention. By utilizing a weighted loss function composed of SSIM loss and L1 loss, we extract and propagate complementary features. We comprehensively evaluate ClarifyNet on I-HAZE, O-HAZE, Dense-Haze, NH-HAZE, SOTS-Indoor, SOTS-Outdoor, HSTS, and Middlebury datasets. We use PSNR and SSIM metrics and compare the results with previous works. For most datasets, ClarifyNet provides the highest scores. On using EfficientNet-B6 as the backbone, ClarifyNet has 18 M parameters (model size of ∼71 MB) and a throughput of 8 frames-per-second while processing images of size 2048 × 1024. © 2022 Elsevier B.V.

[error in script]

IITH Creators: