Attention-Based Real Image Restoration

Saeed Anwar, Nick Barnes, Lars Petersson

Research output: Contribution to journalArticlepeer-review

Abstract

Deep convolutional neural networks perform better on images containing spatially invariant degradations, also known as synthetic degradations; however, their performance is limited on real-degraded photographs and requires multiple-stage network modeling. To advance the practicability of restoration algorithms, this article proposes a novel single-stage blind real image restoration network (R²Net) by employing a modular architecture. We use a residual on the residual structure to ease low-frequency information flow and apply feature attention to exploit the channel dependencies. Furthermore, the evaluation in terms of quantitative metrics and visual quality for four restoration tasks, i.e., denoising, super-resolution, raindrop removal, and JPEG compression on 11 real degraded datasets against more than 30 state-of-the-art algorithms, demonstrates the superiority of our R²Net. We also present the comparison on three synthetically generated degraded datasets for denoising to showcase our method's capability on synthetics denoising. The codes, trained models, and results are available on https://github.com/saeed-anwar/R2Net.

Original languageEnglish
JournalIEEE Transactions on Neural Networks and Learning Systems
DOIs
StateAccepted/In press - 2021
Externally publishedYes

Bibliographical note

Publisher Copyright:
IEEE

Keywords

  • Computational modeling
  • Convolutional neural networks (CNNs)
  • Degradation
  • Image restoration
  • JPEG compression
  • Noise measurement
  • Noise reduction
  • Superresolution
  • Transform coding
  • deep learning
  • denoising
  • feature attention
  • image degradations
  • raindrop removal
  • real restoration
  • super-resolution.

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Attention-Based Real Image Restoration'. Together they form a unique fingerprint.

Cite this