Awesome-All-In-One-Image-Restoration (Updating)

This curated list of papers related to all-in-one image/video restoration. All-in-one image/video restoration aims to handle multiple degradations with one model [1].

We mark works contributed by ourselves with ⭐.

This repository now is maintained by Boyun Li, Yuanbiao Gou and Haiyu Zhao, feel free to contact us if you have any questions.

Table of Contents

• All-In-One Image Restoration
  • Open-set Image Restoration
  • Blind All-In-One Image Restoration
  • Non-All-In-One Image Restoration
• All-In-One Video Restoration
• Misc

All-In-One Image Restoration

Open-set Image Restoration

• [2024 ICML] ⭐ Test-Time Degradation Adaption for Open-Set Image Restoration
  Yuanbiao Gou, Haiyu Zhao, Boyun Li, Xinyan Xiao, Xi Peng
  [paper]

Blind All-In-One Image Restoration

2022

• [2022 CVPR] ⭐ All-In-One Image Restoration for Unknown Corruption
  Boyun Li, Xiao Liu, Peng Hu, Zhongqin Wu, Jiancheng Lv, Xi Peng
  [paper] [code]

• [2022 CVPR] TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions
  Jeya Maria Jose Valanarasu, Rajeev Yasarla, Vishal M. Patel
  [paper] [code]

2023

• [2023 NIPS] PromptIR: Prompting for All-in-One Blind Image Restoration
  Vaishnav Potlapalli, Syed Waqas Zamir, Salman Khan, Fahad Shahbaz Khan
  [paper] [code]
• [2023 CVPR] Ingredient-oriented Multi-Degradation Learning for Image Restoration
  Jinghao Zhang, Jie Huang, Mingde Yao, Zizheng Yang, Hu Yu, Man Zhou, Feng Zhao
  [paper] [code]
• [2023 CVPR] Learning Weather-General and Weather-Specific Features for Image Restoration Under Multiple Adverse Weather Conditions
  Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, Xiaowei Hu
  [paper] [code]
• [2023 ICCV] Adverse Weather Removal with Codebook Priors
  Tian Ye, Sixiang Chen, Jinbin Bai, Jun Shi, Chenghao Xue, Jingxia Jiang, Junjie Yin, Erkang Chen, Yun Liu
  [paper] [code]
• [2023 TPAMI] Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
  Ozan Özdenizci, Robert Legenstein
  [paper] [code]
• [2023 Arxiv] AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion
  Yitong Jiang, Zhaoyang Zhang, Tianfan Xue, Jinwei Gu
  [paper] [code]
• [2023 Arxiv] Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration
  Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, Ran He
  [paper]
• [2023 Arxiv] Prompt-In-Prompt Learning for Universal Image Restoration
  Zilong Li, Yiming Lei, Chenglong Ma, Junping Zhang, Hongming Shan
  [paper] [code]
• [2023 Arxiv] DRM-IR: Task-Adaptive Deep Unfolding Network for All-In-One Image Restoration
  Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Chao Wang
  [paper]
• [2023 Arxiv] Language-driven All-in-one Adverse Weather Removal
  Hao Yang, Liyuan Pan, Yan Yang, Wei Liang
  [paper]
• [2023 Arxiv] Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removal
  Yu-Wei Chen, Soo-Chang Pei
  [paper] [code]

2024

• [2024 ICLR] Controlling Vision-Language Models for Universal Image Restoration
  Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön
  [paper] [code]

• [2024 CVPR] Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model
  Dian Zheng, Xiao-Ming Wu, Shuzhou Yang, Jian Zhang, Jian-Fang Hu, Wei-Shi Zheng
  [paper] [code]

• [2024 Arxiv] AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulation
  Yuning Cui, Syed Waqas Zamir, Salman Khan, Alois Knoll, Mubarak Shah, Fahad Shahbaz Khan
  [paper] [code]

Non-Blind All-In-One Image Restoration

2020

• [2020 CVPR] All in One Bad Weather Removal Using Architectural Search
  Ruoteng Li, Robby T. Tan, Loong-Fah Cheong
  [paper]

2021

• [2021 CVPR] Pre-Trained Image Processing Transformer
  Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yiping Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, Wen Gao
  [paper] [code]

• [2021 TPAMI] A General Decoupled Learning Framework for Parameterized Image Operators
  Qingnan Fan, Dongdong Chen, Lu Yuan, Gang Hua, Nenghai Yu, Baoquan Chen
  [paper] [code]

• [2021 Arxiv] On Efficient Transformer-Based Image Pre-training for Low-Level Vision
  Wenbo Li, Xin Lu, Shengju Qian, Jiangbo Lu, Xiangyu Zhang, Jiaya Jia
  [paper] [code]

2022

• [2022 ECCV] TAPE: Task-Agnostic Prior Embedding for Image Restoration
  Lin Liu, Lingxi Xie, Xiaopeng Zhang, Shanxin Yuan, Xiangyu Chen, Wengang Zhou, Houqiang Li, Qi Tian
  [paper] [code]

2023

• [2023 CVPR] Generative Diffusion Prior for Unified Image Restoration and Enhancement
  Ben Fei, Zhaoyang Lyu, Liang Pan, Junzhe Zhang, Weidong Yang, Tianyue Luo, Bo Zhang, Bo Dai
  [paper] [code]
• [2023 Arxiv] Exploring Degradation-aware Visual Prompt for Universal Image Restoration
  Jiaqi Ma, Tianheng Cheng, Guoli Wang, Qian Zhang, Xinggang Wang, Lefei Zhang
  [paper] [code]

2024

• [2024 Arxiv] InstructIR: High-Quality Image Restoration Following Human Instructions
  Marcos V. Conde, Gregor Geigle, Radu Timofte
  [paper] [code]

All-In-One Video Restoration

2023

• [2023 ICCV] Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation
  Yijun Yang, Angelica I. Aviles-Rivero, Huazhu Fu, Ye Liu, Weiming Wang, Lei Zhu
  [paper] [code]

• [2023 Arxiv] Cross-Consistent Deep Unfolding Network for Adaptive All-In-One Video Restoration
  Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Yuanjian Qiao, Wangmeng Zuo, Deyu Meng
  [paper]

2024

• [2024 CVPR] Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal
  Yijun Yang, Hongtao Wu, Angelica I. Aviles-Rivero, Yulun Zhang, Jing Qin, Lei Zhu
  [paper] [code]

Misc

• [2022 Arxiv] Relationship Quantification of Image Degradations
  Wenxin Wang, Boyun Li, Yuanbiao Gou, Peng Hu, Xi Peng
  [paper]