Cloud-removal-model-collection

A collection of the existing end-to-end cloud removal models

This project includes the code for the MDSA, CVAE, AMGAN, SPAGAN, and MemoryNet models designed for cloud removal. Additionally, it incorporates the data loaders for RICE, WHU, T-Cloud, and a custom dataset named CUHK-CR (located in the 'dataloader' directory under the file named 'My.py'). The respective papers for these models and the download links for the datasets are provided below.

🔥 Congradualation to my collaborators and myself! This paper has been accepted by IEEE Transactions on Geoscience and Remote Sensing! It's a new start! The code for Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery could be found at https://github.com/littlebeen/DDPM-Enhancement-for-Cloud-Removal

datasets

• RICE paper download link

• T-Cloud paper download link pick up code:t63d

• WHU download link

• CUHK-CR paper download link

models

• cvae : Uncertainty-Based Thin Cloud Removal Network via Conditional Variational Autoencoders

• mdsa : Cloud Removal in Optical Remote Sensing Imagery Using Multiscale Distortion-Aware Networks

• amgan : Attention mechanism-based generative adversarial networks for cloud removal in Landsat images

• spagan : Cloud Removal for Remote Sensing Imagery vai Spatial Attention Generative Adversarial Network

• memorynet : Memory augment is All You Need for image restoration

Usage

Train

1. Add your output dir path in the config and choose the model you need (mn, mdsa, cvae, spagan, amgan)
2. Change the dataset path in the dataload/xx.py
3. python train.py

Test

1. Put the pretained model in the pre_train dir and change the config
2. python test.py (metrics include SSIM, PSNR and LPIPS)

Cite

If this project is useful to you, please cite this paper :)

@article{sui2024diffusion,
  author={Sui, Jialu and Ma, Yiyang and Yang, Wenhan and Zhang, Xiaokang and Pun, Man-On and Liu, Jiaying},
  journal={IEEE Transactions on Geoscience and Remote Sensing}, 
  title={Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery}, 
  year={2024},
  volume={62},
  pages={1-14},
  doi={10.1109/TGRS.2024.3411671}}

If you have any questions, be free to contact me!