A collection of the existing end-to-end cloud removal models
This project includes the code for the MDSA, CVAE, AMGAN, SPAGAN, and MemoryNet models designed for cloud removal. Additionally, it incorporates the data loaders for RICE, WHU, T-Cloud, and a custom dataset named CUHK-CR (located in the 'dataloader' directory under the file named 'My.py'). The respective papers for these models and the download links for the datasets are provided below.
🔥 Congradualation to my collaborators and myself! This paper has been accepted by IEEE Transactions on Geoscience and Remote Sensing! It's a new start! The code for Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery could be found at https://github.com/littlebeen/DDPM-Enhancement-for-Cloud-Removal
datasets
-
RICE paper download link
-
T-Cloud paper download link pick up code:t63d
-
WHU download link
-
CUHK-CR paper download link
models
-
cvae : Uncertainty-Based Thin Cloud Removal Network via Conditional Variational Autoencoders
-
mdsa : Cloud Removal in Optical Remote Sensing Imagery Using Multiscale Distortion-Aware Networks
-
amgan : Attention mechanism-based generative adversarial networks for cloud removal in Landsat images
-
spagan : Cloud Removal for Remote Sensing Imagery vai Spatial Attention Generative Adversarial Network
-
memorynet : Memory augment is All You Need for image restoration
Train
- Add your output dir path in the config and choose the model you need (mn, mdsa, cvae, spagan, amgan)
- Change the dataset path in the dataload/xx.py
- python train.py
Test
- Put the pretained model in the pre_train dir and change the config
- python test.py (metrics include SSIM, PSNR and LPIPS)
If this project is useful to you, please cite this paper :)
@article{sui2024diffusion,
author={Sui, Jialu and Ma, Yiyang and Yang, Wenhan and Zhang, Xiaokang and Pun, Man-On and Liu, Jiaying},
journal={IEEE Transactions on Geoscience and Remote Sensing},
title={Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery},
year={2024},
volume={62},
pages={1-14},
doi={10.1109/TGRS.2024.3411671}}
If you have any questions, be free to contact me!