Anywhere: A Multi-Agent Framework for Reliable and Diverse Foreground-Conditioned Image Inpainting

Quick start

Environment setup

git clone https://github.com/Sealical/anywhere-multi-agent.git
cd anywhere-multi-angent
conda create -n anywhere python=3.10 -y
conda activate anywhere
pip install -r requirements.txt 

Set-API-Key

Set up your API keys in structJsonOutput.struct_text_generate.py file

Download & Set model path

• Download RMBG-1.4 and set model path in rmbgSegMask.py file.
• Download ControlNet_SDXL_canny, RealVisXL_V4.0, SDXL_inpainting and set model path in product2Image.py file.

Usage

See more details in run_anywhere_pipeline.ipynb

Reference

@misc{xie2024anywhere,
      title={Anywhere: A Multi-Agent Framework for Reliable and Diverse Foreground-Conditioned Image Inpainting}, 
      author={Tianyidan Xie and Rui Ma and Qian Wang and Xiaoqian Ye and Feixuan Liu and Ying Tai and Zhenyu Zhang and Zili Yi},
      year={2024},
      eprint={2404.18598},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}