WinCLIP

This is an unofficial implementation of WinCLIP in AnomalyCLIP

The implementation of CLIP is based on open_clip

Performance evaluation

Zero-shot

MVTec AD

objects	auroc_px	f1_px	ap_px	aupro	auroc_sp	f1_sp	ap_sp
carpet	90.9	33.9	26	66.3	99.3	97.8	99.8
bottle	85.7	49.4	49.8	69.9	98.6	97.6	99.5
hazelnut	95.7	39.1	33.3	81.3	92.3	88.6	96
leather	95.5	30.8	20.5	86	100	100	100
cable	61.3	12.2	6.2	39.4	85	84.8	89.8
capsule	87	14.3	8.6	63.8	68.7	93.5	90.5
grid	79.4	13.7	5.7	49.3	99.2	98.2	99.7
pill	72.7	11.8	7	66.9	81.5	91.6	96.4
transistor	83.7	27	20.2	45.5	89.1	80	84.9
metal_nut	49.3	23.8	10.8	39.7	96.2	95.3	99.1
screw	91.1	11.3	5.4	70.2	71.7	85.9	87.7
toothbrush	86.2	10.5	5.5	67.9	85.3	88.9	94.5
zipper	91.7	27.8	19.4	72	91.2	93.4	97.5
tile	79.1	30.8	21.2	54.5	99.9	99.4	100
wood	85.1	35.4	32.9	56.3	97.6	95.2	99.3
mean	82.3	24.8	18.2	61.9	90.4	92.7	95.6

VisA

objects	auroc_px	f1_px	ap_px	aupro	auroc_sp	f1_sp	ap_sp
candle	87	8.9	2.3	77.7	94.9	90.6	95.4
capsules	80	4.2	1.4	39.4	79.4	80.5	87.9
cashew	84.8	9.6	4.8	78.4	91.2	88.9	96
chewinggum	95.4	31.5	24	69.6	95.5	93.8	98.2
fryum	87.7	16.2	11.1	74.4	73.6	80	86.9
macaroni1	50.3	0.1	0	24.7	79	74.2	80
macaroni2	44.7	0.1	0	8	67.1	68.8	65.1
pcb1	38.7	0.9	0.4	20.7	72.1	70.2	73
pcb2	58.7	1.5	0.4	20.6	47	67.1	46.1
pcb3	76	2.1	0.7	43.7	63.9	67.6	63
pcb4	91.4	24.6	15.5	74.5	74.2	75.7	70.1
pipe_fryum	83.6	8.3	4.4	80.3	67.8	80.3	82.1
mean	73.2	9	5.4	51	75.5	78.2	78.7

Few-shot

MVTec AD (1-shot)

objects	auroc_px	f1_px	ap_px	aupro	auroc_sp	f1_sp	ap_sp
carpet	99.1	66.1	69.4	95.9	100	99.4	100
bottle	94.3	60.9	64.9	85.1	99.4	98.4	99.8
hazelnut	98.5	58.9	61.1	93.4	98	95.6	99
leather	99.2	45.4	39.3	97.8	100	99.5	100
cable	86.9	28.7	22.8	65	89.2	86.3	93.4
capsule	96.4	32.3	24.7	89.7	83.5	92.4	96.3
grid	94.1	28.7	19.1	82.1	99.6	99.1	99.9
pill	92.4	36.1	28.7	89.8	89.6	93.3	98
transistor	90	41.2	41.1	67.5	89.6	80.9	85.7
metal_nut	78.5	36.5	28.7	75.3	98.2	97.4	99.6
screw	95.9	23.5	14.4	84.5	81.5	86.8	93.1
toothbrush	96	33.6	26.3	82.8	91.4	90.6	96.6
zipper	97	46.5	40.8	90.5	86.4	90.3	95.8
tile	91.7	53.5	46.2	77.5	100	99.4	100
wood	94.5	56.4	59.4	84.5	99	96.8	99.7
mean	93.6	43.2	39.1	84.1	93.7	93.7	97.1

MVTec AD (2-shot)

objects	auroc_px	f1_px	ap_px	aupro	auroc_sp	f1_sp	ap_sp
carpet	99	64.5	68.2	95.6	99.8	98.9	99.9
bottle	94.8	62.4	66.3	85.9	99.6	98.4	99.9
hazelnut	98.7	61.6	63.9	93.6	97.9	95.7	98.9
leather	99.2	45.2	39	97.9	99.9	99.5	100
cable	88.8	31.5	25.3	72.5	91	89.5	94
capsule	95.6	23.1	11.9	86.8	66	92.6	88.1
grid	94.8	30.3	20.7	83.9	99.4	99.1	99.8
pill	92.8	39.5	32.9	90.4	92.9	95.3	98.6
transistor	89.8	41	40.4	66.7	89.5	79.2	85.6
metal_nut	76.7	35.2	26.8	73.8	98.5	98.4	99.7
screw	96.7	25.6	18	87.5	82.9	86.9	93.5
toothbrush	96.4	36.6	29.9	82	93.3	92.1	97.6
zipper	97.2	50	43.9	91.1	95.2	94.8	98.7
tile	92	53.9	46.4	78	99.9	99.4	100
wood	94.5	56.2	58.5	86	99.5	98.3	99.8
mean	93.8	43.8	39.5	84.8	93.7	94.5	96.9

MVTec AD (4-shot)

objects	auroc_px	f1_px	ap_px	aupro	auroc_sp	f1_sp	ap_sp
carpet	99	65.1	68.9	95.5	99.9	99.4	100
bottle	94.4	62.1	65.7	85.2	99.4	97.6	99.8
hazelnut	98.5	60.7	62.5	92.8	97.6	95	98.8
leather	99.3	45.4	39.3	97.8	100	100	100
cable	89	31.7	25.8	71.4	89.6	88.4	92.9
capsule	97.2	35.7	27.9	91.1	86.5	94	96.9
grid	95.1	30	22	84	99.7	98.2	99.9
pill	93	40.9	34.4	90.9	92.4	94.1	98.5
transistor	89.4	40.6	39.2	65.5	90.4	80.4	87.3
metal_nut	80.2	38	31.1	78	99.3	98.4	99.8
screw	96	22	15.1	85	81.4	89.1	91.6
toothbrush	98.2	55.1	50.8	88.6	98.1	96.7	99.3
zipper	97.4	51.3	46.2	91.2	95.5	94.8	98.8
tile	91.7	53.1	45.3	77.7	100	99.4	100
wood	94.5	56.6	59.3	86.6	99.3	97.5	99.8
mean	94.2	45.9	42.2	85.4	95.3	94.9	97.6

VisA (1-shot)

Quick start

Zero-shot anomaly detection

bash zero_shot.sh

Few-shot anomaly detection

bash few_shot.sh

BibTex Citation

If you find this paper and repository useful, please cite our paper.

@article{zhou2023anomalyclip,
  title={AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection},
  author={Zhou, Qihang and Pang, Guansong and Tian, Yu and He, Shibo and Chen, Jiming},
  journal={arXiv preprint arXiv:2310.18961},
  year={2023}
}