Skip to content

Face clustering benchmarks

Marcel Klehr edited this page May 15, 2023 · 34 revisions

Benchmark: ~22000 photos of the first ~2000 people from IMDb-Face dataset with 20-200 photos each.

v4.0.1

Results
{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 2622 }
{ clusteredFacesRate: 0.17755806866662152 }
{ clusteredTargetFaces: 959 }
{ clusteredTargetFacesRate: 0.1052111903455842 }
{ shitClusterRate: 0.10638297872340426 }
{ targettedShitClusterRate: 0.06593406593406594 }
{ averageClusterAccuracy: 0.8848324957536976 }
{ averageClusterTargetAccuracy: 0.9186972476685288 }
{ weightedAccuracy: 0.15710914903949313 }
{ weightedTargetAccuracy: 0.09665723099441789 }

v4.0.1 with voting and smaller minSampleSize

Results
{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 3145 }
{ clusteredFacesRate: 0.21297487641362498 }
{ clusteredTargetFaces: 1153 }
{ clusteredTargetFacesRate: 0.12649478880965442 }
{ shitClusterRate: 0.13392857142857142 }
{ targettedShitClusterRate: 0.046296296296296294 }
{ averageClusterAccuracy: 0.8452653408860407 }
{ averageClusterTargetAccuracy: 0.9183654501253514 }
{ weightedAccuracy: 0.1800202815119251 }
{ weightedTargetAccuracy: 0.11616844366368956 }

v4.0.1 with voting and sampled rejections

Results
{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 3421 }
{ clusteredFacesRate: 0.2316651994311641 }
{ clusteredTargetFaces: 1257 }
{ clusteredTargetFacesRate: 0.13790455293472298 }
{ shitClusterRate: 0.12698412698412698 }
{ targettedShitClusterRate: 0.05785123966942149 }
{ averageClusterAccuracy: 0.865709659123329 }
{ averageClusterTargetAccuracy: 0.9234653901213209 }
{ weightedAccuracy: 0.2005548008302911 }
{ weightedTargetAccuracy: 0.1273500817753703 }

v4.0.1 with voting, sampled rejections and original min sample size

Results
{ totalPhotos: 24225 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6095768833849329 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 2839 }
{ clusteredFacesRate: 0.19225299654635336 }
{ clusteredTargetFaces: 1024 }
{ clusteredTargetFacesRate: 0.11234229292375206 }
{ shitClusterRate: 0.10185185185185185 }
{ targettedShitClusterRate: 0.04854368932038835 }
{ averageClusterAccuracy: 0.894196891388111 }
{ averageClusterTargetAccuracy: 0.9392296444909238 }
{ weightedAccuracy: 0.1719120318717984 }
{ weightedTargetAccuracy: 0.10551521184407087 }

v4.0.1 with voting , sampled rejections, and proper sample size / cluster size ratio

Results
{ totalPhotos: 24225 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6095768833849329 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 3291 }
{ clusteredFacesRate: 0.22286178641565654 }
{ clusteredTargetFaces: 1178 }
{ clusteredTargetFacesRate: 0.1292375205704882 }
{ shitClusterRate: 0.07534246575342465 }
{ targettedShitClusterRate: 0.029411764705882353 }
{ averageClusterAccuracy: 0.9090423913173917 }
{ averageClusterTargetAccuracy: 0.9500084568014378 }
{ weightedAccuracy: 0.20259081125655423 }
{ weightedTargetAccuracy: 0.12277673747801357 }

v4.0.1 with voting , sampled rejections, proper sample size / cluster size ratio and alpha factor = 0.6

Results
{ totalPhotos: 24225 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6095768833849329 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 3718 }
{ clusteredFacesRate: 0.25177761224351597 }
{ clusteredTargetFaces: 1307 }
{ clusteredTargetFacesRate: 0.14339001645639057 }
{ shitClusterRate: 0.10596026490066225 }
{ targettedShitClusterRate: 0.034482758620689655 }
{ averageClusterAccuracy: 0.8612823800669005 }
{ averageClusterTargetAccuracy: 0.9113445503727365 }
{ weightedAccuracy: 0.21685162112065662 }
{ weightedTargetAccuracy: 0.13067771007538856 }

v4.0.1 with voting , sampled rejections, original min sample size and alpha factor = 0.6

Results

Clone this wiki locally