Skip to content

Face clustering benchmarks

Marcel Klehr edited this page May 15, 2023 · 34 revisions

Benchmark: ~22000 photos of the first ~2000 people from IMDb-Face dataset with 20-200 photos each.

v4.0.1

{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 2622 }
{ clusteredFacesRate: 0.17755806866662152 }
{ clusteredTargetFaces: 959 }
{ clusteredTargetFacesRate: 0.1052111903455842 }
{ shitClusterRate: 0.10638297872340426 }
{ targettedShitClusterRate: 0.06593406593406594 }
{ averageClusterAccuracy: 0.8848324957536976 }
{ averageClusterTargetAccuracy: 0.9186972476685288 }
{ weightedAccuracy: 0.15710914903949313 }
{ weightedTargetAccuracy: 0.09665723099441789 }

v4.0.1 with voting and smaller minSampleSize

{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 3145 }
{ clusteredFacesRate: 0.21297487641362498 }
{ clusteredTargetFaces: 1153 }
{ clusteredTargetFacesRate: 0.12649478880965442 }
{ shitClusterRate: 0.13392857142857142 }
{ targettedShitClusterRate: 0.046296296296296294 }
{ averageClusterAccuracy: 0.8452653408860407 }
{ averageClusterTargetAccuracy: 0.9183654501253514 }
{ weightedAccuracy: 0.1800202815119251 }
{ weightedTargetAccuracy: 0.11616844366368956 }

v4.0.1 with voting and sampled rejections

{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 3421 }
{ clusteredFacesRate: 0.2316651994311641 }
{ clusteredTargetFaces: 1257 }
{ clusteredTargetFacesRate: 0.13790455293472298 }
{ shitClusterRate: 0.12698412698412698 }
{ targettedShitClusterRate: 0.05785123966942149 }
{ averageClusterAccuracy: 0.865709659123329 }
{ averageClusterTargetAccuracy: 0.9234653901213209 }
{ weightedAccuracy: 0.2005548008302911 }
{ weightedTargetAccuracy: 0.1273500817753703 }

v4.0.1 with voting, sampled rejections and original min sample size

{ totalPhotos: 24225 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6095768833849329 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 2839 }
{ clusteredFacesRate: 0.19225299654635336 }
{ clusteredTargetFaces: 1024 }
{ clusteredTargetFacesRate: 0.11234229292375206 }
{ shitClusterRate: 0.10185185185185185 }
{ targettedShitClusterRate: 0.04854368932038835 }
{ averageClusterAccuracy: 0.894196891388111 }
{ averageClusterTargetAccuracy: 0.9392296444909238 }
{ weightedAccuracy: 0.1719120318717984 }
{ weightedTargetAccuracy: 0.10551521184407087 }

v4.0.1 with voting , sampled rejections, original min sample size and alpha factor = 0.9

{ totalPhotos: 24225 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6095768833849329 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 2870 }
{ clusteredFacesRate: 0.19435227195774363 }
{ clusteredTargetFaces: 1030 }
{ clusteredTargetFacesRate: 0.11300054854635216 }
{ shitClusterRate: 0.1111111111111111 }
{ targettedShitClusterRate: 0.04854368932038835 }
{ averageClusterAccuracy: 0.889100892336931 }
{ averageClusterTargetAccuracy: 0.9329085950658002 }
{ weightedAccuracy: 0.17279877842533975 }
{ weightedTargetAccuracy: 0.10541918298604214 }
Clone this wiki locally