Skip to content

Face clustering benchmarks

Jump to bottom
Marcel Klehr edited this page May 15, 2023 · 34 revisions

Benchmark: ~22000 photos of the first ~2000 people from IMDb-Face dataset with 20-200 photos each.

v4.0.1

Results 
{ totalPhotos: 22775 }
{ detectedFaces: 14767 }
{ detectedFacesRate: 0.6483863885839737 }
{ detectedTargetFaces: 9115 }
{ clusteredFaces: 2622 }
{ clusteredFacesRate: 0.17755806866662152 }
{ clusteredTargetFaces: 959 }
{ clusteredTargetFacesRate: 0.1052111903455842 }
{ shitClusterRate: 0.10638297872340426 }
{ targettedShitClusterRate: 0.06593406593406594 }
{ averageClusterAccuracy: 0.8848324957536976 }
{ averageClusterTargetAccuracy: 0.9186972476685288 }
{ weightedAccuracy: 0.15710914903949313 }
{ weightedTargetAccuracy: 0.09665723099441789 }

v4.0.1 with voting and smaller minSampleSize

Results ``` { totalPhotos: 22775 } { detectedFaces: 14767 } { detectedFacesRate: 0.6483863885839737 } { detectedTargetFaces: 9115 } { clusteredFaces: 3145 } { clusteredFacesRate: 0.21297487641362498 } { clusteredTargetFaces: 1153 } { clusteredTargetFacesRate: 0.12649478880965442 } { shitClusterRate: 0.13392857142857142 } { targettedShitClusterRate: 0.046296296296296294 } { averageClusterAccuracy: 0.8452653408860407 } { averageClusterTargetAccuracy: 0.9183654501253514 } { weightedAccuracy: 0.1800202815119251 } { weightedTargetAccuracy: 0.11616844366368956 } ```

v4.0.1 with voting and sampled rejections

Results ``` { totalPhotos: 22775 } { detectedFaces: 14767 } { detectedFacesRate: 0.6483863885839737 } { detectedTargetFaces: 9115 } { clusteredFaces: 3421 } { clusteredFacesRate: 0.2316651994311641 } { clusteredTargetFaces: 1257 } { clusteredTargetFacesRate: 0.13790455293472298 } { shitClusterRate: 0.12698412698412698 } { targettedShitClusterRate: 0.05785123966942149 } { averageClusterAccuracy: 0.865709659123329 } { averageClusterTargetAccuracy: 0.9234653901213209 } { weightedAccuracy: 0.2005548008302911 } { weightedTargetAccuracy: 0.1273500817753703 } ```

v4.0.1 with voting, sampled rejections and original min sample size

Results ``` { totalPhotos: 24225 } { detectedFaces: 14767 } { detectedFacesRate: 0.6095768833849329 } { detectedTargetFaces: 9115 } { clusteredFaces: 2839 } { clusteredFacesRate: 0.19225299654635336 } { clusteredTargetFaces: 1024 } { clusteredTargetFacesRate: 0.11234229292375206 } { shitClusterRate: 0.10185185185185185 } { targettedShitClusterRate: 0.04854368932038835 } { averageClusterAccuracy: 0.894196891388111 } { averageClusterTargetAccuracy: 0.9392296444909238 } { weightedAccuracy: 0.1719120318717984 } { weightedTargetAccuracy: 0.10551521184407087 } ```

v4.0.1 with voting , sampled rejections, original min sample size and alpha factor = 0.9

Results ``` { totalPhotos: 24225 } { detectedFaces: 14767 } { detectedFacesRate: 0.6095768833849329 } { detectedTargetFaces: 9115 } { clusteredFaces: 2870 } { clusteredFacesRate: 0.19435227195774363 } { clusteredTargetFaces: 1030 } { clusteredTargetFacesRate: 0.11300054854635216 } { shitClusterRate: 0.1111111111111111 } { targettedShitClusterRate: 0.04854368932038835 } { averageClusterAccuracy: 0.889100892336931 } { averageClusterTargetAccuracy: 0.9329085950658002 } { weightedAccuracy: 0.17279877842533975 } { weightedTargetAccuracy: 0.10541918298604214 } ```

v4.0.1 with voting , sampled rejections, original min sample size and alpha factor = 0.6

Results ``` { totalPhotos: 24225 } { detectedFaces: 14767 } { detectedFacesRate: 0.6095768833849329 } { detectedTargetFaces: 9115 } { clusteredFaces: 2837 } { clusteredFacesRate: 0.19211755942303785 } { clusteredTargetFaces: 1027 } { clusteredTargetFacesRate: 0.11267142073505211 } { shitClusterRate: 0.102803738317757 } { targettedShitClusterRate: 0.049019607843137254 } { averageClusterAccuracy: 0.8933174851658451 } { averageClusterTargetAccuracy: 0.9394205677726438 } { weightedAccuracy: 0.17162197503998797 } { weightedTargetAccuracy: 0.10584585003867308 } ```
Clone this wiki locally