Evaluation

An independent-data benchmark of the Akator Image Matcher's copy-detection performance — recall and precision measured on Open Images V7 at a scale of one million indexed images.

Performance and Robustness of the Akator Image Matcher

Technical Report · AKR-2026-IM-001 · Product version 1.2.18 · June 2026

Download PDF (0.5 MB)

What the report covers

  • Data: Open Images V7 — a public, externally verifiable corpus of natural photographs, so the evaluation is independent of any proprietary data.
  • Scale: a one-million-image index (the "haystack") representing a customer database, plus a separate out-of-index pool that supplies the negative queries.
  • Method: recall measured across 85 parameter configurations spanning 21 manipulation families in four classes; precision via the false-positive rate on 10,000 out-of-index queries. The system is tested black-box, through its production interface.
  • Limitations: the report characterises in full where performance drops — principally reduced recall under coarse geometric change.

Key results

1,000,000
indexed images
0.39%
false-positive rate on 10,000 out-of-index queries
100%
peak recall on colour, compression & watermarks
85 / 21
configurations across 21 manipulation families

All results are conditional on the data distribution and manipulation parameters defined in the report; they are not guarantees for inputs outside those conditions.