{
  "id": 97576,
  "title": "Explanation re the TP Criteria",
  "url": "/competitions/open-images-2019-visual-relationship/discussion/97576",
  "author_name": "",
  "post_date": "2019-06-27T19:50:22.942132700Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Hi all,</p>\n\n<p>The TP criteria in the Open Images evaluation page:</p>\n\n<p><a href=\"https://storage.googleapis.com/openimages/web/evaluation.html#visual_relationships_eval\">https://storage.googleapis.com/openimages/web/evaluation.html#visual_relationships_eval</a></p>\n\n<p>states as follows:</p>\n\n<p>\"We consider a detected triplet to be a True Positive (TP) if and only if both object boxes have IoU &gt; threshold <strong><em>with a previously undetected ground-truth annotation</em></strong>, and all three labels match their corresponding ground-truth labels\" (emphasis is mine). </p>\n\n<p>Can someone explain \"with a previously undetected ground-truth annotation\" ? </p>",
  "messages": [
    {
      "id": "563052",
      "postDate": "06/27/2019 19:50:22",
      "content": "<p>Hi all,</p>\n\n<p>The TP criteria in the Open Images evaluation page:</p>\n\n<p><a href=\"https://storage.googleapis.com/openimages/web/evaluation.html#visual_relationships_eval\">https://storage.googleapis.com/openimages/web/evaluation.html#visual_relationships_eval</a></p>\n\n<p>states as follows:</p>\n\n<p>\"We consider a detected triplet to be a True Positive (TP) if and only if both object boxes have IoU &gt; threshold <strong><em>with a previously undetected ground-truth annotation</em></strong>, and all three labels match their corresponding ground-truth labels\" (emphasis is mine). </p>\n\n<p>Can someone explain \"with a previously undetected ground-truth annotation\" ? </p>",
      "rawMarkdown": "Hi all,\n\nThe TP criteria in the Open Images evaluation page:\n\nhttps://storage.googleapis.com/openimages/web/evaluation.html#visual_relationships_eval\n\nstates as follows:\n\n\"We consider a detected triplet to be a True Positive (TP) if and only if both object boxes have IoU &gt; threshold ***with a previously undetected ground-truth annotation***, and all three labels match their corresponding ground-truth labels\" (emphasis is mine). \n\nCan someone explain \"with a previously undetected ground-truth annotation\" ?",
      "votes": null
    },
    {
      "id": "576976",
      "postDate": "07/16/2019 08:08:18",
      "content": "<p>Each groundtruth annotation can be matched to exactly one detection triplet. Consequently, if you have two detection triplets both matching to the same groundtruth annotation, one will be marked as TP, and the other one will be marked as FP.</p>",
      "rawMarkdown": "Each groundtruth annotation can be matched to exactly one detection triplet. Consequently, if you have two detection triplets both matching to the same groundtruth annotation, one will be marked as TP, and the other one will be marked as FP.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 576976,
      "author_name": "akuznetsa",
      "author_url": "",
      "post_date": "07/16/2019 08:08:18",
      "content": "<p>Each groundtruth annotation can be matched to exactly one detection triplet. Consequently, if you have two detection triplets both matching to the same groundtruth annotation, one will be marked as TP, and the other one will be marked as FP.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "563052": "Hi all,\n\nThe TP criteria in the Open Images evaluation page:\n\nhttps://storage.googleapis.com/openimages/web/evaluation.html#visual_relationships_eval\n\nstates as follows:\n\n\"We consider a detected triplet to be a True Positive (TP) if and only if both object boxes have IoU &gt; threshold ***with a previously undetected ground-truth annotation***, and all three labels match their corresponding ground-truth labels\" (emphasis is mine). \n\nCan someone explain \"with a previously undetected ground-truth annotation\" ?",
    "576976": "Each groundtruth annotation can be matched to exactly one detection triplet. Consequently, if you have two detection triplets both matching to the same groundtruth annotation, one will be marked as TP, and the other one will be marked as FP."
  },
  "source": "meta"
}