{
  "id": 55502,
  "title": "Evaluation: Confidence",
  "url": "/competitions/cvpr-2018-autonomous-driving/discussion/55502",
  "author_name": "",
  "post_date": "2018-04-27T09:31:24.223491Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Does anybody know why the confidence score is needed in the submission? \nIs it really used to determine the AP?</p>",
  "messages": [
    {
      "id": "320014",
      "postDate": "04/27/2018 09:31:24",
      "content": "<p>Does anybody know why the confidence score is needed in the submission? \nIs it really used to determine the AP?</p>",
      "rawMarkdown": "Does anybody know why the confidence score is needed in the submission? \nIs it really used to determine the AP?",
      "votes": null
    },
    {
      "id": "321318",
      "postDate": "05/01/2018 03:05:06",
      "content": "<p>I believe it's used to calculate mAP.  AP requires ordering predictions by confidence score.</p>",
      "rawMarkdown": "I believe it's used to calculate mAP.  AP requires ordering predictions by confidence score.",
      "votes": null
    },
    {
      "id": "321899",
      "postDate": "05/02/2018 05:39:58",
      "content": "<p>We have updated the evaluation page. </p>\n\n<p>\"If there are multiple predicted instances matched to a ground truth instance, the predicted instance that is larger than the IoU threshold and has the largest confidence is considered as the true positive, and remaining predicted instances are false positives. \"</p>",
      "rawMarkdown": "We have updated the evaluation page. \n\n\"If there are multiple predicted instances matched to a ground truth instance, the predicted instance that is larger than the IoU threshold and has the largest confidence is considered as the true positive, and remaining predicted instances are false positives. \"",
      "votes": null
    },
    {
      "id": "322681",
      "postDate": "05/03/2018 12:26:06",
      "content": "<p>Thanks for the clarification :)</p>",
      "rawMarkdown": "Thanks for the clarification :)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 321318,
      "author_name": "aaalgo",
      "author_url": "",
      "post_date": "05/01/2018 03:05:06",
      "content": "<p>I believe it's used to calculate mAP.  AP requires ordering predictions by confidence score.</p>",
      "votes": null,
      "replies": [
        {
          "id": 322681,
          "author_name": "adamhart",
          "author_url": "",
          "post_date": "05/03/2018 12:26:06",
          "content": "<p>Thanks for the clarification :)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 321899,
      "author_name": "huangxinyu01",
      "author_url": "",
      "post_date": "05/02/2018 05:39:58",
      "content": "<p>We have updated the evaluation page. </p>\n\n<p>\"If there are multiple predicted instances matched to a ground truth instance, the predicted instance that is larger than the IoU threshold and has the largest confidence is considered as the true positive, and remaining predicted instances are false positives. \"</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "320014": "Does anybody know why the confidence score is needed in the submission? \nIs it really used to determine the AP?",
    "321318": "I believe it's used to calculate mAP.  AP requires ordering predictions by confidence score.",
    "321899": "We have updated the evaluation page. \n\n\"If there are multiple predicted instances matched to a ground truth instance, the predicted instance that is larger than the IoU threshold and has the largest confidence is considered as the true positive, and remaining predicted instances are false positives. \"",
    "322681": "Thanks for the clarification :)"
  },
  "source": "meta"
}