{
  "id": 103519,
  "title": "Important information about the challenge data and evaluation",
  "url": "/competitions/open-images-2019-visual-relationship/discussion/103519",
  "author_name": "Alina",
  "post_date": "2019-08-09T18:38:28.553000",
  "votes": 2,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Based on the results of the previous year's challenge and the questions we received, we would like to stress the following points:</p>\n\n<ul>\n<li><p>The images are annotated with positive image-level labels, indicating certain object classes are present, and with negative image-level labels, indicating certain classes are absent. These negative labels are all reliable and can be used during training, e.g. for hard-negative mining which is important when training object detectors.</p></li>\n<li><p>The public leaderboard on the Kaggle website is the most reliable indicator of your performance, as it is based on images and annotations distributed identically to the hidden test set on which participants will be ranked for final evaluation. The validation set is also indicative of performance on the Challenge set, but is not exactly identically distributed. The best reference is the public leaderboard.</p></li>\n</ul>",
  "messages": [
    {
      "id": 595830,
      "postDate": "2019-08-09T18:38:28.553Z",
      "content": "<p>Based on the results of the previous year's challenge and the questions we received, we would like to stress the following points:</p>\n\n<ul>\n<li><p>The images are annotated with positive image-level labels, indicating certain object classes are present, and with negative image-level labels, indicating certain classes are absent. These negative labels are all reliable and can be used during training, e.g. for hard-negative mining which is important when training object detectors.</p></li>\n<li><p>The public leaderboard on the Kaggle website is the most reliable indicator of your performance, as it is based on images and annotations distributed identically to the hidden test set on which participants will be ranked for final evaluation. The validation set is also indicative of performance on the Challenge set, but is not exactly identically distributed. The best reference is the public leaderboard.</p></li>\n</ul>",
      "rawMarkdown": "Based on the results of the previous year's challenge and the questions we received, we would like to stress the following points:\n\n- The images are annotated with positive image-level labels, indicating certain object classes are present, and with negative image-level labels, indicating certain classes are absent. These negative labels are all reliable and can be used during training, e.g. for hard-negative mining which is important when training object detectors.\n\n- The public leaderboard on the Kaggle website is the most reliable indicator of your performance, as it is based on images and annotations distributed identically to the hidden test set on which participants will be ranked for final evaluation. The validation set is also indicative of performance on the Challenge set, but is not exactly identically distributed. The best reference is the public leaderboard.",
      "votes": 2
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "595830": "Based on the results of the previous year's challenge and the questions we received, we would like to stress the following points:\n\n- The images are annotated with positive image-level labels, indicating certain object classes are present, and with negative image-level labels, indicating certain classes are absent. These negative labels are all reliable and can be used during training, e.g. for hard-negative mining which is important when training object detectors.\n\n- The public leaderboard on the Kaggle website is the most reliable indicator of your performance, as it is based on images and annotations distributed identically to the hidden test set on which participants will be ranked for final evaluation. The validation set is also indicative of performance on the Challenge set, but is not exactly identically distributed. The best reference is the public leaderboard."
  }
}