{
  "id": 585723,
  "title": "Possible label inconsistencies in test set",
  "url": "/competitions/cupybara/discussion/585723",
  "author_name": "",
  "post_date": "2025-06-22T16:01:35.222121500Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi,</p>\n<p>I noticed a few possible label inconsistencies in the test set. These are the specific files where the original label (original) seems inconsistent with what appears to me to be the actual content (real):</p>\n<h2>filename              | original        | real</h2>\n<p>12230148.mp4    | no_animal   | bird  <br>\n12290201.mp4    | no_animal   | skunk  <br>\nDSCF0002.mp4    | bird        | human  <br>\nDSCF0003.mp4    | bird        | human  <br>\nDSCF0008.mp4    | wild_boar   | cow  <br>\nDSCF0014.mp4    | no_animal   | cow  </p>\n<p>Just flagging this in case it’s useful for the organizers.</p>\n<p>Best,<br>\nJessica</p>",
  "messages": [
    {
      "id": "3230237",
      "postDate": "06/22/2025 16:01:35",
      "content": "<p>Hi,</p>\n<p>I noticed a few possible label inconsistencies in the test set. These are the specific files where the original label (original) seems inconsistent with what appears to me to be the actual content (real):</p>\n<h2>filename              | original        | real</h2>\n<p>12230148.mp4    | no_animal   | bird  <br>\n12290201.mp4    | no_animal   | skunk  <br>\nDSCF0002.mp4    | bird        | human  <br>\nDSCF0003.mp4    | bird        | human  <br>\nDSCF0008.mp4    | wild_boar   | cow  <br>\nDSCF0014.mp4    | no_animal   | cow  </p>\n<p>Just flagging this in case it’s useful for the organizers.</p>\n<p>Best,<br>\nJessica</p>",
      "rawMarkdown": "Hi,\n\nI noticed a few possible label inconsistencies in the test set. These are the specific files where the original label (original) seems inconsistent with what appears to me to be the actual content (real):\n\nfilename              | original        | real\n-----------------------------------------\n12230148.mp4    | no_animal   | bird  \n12290201.mp4    | no_animal   | skunk  \nDSCF0002.mp4    | bird        | human  \nDSCF0003.mp4    | bird        | human  \nDSCF0008.mp4    | wild_boar   | cow  \nDSCF0014.mp4    | no_animal   | cow  \n\nJust flagging this in case it’s useful for the organizers.\n\nBest,\nJessica",
      "votes": null
    },
    {
      "id": "3230890",
      "postDate": "06/23/2025 15:08:32",
      "content": "<p>Hi Jessica,</p>\n<p>You are absolutely right! Thank you for catching that mistake. We appreciate you flagging it.</p>\n<p>We are updating the main test.csv file to reflect the correct tags, but it might take a while. In the meantime, we ask that everyone that reads this to please update your local test.csv file with the changes you suggested.</p>\n<p>This is very helpful, so please continue to let us know if you find any other inconsistencies.</p>",
      "rawMarkdown": "Hi Jessica,\n\nYou are absolutely right! Thank you for catching that mistake. We appreciate you flagging it.\n\nWe are updating the main test.csv file to reflect the correct tags, but it might take a while. In the meantime, we ask that everyone that reads this to please update your local test.csv file with the changes you suggested.\n\nThis is very helpful, so please continue to let us know if you find any other inconsistencies.",
      "votes": null
    },
    {
      "id": "3230986",
      "postDate": "06/23/2025 17:30:15",
      "content": "<p>Hi, Jessica I have added a new test file with the updated labels.<br>\n<em>test_updated.csv</em> </p>\n<p>Thank you for reporting this.</p>",
      "rawMarkdown": "Hi, Jessica I have added a new test file with the updated labels.\n*test_updated.csv* \n\nThank you for reporting this.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3230890,
      "author_name": "leonardoagis",
      "author_url": "",
      "post_date": "06/23/2025 15:08:32",
      "content": "<p>Hi Jessica,</p>\n<p>You are absolutely right! Thank you for catching that mistake. We appreciate you flagging it.</p>\n<p>We are updating the main test.csv file to reflect the correct tags, but it might take a while. In the meantime, we ask that everyone that reads this to please update your local test.csv file with the changes you suggested.</p>\n<p>This is very helpful, so please continue to let us know if you find any other inconsistencies.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3230986,
      "author_name": "galvarez",
      "author_url": "",
      "post_date": "06/23/2025 17:30:15",
      "content": "<p>Hi, Jessica I have added a new test file with the updated labels.<br>\n<em>test_updated.csv</em> </p>\n<p>Thank you for reporting this.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3230237": "Hi,\n\nI noticed a few possible label inconsistencies in the test set. These are the specific files where the original label (original) seems inconsistent with what appears to me to be the actual content (real):\n\nfilename              | original        | real\n-----------------------------------------\n12230148.mp4    | no_animal   | bird  \n12290201.mp4    | no_animal   | skunk  \nDSCF0002.mp4    | bird        | human  \nDSCF0003.mp4    | bird        | human  \nDSCF0008.mp4    | wild_boar   | cow  \nDSCF0014.mp4    | no_animal   | cow  \n\nJust flagging this in case it’s useful for the organizers.\n\nBest,\nJessica",
    "3230890": "Hi Jessica,\n\nYou are absolutely right! Thank you for catching that mistake. We appreciate you flagging it.\n\nWe are updating the main test.csv file to reflect the correct tags, but it might take a while. In the meantime, we ask that everyone that reads this to please update your local test.csv file with the changes you suggested.\n\nThis is very helpful, so please continue to let us know if you find any other inconsistencies.",
    "3230986": "Hi, Jessica I have added a new test file with the updated labels.\n*test_updated.csv* \n\nThank you for reporting this."
  },
  "source": "meta"
}