{
  "id": 233171,
  "title": "Evaluation metric",
  "url": "/competitions/hotel-id-2021-fgvc8/discussion/233171",
  "author_name": "",
  "post_date": "2021-04-17T17:51:54.943293100Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Can anyone please let me know what this statement means in evaluation?<br>\n<code>Once a correct label has been scored for an observation, that label is no longer considered relevant for that observation, and additional predictions of that label are skipped in the calculation. For example, if the correct label is A for an observation, the following predictions all score an average precision of 1.0.</code></p>",
  "messages": [
    {
      "id": "1276576",
      "postDate": "04/17/2021 17:51:54",
      "content": "<p>Can anyone please let me know what this statement means in evaluation?<br>\n<code>Once a correct label has been scored for an observation, that label is no longer considered relevant for that observation, and additional predictions of that label are skipped in the calculation. For example, if the correct label is A for an observation, the following predictions all score an average precision of 1.0.</code></p>",
      "rawMarkdown": "Can anyone please let me know what this statement means in evaluation?\n`Once a correct label has been scored for an observation, that label is no longer considered relevant for that observation, and additional predictions of that label are skipped in the calculation. For example, if the correct label is A for an observation, the following predictions all score an average precision of 1.0.`",
      "votes": null
    },
    {
      "id": "1278233",
      "postDate": "04/19/2021 17:07:33",
      "content": "<p>That means that if your prediction would be A A A A A(the correct label is A), the evaluation calculation stop at first correct label, so you wont get extra score for other A's, if your prediction would be A B C D E, it will have the same score as the first one. </p>\n<p>I am still a beginner so correct me someone if I am wrong.</p>",
      "rawMarkdown": "That means that if your prediction would be A A A A A(the correct label is A), the evaluation calculation stop at first correct label, so you wont get extra score for other A's, if your prediction would be A B C D E, it will have the same score as the first one. \n\nI am still a beginner so correct me someone if I am wrong.",
      "votes": null
    },
    {
      "id": "1279804",
      "postDate": "04/21/2021 08:42:39",
      "content": "<p>Also do we need to put headers on the columns of submission. I tried both the options with and without headers but I keep getting <em>SUBMISSION SCORING ERROR</em> I am pretty sure about giving 5 most probable hotel ids being outputted in a space separated single cell. Please help me with this?</p>",
      "rawMarkdown": "Also do we need to put headers on the columns of submission. I tried both the options with and without headers but I keep getting *SUBMISSION SCORING ERROR* I am pretty sure about giving 5 most probable hotel ids being outputted in a space separated single cell. Please help me with this?",
      "votes": null
    },
    {
      "id": "1279916",
      "postDate": "04/21/2021 11:18:29",
      "content": "<p>The submission should look like this:</p>\n<p>image,hotel_id <br>\n99e91ad5f2870678.jpg,36363 53586 18807 64314 60181<br>\nb5cc62ab665591a9.jpg,36363 53586 18807 64314 60181<br>\nd5664a972d5a644b.jpg,36363 53586 18807 64314 60181</p>\n<p>With the header, maybe you forgot the image name?</p>",
      "rawMarkdown": "The submission should look like this:\n\nimage,hotel_id \n99e91ad5f2870678.jpg,36363 53586 18807 64314 60181\nb5cc62ab665591a9.jpg,36363 53586 18807 64314 60181\nd5664a972d5a644b.jpg,36363 53586 18807 64314 60181\n\nWith the header, maybe you forgot the image name?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1278233,
      "author_name": "adamosusky",
      "author_url": "",
      "post_date": "04/19/2021 17:07:33",
      "content": "<p>That means that if your prediction would be A A A A A(the correct label is A), the evaluation calculation stop at first correct label, so you wont get extra score for other A's, if your prediction would be A B C D E, it will have the same score as the first one. </p>\n<p>I am still a beginner so correct me someone if I am wrong.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1279804,
      "author_name": "ekapureshubham",
      "author_url": "",
      "post_date": "04/21/2021 08:42:39",
      "content": "<p>Also do we need to put headers on the columns of submission. I tried both the options with and without headers but I keep getting <em>SUBMISSION SCORING ERROR</em> I am pretty sure about giving 5 most probable hotel ids being outputted in a space separated single cell. Please help me with this?</p>",
      "votes": null,
      "replies": [
        {
          "id": 1279916,
          "author_name": "adamosusky",
          "author_url": "",
          "post_date": "04/21/2021 11:18:29",
          "content": "<p>The submission should look like this:</p>\n<p>image,hotel_id <br>\n99e91ad5f2870678.jpg,36363 53586 18807 64314 60181<br>\nb5cc62ab665591a9.jpg,36363 53586 18807 64314 60181<br>\nd5664a972d5a644b.jpg,36363 53586 18807 64314 60181</p>\n<p>With the header, maybe you forgot the image name?</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1276576": "Can anyone please let me know what this statement means in evaluation?\n`Once a correct label has been scored for an observation, that label is no longer considered relevant for that observation, and additional predictions of that label are skipped in the calculation. For example, if the correct label is A for an observation, the following predictions all score an average precision of 1.0.`",
    "1278233": "That means that if your prediction would be A A A A A(the correct label is A), the evaluation calculation stop at first correct label, so you wont get extra score for other A's, if your prediction would be A B C D E, it will have the same score as the first one. \n\nI am still a beginner so correct me someone if I am wrong.",
    "1279804": "Also do we need to put headers on the columns of submission. I tried both the options with and without headers but I keep getting *SUBMISSION SCORING ERROR* I am pretty sure about giving 5 most probable hotel ids being outputted in a space separated single cell. Please help me with this?",
    "1279916": "The submission should look like this:\n\nimage,hotel_id \n99e91ad5f2870678.jpg,36363 53586 18807 64314 60181\nb5cc62ab665591a9.jpg,36363 53586 18807 64314 60181\nd5664a972d5a644b.jpg,36363 53586 18807 64314 60181\n\nWith the header, maybe you forgot the image name?"
  },
  "source": "meta"
}