{
  "id": 585621,
  "title": "More information about metric 📈",
  "url": "/competitions/aeroclub-recsys-2025/discussion/585621",
  "author_name": "Antonoof",
  "post_date": "2025-06-21T20:23:49.422000",
  "votes": 3,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I would like to give more information about the HitRate@3 metric.<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2F2d2a9844c557667561678489c680aeb1%2Fmetric.png?generation=1750536923523823&amp;alt=media\" alt=\"metric\"></p>\n<p>The condition rank_i ≤ 3 means that the correct option (the one that the user selected) is in the first three positions of the predicted ranked list.</p>\n<p>Well, let's show example:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Faa2c5ba2461993ef6183c40d8f3b5022%2Ftable1.png?generation=1750537052252338&amp;alt=media\" alt=\"table1\"></p>\n<p>Here, selected = 1 means that the option with Id = 102 was selected by the user.</p>\n<p>Predicted rank:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Fb0ec2d0495992cc96a3fbe1852b229ec%2Fpred.png?generation=1750537101622349&amp;alt=media\" alt=\"pred\"></p>\n<p>In this case, the correct option (with Id = 102) has rank 1, which satisfies the condition rank_i ≤ 3. </p>\n<p>Therefore, for this request, the indicator function value will be 1, and this request will be considered successful in the HitRate@3 metric. If the correct option had a rank of 4 or higher, the rank_i ≤ 3 condition would not be met, and this query would not be counted as successful in the HitRate@3 metric.</p>\n<p>💡 Idea : Rank means priority.</p>\n<p>Maybe you have question:  will the difference between 4 and 5 be taken into account?</p>\n<p>answer: No, HitRate@3 only takes into account whether the correct option is in the top 3, and does not take into account the difference between ranks outside this range.</p>",
  "messages": [
    {
      "id": 3229631,
      "postDate": "2025-06-21T20:23:49.423Z",
      "content": "<p>I would like to give more information about the HitRate@3 metric.<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2F2d2a9844c557667561678489c680aeb1%2Fmetric.png?generation=1750536923523823&amp;alt=media\" alt=\"metric\"></p>\n<p>The condition rank_i ≤ 3 means that the correct option (the one that the user selected) is in the first three positions of the predicted ranked list.</p>\n<p>Well, let's show example:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Faa2c5ba2461993ef6183c40d8f3b5022%2Ftable1.png?generation=1750537052252338&amp;alt=media\" alt=\"table1\"></p>\n<p>Here, selected = 1 means that the option with Id = 102 was selected by the user.</p>\n<p>Predicted rank:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Fb0ec2d0495992cc96a3fbe1852b229ec%2Fpred.png?generation=1750537101622349&amp;alt=media\" alt=\"pred\"></p>\n<p>In this case, the correct option (with Id = 102) has rank 1, which satisfies the condition rank_i ≤ 3. </p>\n<p>Therefore, for this request, the indicator function value will be 1, and this request will be considered successful in the HitRate@3 metric. If the correct option had a rank of 4 or higher, the rank_i ≤ 3 condition would not be met, and this query would not be counted as successful in the HitRate@3 metric.</p>\n<p>💡 Idea : Rank means priority.</p>\n<p>Maybe you have question:  will the difference between 4 and 5 be taken into account?</p>\n<p>answer: No, HitRate@3 only takes into account whether the correct option is in the top 3, and does not take into account the difference between ranks outside this range.</p>",
      "rawMarkdown": "I would like to give more information about the HitRate@3 metric.\n![metric](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2F2d2a9844c557667561678489c680aeb1%2Fmetric.png?generation=1750536923523823&alt=media)\n\nThe condition rank_i ≤ 3 means that the correct option (the one that the user selected) is in the first three positions of the predicted ranked list.\n\nWell, let's show example:\n![table1](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Faa2c5ba2461993ef6183c40d8f3b5022%2Ftable1.png?generation=1750537052252338&alt=media)\n\nHere, selected = 1 means that the option with Id = 102 was selected by the user.\n\nPredicted rank:\n![pred](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Fb0ec2d0495992cc96a3fbe1852b229ec%2Fpred.png?generation=1750537101622349&alt=media)\n\nIn this case, the correct option (with Id = 102) has rank 1, which satisfies the condition rank_i ≤ 3. \n\nTherefore, for this request, the indicator function value will be 1, and this request will be considered successful in the HitRate@3 metric. If the correct option had a rank of 4 or higher, the rank_i ≤ 3 condition would not be met, and this query would not be counted as successful in the HitRate@3 metric.\n\n💡 Idea : Rank means priority.\n\nMaybe you have question:  will the difference between 4 and 5 be taken into account?\n\nanswer: No, HitRate@3 only takes into account whether the correct option is in the top 3, and does not take into account the difference between ranks outside this range.",
      "votes": 3
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "3229631": "I would like to give more information about the HitRate@3 metric.\n![metric](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2F2d2a9844c557667561678489c680aeb1%2Fmetric.png?generation=1750536923523823&alt=media)\n\nThe condition rank_i ≤ 3 means that the correct option (the one that the user selected) is in the first three positions of the predicted ranked list.\n\nWell, let's show example:\n![table1](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Faa2c5ba2461993ef6183c40d8f3b5022%2Ftable1.png?generation=1750537052252338&alt=media)\n\nHere, selected = 1 means that the option with Id = 102 was selected by the user.\n\nPredicted rank:\n![pred](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17954496%2Fb0ec2d0495992cc96a3fbe1852b229ec%2Fpred.png?generation=1750537101622349&alt=media)\n\nIn this case, the correct option (with Id = 102) has rank 1, which satisfies the condition rank_i ≤ 3. \n\nTherefore, for this request, the indicator function value will be 1, and this request will be considered successful in the HitRate@3 metric. If the correct option had a rank of 4 or higher, the rank_i ≤ 3 condition would not be met, and this query would not be counted as successful in the HitRate@3 metric.\n\n💡 Idea : Rank means priority.\n\nMaybe you have question:  will the difference between 4 and 5 be taken into account?\n\nanswer: No, HitRate@3 only takes into account whether the correct option is in the top 3, and does not take into account the difference between ranks outside this range."
  }
}