{
  "id": 367783,
  "title": "Ignore cheaters when using leaderboard",
  "url": "/competitions/otto-recommender-system/discussion/367783",
  "author_name": "",
  "post_date": "2022-11-22T02:58:24.093308500Z",
  "votes": 6,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Firstly, I must mention this post is almost purely based on the post by <a href=\"https://www.kaggle.com/forcewithme\" target=\"_blank\">@forcewithme</a> linked at the bottom of the post. So, all the credit belongs to the comprehensive investigation done by <a href=\"https://www.kaggle.com/forcewithme\" target=\"_blank\">@forcewithme</a> , <a href=\"https://www.kaggle.com/chenlin1999\" target=\"_blank\">@chenlin1999</a> and others.</p>\n<p>A brief summary is that we are almost certain some participants for the Open Problems competition have bought their high scoring solutions online. And we have also noticed that some people are trying to do the same for this <strong>OTTO competition too</strong>. Thus, if you notice a \"suspiciously big pile\" of new participants surpassing you on the public leaderboard, they should be reported and <strong>ignored if you want to use the public leaderboard as an indicator of where you currently rank among the participants.</strong></p>\n<p><a href=\"https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366313\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366313</a></p>",
  "messages": [
    {
      "id": "2039248",
      "postDate": "11/22/2022 02:58:24",
      "content": "<p>Firstly, I must mention this post is almost purely based on the post by <a href=\"https://www.kaggle.com/forcewithme\" target=\"_blank\">@forcewithme</a> linked at the bottom of the post. So, all the credit belongs to the comprehensive investigation done by <a href=\"https://www.kaggle.com/forcewithme\" target=\"_blank\">@forcewithme</a> , <a href=\"https://www.kaggle.com/chenlin1999\" target=\"_blank\">@chenlin1999</a> and others.</p>\n<p>A brief summary is that we are almost certain some participants for the Open Problems competition have bought their high scoring solutions online. And we have also noticed that some people are trying to do the same for this <strong>OTTO competition too</strong>. Thus, if you notice a \"suspiciously big pile\" of new participants surpassing you on the public leaderboard, they should be reported and <strong>ignored if you want to use the public leaderboard as an indicator of where you currently rank among the participants.</strong></p>\n<p><a href=\"https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366313\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366313</a></p>",
      "rawMarkdown": "Firstly, I must mention this post is almost purely based on the post by @forcewithme linked at the bottom of the post. So, all the credit belongs to the comprehensive investigation done by @forcewithme , @chenlin1999 and others.\n\nA brief summary is that we are almost certain some participants for the Open Problems competition have bought their high scoring solutions online. And we have also noticed that some people are trying to do the same for this **OTTO competition too**. Thus, if you notice a \"suspiciously big pile\" of new participants surpassing you on the public leaderboard, they should be reported and **ignored if you want to use the public leaderboard as an indicator of where you currently rank among the participants.**\n\nhttps://www.kaggle.com/competitions/open-problems-multimodal/discussion/366313",
      "votes": null
    },
    {
      "id": "2051902",
      "postDate": "12/01/2022 17:40:49",
      "content": "<p>We take these reports very seriously, please contact <a href=\"https://www.kaggle.com/compliance\" target=\"_blank\">Kaggle compliance</a> to log your concerns. </p>",
      "rawMarkdown": "We take these reports very seriously, please contact [Kaggle compliance](https://www.kaggle.com/compliance) to log your concerns.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2051902,
      "author_name": "maggiemd",
      "author_url": "",
      "post_date": "12/01/2022 17:40:49",
      "content": "<p>We take these reports very seriously, please contact <a href=\"https://www.kaggle.com/compliance\" target=\"_blank\">Kaggle compliance</a> to log your concerns. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2039248": "Firstly, I must mention this post is almost purely based on the post by @forcewithme linked at the bottom of the post. So, all the credit belongs to the comprehensive investigation done by @forcewithme , @chenlin1999 and others.\n\nA brief summary is that we are almost certain some participants for the Open Problems competition have bought their high scoring solutions online. And we have also noticed that some people are trying to do the same for this **OTTO competition too**. Thus, if you notice a \"suspiciously big pile\" of new participants surpassing you on the public leaderboard, they should be reported and **ignored if you want to use the public leaderboard as an indicator of where you currently rank among the participants.**\n\nhttps://www.kaggle.com/competitions/open-problems-multimodal/discussion/366313",
    "2051902": "We take these reports very seriously, please contact [Kaggle compliance](https://www.kaggle.com/compliance) to log your concerns."
  },
  "source": "meta"
}