{
  "id": 377149,
  "title": "Big wall in LB: only 4.12% of teams scored >= 0.579",
  "url": "/competitions/otto-recommender-system/discussion/377149",
  "author_name": "",
  "post_date": "2023-01-10T02:55:39.723301700Z",
  "votes": 9,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I plotted LB score distribution in this <a href=\"https://www.kaggle.com/code/tatamikenn/otto-public-leader-board-2023-01-10?scriptVersionId=115953881\" target=\"_blank\">notebook</a>, and found only 4.12% (92/2231) of teams scored &gt;= 0.579. There exists a big wall in LB. This is a notable number considering 35.1% (783/2231) teams are active in the current 7 days.</p>\n<p>I don't know the ratio of those who implementing GBDT ranker model, but considering some people say they use  it and scored &gt;= 0.579, designing high scoring ranker model should be quite difficult in this competition.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4910466%2F519df5cc13ab92be369aded90606190d%2Fotto-lb-hist.png?generation=1673318418044459&amp;alt=media\" alt=\"LB Score distribution at 2021-01-10\"></p>",
  "messages": [
    {
      "id": "2093453",
      "postDate": "01/10/2023 02:55:39",
      "content": "<p>I plotted LB score distribution in this <a href=\"https://www.kaggle.com/code/tatamikenn/otto-public-leader-board-2023-01-10?scriptVersionId=115953881\" target=\"_blank\">notebook</a>, and found only 4.12% (92/2231) of teams scored &gt;= 0.579. There exists a big wall in LB. This is a notable number considering 35.1% (783/2231) teams are active in the current 7 days.</p>\n<p>I don't know the ratio of those who implementing GBDT ranker model, but considering some people say they use  it and scored &gt;= 0.579, designing high scoring ranker model should be quite difficult in this competition.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4910466%2F519df5cc13ab92be369aded90606190d%2Fotto-lb-hist.png?generation=1673318418044459&amp;alt=media\" alt=\"LB Score distribution at 2021-01-10\"></p>",
      "rawMarkdown": "I plotted LB score distribution in this [notebook], and found only 4.12% (92/2231) of teams scored >= 0.579. There exists a big wall in LB. This is a notable number considering 35.1% (783/2231) teams are active in the current 7 days.\n\nI don't know the ratio of those who implementing GBDT ranker model, but considering some people say they use  it and scored >= 0.579, designing high scoring ranker model should be quite difficult in this competition.\n\n[notebook]: https://www.kaggle.com/code/tatamikenn/otto-public-leader-board-2023-01-10?scriptVersionId=115953881\n\n![LB Score distribution at 2021-01-10](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4910466%2F519df5cc13ab92be369aded90606190d%2Fotto-lb-hist.png?generation=1673318418044459&alt=media)",
      "votes": null
    },
    {
      "id": "2093613",
      "postDate": "01/10/2023 06:26:48",
      "content": "<p>Note: The threshold 0.578 equals to the current highest public notebook<a href=\"https://www.kaggle.com/code/karakasatarik/0-578-ensemble-of-public-notebooks\" target=\"_blank\">^1</a>. So, there might be the case that only 4.12% of teams has successfully implements their own ranker models and most of others just copying the current highest-scored notebook.</p>",
      "rawMarkdown": "Note: The threshold 0.578 equals to the current highest public notebook[^1]. So, there might be the case that only 4.12% of teams has successfully implements their own ranker models and most of others just copying the current highest-scored notebook.\n\n[^1]: https://www.kaggle.com/code/karakasatarik/0-578-ensemble-of-public-notebooks",
      "votes": null
    },
    {
      "id": "2094566",
      "postDate": "01/10/2023 20:49:24",
      "content": "<p>Yeah that is the case.</p>",
      "rawMarkdown": "Yeah that is the case.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2093613,
      "author_name": "tatamikenn",
      "author_url": "",
      "post_date": "01/10/2023 06:26:48",
      "content": "<p>Note: The threshold 0.578 equals to the current highest public notebook<a href=\"https://www.kaggle.com/code/karakasatarik/0-578-ensemble-of-public-notebooks\" target=\"_blank\">^1</a>. So, there might be the case that only 4.12% of teams has successfully implements their own ranker models and most of others just copying the current highest-scored notebook.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2094566,
          "author_name": "abidhasan99",
          "author_url": "",
          "post_date": "01/10/2023 20:49:24",
          "content": "<p>Yeah that is the case.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2093453": "I plotted LB score distribution in this [notebook], and found only 4.12% (92/2231) of teams scored >= 0.579. There exists a big wall in LB. This is a notable number considering 35.1% (783/2231) teams are active in the current 7 days.\n\nI don't know the ratio of those who implementing GBDT ranker model, but considering some people say they use  it and scored >= 0.579, designing high scoring ranker model should be quite difficult in this competition.\n\n[notebook]: https://www.kaggle.com/code/tatamikenn/otto-public-leader-board-2023-01-10?scriptVersionId=115953881\n\n![LB Score distribution at 2021-01-10](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4910466%2F519df5cc13ab92be369aded90606190d%2Fotto-lb-hist.png?generation=1673318418044459&alt=media)",
    "2093613": "Note: The threshold 0.578 equals to the current highest public notebook[^1]. So, there might be the case that only 4.12% of teams has successfully implements their own ranker models and most of others just copying the current highest-scored notebook.\n\n[^1]: https://www.kaggle.com/code/karakasatarik/0-578-ensemble-of-public-notebooks",
    "2094566": "Yeah that is the case."
  },
  "source": "meta"
}