{
  "id": 484616,
  "title": "Why did everyone's scores drop so badly?",
  "url": "/competitions/home-credit-credit-risk-model-stability/discussion/484616",
  "author_name": "",
  "post_date": "2024-03-17T12:32:30.632997100Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Why did everyone's scores drop so badly?<br>\nIn theory, shouldn't only those who opportunely lower their scores in the top half of the leaderboard see their scores drop so much? Why should everyone, including the top of the leaderboard, see their scores drop so much?</p>",
  "messages": [
    {
      "id": "2702147",
      "postDate": "03/17/2024 12:32:30",
      "content": "<p>Why did everyone's scores drop so badly?<br>\nIn theory, shouldn't only those who opportunely lower their scores in the top half of the leaderboard see their scores drop so much? Why should everyone, including the top of the leaderboard, see their scores drop so much?</p>",
      "rawMarkdown": "Why did everyone's scores drop so badly?\nIn theory, shouldn't only those who opportunely lower their scores in the top half of the leaderboard see their scores drop so much? Why should everyone, including the top of the leaderboard, see their scores drop so much?",
      "votes": null
    },
    {
      "id": "2702467",
      "postDate": "03/17/2024 16:38:37",
      "content": "<p>I think that everyone was doing the metric hack</p>",
      "rawMarkdown": "I think that everyone was doing the metric hack",
      "votes": null
    },
    {
      "id": "2703613",
      "postDate": "03/18/2024 09:39:00",
      "content": "<p>It was almost top 200 ppl in public LB. </p>",
      "rawMarkdown": "It was almost top 200 ppl in public LB.",
      "votes": null
    },
    {
      "id": "2704688",
      "postDate": "03/18/2024 21:35:23",
      "content": "<p>Not really, even models with no metric hack score differently now. There was a similar <a href=\"https://www.kaggle.com/competitions/home-credit-credit-risk-model-stability/discussion/483473\" target=\"_blank\">discussion</a> some time ago.</p>",
      "rawMarkdown": "Not really, even models with no metric hack score differently now. There was a similar [discussion](https://www.kaggle.com/competitions/home-credit-credit-risk-model-stability/discussion/483473) some time ago.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2702467,
      "author_name": "davidcanorosillo",
      "author_url": "",
      "post_date": "03/17/2024 16:38:37",
      "content": "<p>I think that everyone was doing the metric hack</p>",
      "votes": null,
      "replies": [
        {
          "id": 2703613,
          "author_name": "jetakow",
          "author_url": "",
          "post_date": "03/18/2024 09:39:00",
          "content": "<p>It was almost top 200 ppl in public LB. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2704688,
          "author_name": "kononenko",
          "author_url": "",
          "post_date": "03/18/2024 21:35:23",
          "content": "<p>Not really, even models with no metric hack score differently now. There was a similar <a href=\"https://www.kaggle.com/competitions/home-credit-credit-risk-model-stability/discussion/483473\" target=\"_blank\">discussion</a> some time ago.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2702147": "Why did everyone's scores drop so badly?\nIn theory, shouldn't only those who opportunely lower their scores in the top half of the leaderboard see their scores drop so much? Why should everyone, including the top of the leaderboard, see their scores drop so much?",
    "2702467": "I think that everyone was doing the metric hack",
    "2703613": "It was almost top 200 ppl in public LB.",
    "2704688": "Not really, even models with no metric hack score differently now. There was a similar [discussion](https://www.kaggle.com/competitions/home-credit-credit-risk-model-stability/discussion/483473) some time ago."
  },
  "source": "meta"
}