{
  "id": 483978,
  "title": "How to calculate the Leaderboard scores?",
  "url": "/competitions/home-credit-credit-risk-model-stability/discussion/483978",
  "author_name": "",
  "post_date": "2024-03-15T01:09:04.865430700Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I want to pre-calculate the leaderboard scores in my notebook so that I know my ranking before submitting. Thanks.</p>",
  "messages": [
    {
      "id": "2697550",
      "postDate": "03/15/2024 01:09:04",
      "content": "<p>I want to pre-calculate the leaderboard scores in my notebook so that I know my ranking before submitting. Thanks.</p>",
      "rawMarkdown": "I want to pre-calculate the leaderboard scores in my notebook so that I know my ranking before submitting. Thanks.",
      "votes": null
    },
    {
      "id": "2698189",
      "postDate": "03/15/2024 10:42:43",
      "content": "<p>Hi Jie,<br>\nyou can calculate score on train dataset, evaluation metric is described in starter notebook: <a href=\"https://www.kaggle.com/code/jetakow/home-credit-2024-starter-notebook\" target=\"_blank\">https://www.kaggle.com/code/jetakow/home-credit-2024-starter-notebook</a></p>",
      "rawMarkdown": "Hi Jie,\nyou can calculate score on train dataset, evaluation metric is described in starter notebook: https://www.kaggle.com/code/jetakow/home-credit-2024-starter-notebook",
      "votes": null
    },
    {
      "id": "2702162",
      "postDate": "03/17/2024 12:41:36",
      "content": "<p>So you mean, the score on leaderboard comes from 'AUC', right? How about stability metric (from Gini)?</p>",
      "rawMarkdown": "So you mean, the score on leaderboard comes from 'AUC', right? How about stability metric (from Gini)?",
      "votes": null
    },
    {
      "id": "2703358",
      "postDate": "03/18/2024 05:57:17",
      "content": "<p>No, leaderboard scores are calculated by \"full\" metric, that includes both gini and stability part.<br>\nIn starter notebook see gini_stability function</p>",
      "rawMarkdown": "No, leaderboard scores are calculated by \"full\" metric, that includes both gini and stability part.\nIn starter notebook see gini_stability function",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2698189,
      "author_name": "tomasjeline2",
      "author_url": "",
      "post_date": "03/15/2024 10:42:43",
      "content": "<p>Hi Jie,<br>\nyou can calculate score on train dataset, evaluation metric is described in starter notebook: <a href=\"https://www.kaggle.com/code/jetakow/home-credit-2024-starter-notebook\" target=\"_blank\">https://www.kaggle.com/code/jetakow/home-credit-2024-starter-notebook</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2702162,
          "author_name": "iaoddy",
          "author_url": "",
          "post_date": "03/17/2024 12:41:36",
          "content": "<p>So you mean, the score on leaderboard comes from 'AUC', right? How about stability metric (from Gini)?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2703358,
              "author_name": "tomasjeline2",
              "author_url": "",
              "post_date": "03/18/2024 05:57:17",
              "content": "<p>No, leaderboard scores are calculated by \"full\" metric, that includes both gini and stability part.<br>\nIn starter notebook see gini_stability function</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2697550": "I want to pre-calculate the leaderboard scores in my notebook so that I know my ranking before submitting. Thanks.",
    "2698189": "Hi Jie,\nyou can calculate score on train dataset, evaluation metric is described in starter notebook: https://www.kaggle.com/code/jetakow/home-credit-2024-starter-notebook",
    "2702162": "So you mean, the score on leaderboard comes from 'AUC', right? How about stability metric (from Gini)?",
    "2703358": "No, leaderboard scores are calculated by \"full\" metric, that includes both gini and stability part.\nIn starter notebook see gini_stability function"
  },
  "source": "meta"
}